scholarly journals Bayes Estimate of Primary Threshold in Cluster-wise fMRI Inferences

2020 ◽  
Author(s):  
Yunjiang Ge ◽  
Stephanie Hare ◽  
Gang Chen ◽  
James Waltz ◽  
Peter Kochunov ◽  
...  
Keyword(s):  
False Discovery Rate ◽  
Statistical Inference ◽  
Statistical Power ◽  
Empirical Bayes ◽  
Fmri Data ◽  
False Discovery ◽  
Proposed Model ◽  
The Family ◽  
Data Driven Approach ◽  
Selection Of

AbstractCluster-wise statistical inference is the most widely used technique for functional magnetic resonance imaging (fMRI) data analyses. Cluster-wise statistical inference consists of two steps: i) primary thresholding that excludes less significant voxels by a pre-specified cut-off (e.g., p < 0.001); and ii) cluster-wise thresholding that controls the family-wise error rate (FWER) caused by clusters consisting of false positive suprathreshold voxels. It has been well known that the selection of the primary threshold is critical because it determines both statistical power and false discovery rate. However, in most existing statistical packages, the primary threshold is selected based on prior knowledge (e.g., p < 0.001) without taking into account the information in the data. In this manuscript, we propose a data-driven approach to objectively select the optimal primary threshold based on an empirical Bayes framework. We evaluate the proposed model using extensive simulation studies and an fMRI data example. The results show that our method can effectively increase statistical power while effectively controlling the false discovery rate.

On “Field Significance” and the False Discovery Rate

2006 ◽  
Vol 45 (9) ◽  
pp. 1181-1189 ◽  
Author(s):  
D. S. Wilks
Keyword(s):  
False Discovery Rate ◽  
Statistical Power ◽  
Statistical Significance ◽  
Significance Test ◽  
P Value ◽  
Test Statistic ◽  
Global Test ◽  
Additional Advantage ◽  
Counting Procedure ◽  
False Discovery

Abstract The conventional approach to evaluating the joint statistical significance of multiple hypothesis tests (i.e., “field,” or “global,” significance) in meteorology and climatology is to count the number of individual (or “local”) tests yielding nominally significant results and then to judge the unusualness of this integer value in the context of the distribution of such counts that would occur if all local null hypotheses were true. The sensitivity (i.e., statistical power) of this approach is potentially compromised both by the discrete nature of the test statistic and by the fact that the approach ignores the confidence with which locally significant tests reject their null hypotheses. An alternative global test statistic that has neither of these problems is the minimum p value among all of the local tests. Evaluation of field significance using the minimum local p value as the global test statistic, which is also known as the Walker test, has strong connections to the joint evaluation of multiple tests in a way that controls the “false discovery rate” (FDR, or the expected fraction of local null hypothesis rejections that are incorrect). In particular, using the minimum local p value to evaluate field significance at a level αglobal is nearly equivalent to the slightly more powerful global test based on the FDR criterion. An additional advantage shared by Walker’s test and the FDR approach is that both are robust to spatial dependence within the field of tests. The FDR method not only provides a more broadly applicable and generally more powerful field significance test than the conventional counting procedure but also allows better identification of locations with significant differences, because fewer than αglobal × 100% (on average) of apparently significant local tests will have resulted from local null hypotheses that are true.

scholarly journals An averaging strategy to reduce variability in target-decoy estimates of false discovery rate

2018 ◽  
Author(s):  
Uri Keich ◽  
Kaipo Tamura ◽  
William Stafford Noble
Keyword(s):  
False Discovery Rate ◽  
Statistical Power ◽  
Shotgun Proteomics ◽  
Database Search ◽  
Proteomics Data ◽  
Decoy Database ◽  
Software Toolkit ◽  
True Proportion ◽  
False Discovery ◽  
False Discoveries

AbstractDecoy database search with target-decoy competition (TDC) provides an intuitive, easy-to-implement method for estimating the false discovery rate (FDR) associated with spectrum identifications from shotgun proteomics data. However, the procedure can yield different results for a fixed dataset analyzed with different decoy databases, and this decoy-induced variability is particularly problematic for smaller FDR thresholds, datasets or databases. In such cases, the nominal FDR might be 1% but the true proportion of false discoveries might be 10%. The averaged TDC protocol combats this problem by exploiting multiple independently shuffled decoy databases to provide an FDR estimate with reduced variability. We provide a tutorial introduction to aTDC, describe an improved variant of the protocol that offers increased statistical power, and discuss how to deploy aTDC in practice using the Crux software toolkit.

scholarly journals Editorial: Articles, perspectives, and TPDP

2021 ◽  
Vol 11 (2) ◽  
Author(s):  
Lars Vilhuber
Keyword(s):  
False Discovery Rate ◽  
Rate Control ◽  
Previous Issue ◽  
Present Issue ◽  
False Discovery Rate Control ◽  
Data Centre ◽  
False Discovery ◽  
Selection Of

The present issue provides a diverse selection of articles. We introduced a new typeof article, “Perspectives,” in the previous issue, and continue with two such articles in thecurrent issue, both drawn again from presentations made at the October 2020 CanadianResearch Data Centre Network (CRDCN) conference. We also have a new article on the topic of “Privacy Challenges,” as well as  the first of several journal versions of contributions to TPDP 2020. We open with a regular article on the topic of  "Differentiallyprivate false discovery rate control."

scholarly journals Discrete False-Discovery Rate Improves Identification of Differentially Abundant Microbes

mSystems ◽  
2017 ◽  
Vol 2 (6) ◽  
Author(s):  
Lingjing Jiang ◽  
Amnon Amir ◽  
James T. Morton ◽  
Ruth Heller ◽  
Ery Arias-Castro ◽  
...  
Keyword(s):  
Gene Expression ◽  
False Discovery Rate ◽  
Real World ◽  
Statistical Power ◽  
Gene Expression Analysis ◽  
New Method ◽  
Data Sets ◽  
Differential Abundance ◽  
False Discovery ◽  
Microbiome Data

ABSTRACT DS-FDR can achieve higher statistical power to detect significant findings in sparse and noisy microbiome data compared to the commonly used Benjamini-Hochberg procedure and other FDR-controlling procedures. Differential abundance testing is a critical task in microbiome studies that is complicated by the sparsity of data matrices. Here we adapt for microbiome studies a solution from the field of gene expression analysis to produce a new method, discrete false-discovery rate (DS-FDR), that greatly improves the power to detect differential taxa by exploiting the discreteness of the data. Additionally, DS-FDR is relatively robust to the number of noninformative features, and thus removes the problem of filtering taxonomy tables by an arbitrary abundance threshold. We show by using a combination of simulations and reanalysis of nine real-world microbiome data sets that this new method outperforms existing methods at the differential abundance testing task, producing a false-discovery rate that is up to threefold more accurate, and halves the number of samples required to find a given difference (thus increasing the efficiency of microbiome experiments considerably). We therefore expect DS-FDR to be widely applied in microbiome studies. IMPORTANCE DS-FDR can achieve higher statistical power to detect significant findings in sparse and noisy microbiome data compared to the commonly used Benjamini-Hochberg procedure and other FDR-controlling procedures.

Sign in / Sign up

Export Citation Format

Share Document