Multiple testing via FDRL for large-scale imaging data
Open Access
- 1 February 2011
- journal article
- Published by Institute of Mathematical Statistics in The Annals of Statistics
- Vol. 39 (1)
- https://doi.org/10.1214/10-aos848
Abstract
The multiple testing procedure plays an important role in detecting the presence of spatial signals for large-scale imaging data. Typically, the spatial signals are sparse but clustered. This paper provides empirical evidence that for a range of commonly used control levels, the conventional $\operatorname {FDR}$ procedure can lack the ability to detect statistical significance, even if the $p$-values under the true null hypotheses are independent and uniformly distributed; more generally, ignoring the neighboring information of spatially structured data will tend to diminish the detection effectiveness of the $\operatorname {FDR}$ procedure. This paper first introduces a scalar quantity to characterize the extent to which the "lack of identification phenomenon" ($\operatorname {LIP}$) of the $\operatorname {FDR}$ procedure occurs. Second, we propose a new multiple comparison procedure, called $\operatorname {FDR}_L$, to accommodate the spatial information of neighboring $p$-values, via a local aggregation of $p$-values. Theoretical properties of the $\operatorname {FDR}_L$ procedure are investigated under weak dependence of $p$-values. It is shown that the $\operatorname {FDR}_L$ procedure alleviates the $\operatorname {LIP}$ of the $\operatorname {FDR}$ procedure, thus substantially facilitating the selection of more stringent control levels. Simulation evaluations indicate that the $\operatorname {FDR}_L$ procedure improves the detection sensitivity of the $\operatorname {FDR}$ procedure with little loss in detection specificity. The computational simplicity and detection effectiveness of the $\operatorname {FDR}_L$ procedure are illustrated through a real brain fMRI dataset.Comment: Published in at http://dx.doi.org/10.1214/10-AOS848 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of Mathematical Statistics (http://www.imstat.org
Keywords
This publication has 25 references indexed in Scilit:
- A general framework for multiple testing dependenceProceedings of the National Academy of Sciences, 2008
- To How Many Simultaneous Hypothesis Tests Can Normal, Student'stor Bootstrap Calibration Be Applied?Journal of the American Statistical Association, 2007
- False Discovery Rates for Spatial SignalsJournal of the American Statistical Association, 2007
- False discovery and false nondiscovery rates in single-step multiple testing proceduresThe Annals of Statistics, 2006
- Large-Scale Simultaneous Hypothesis TestingJournal of the American Statistical Association, 2004
- Multiple Hypothesis Testing in Microarray ExperimentsStatistical Science, 2003
- A Direct Approach to False Discovery RatesJournal of the Royal Statistical Society Series B: Statistical Methodology, 2002
- The control of the false discovery rate in multiple testing under dependencyThe Annals of Statistics, 2001
- Diffusion tensor imaging: Concepts and applicationsJournal of Magnetic Resonance Imaging, 2001
- AFNI: Software for Analysis and Visualization of Functional Magnetic Resonance NeuroimagesComputers and Biomedical Research, 1996