Adaptive linear step-up procedures that control the false discovery rate
1 Department of Statistics and Operations Research, The Sackler Faculty of Exact Sciences, Tel University, Tel Aviv, Israel. ybenja{at}tau.ac.il, 2 Department of Statistics, The Wharton School of the University of Pennsylvania, Philadelphia, Pennsylvania 19104, U.S.A. krieger{at}wharton.upenn.edu, 3 Department of Statistics and Operations Research, The Sackler Faculty of Exact Sciences, Tel University, Tel Aviv, Israel. yekutiel{at}tau.ac.il
The linear step-up multiple testing procedure controls the false discovery rate at the desired level q for independent and positively dependent test statistics. When all null hypotheses are true, and the test statistics are independent and continuous, the bound is sharp. When some of the null hypotheses are not true, the procedure is conservative by a factor which is the proportion m0/m of the true null hypotheses among the hypotheses. We provide a new two-stage procedure in which the linear step-up procedure is used in stage one to estimate m0, providing a new level q' which is used in the linear step-up procedure in the second stage. We prove that a general form of the two-stage procedure controls the false discovery rate at the desired level q. This framework enables us to study analytically the properties of other procedures that exist in the literature. A simulation study is presented that shows that two-stage adaptive procedures improve in power over the original procedure, mainly because they provide tighter control of the false discovery rate. We further study the performance of the current suggestions, some variations of the procedures, and previous suggestions, in the case where the test statistics are positively dependent, a case for which the original procedure controls the false discovery rate. In the setting studied here the newly proposed two-stage procedure is the only one that controls the false discovery rate. The procedures are illustrated with two examples of biological importance.
Key Words: False discovery rate; Multiple testing; Two-stage procedure.
Received September 2003. Revised February 2006.
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  W. Guo A note on adaptive Bonferroni and Holm procedures under dependence Biometrika, December 1, 2009; 96(4): 1012 - 1018. [Abstract] [PDF]
|
|
|
|
 |
|
 Y. Benjamini, R. Heller, and D. Yekutieli Selective inference in complex research Phil Trans R Soc A, November 13, 2009; 367(1906): 4255 - 4271. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. Heller, E. Manduchi, G. R. Grant, and W. J. Ewens A flexible two-stage procedure for identifying gene sets that are differentially expressed Bioinformatics, April 15, 2009; 25(8): 1019 - 1025. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Jerger, N. Tye-Murray, and H. Abdi Role of Visual Speech in Phonological Processing by Children With Hearing Loss J Speech Lang Hear Res, April 1, 2009; 52(2): 412 - 434. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. Nakano, H. Watanabe, F. Homae, and G. Taga Prefrontal Cortical Involvement in Young Infants' Analysis of Novelty Cereb Cortex, February 1, 2009; 19(2): 455 - 463. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F. Liang and J. Zhang Estimating the false discovery rate using the stochastic approximation algorithm Biometrika, December 1, 2008; 95(4): 961 - 977. [Abstract] [PDF]
|
|
|
|
 |
|
 A. Farcomeni A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion Statistical Methods in Medical Research, August 1, 2008; 17(4): 347 - 388. [Abstract] [PDF]
|
|
|
|
|
|
A. Cohen, H. B. Sackrowitz, M. Xu, and S. Buyske A family of Bayes multiple testing procedures Biometrika, June 1, 2008; 95(2): 295 - 305. [Abstract] [PDF]
|
|
|
|
|
|
A. Reiner-Benaim, D. Yekutieli, N. E. Letwin, G. I. Elmer, N. H. Lee, N. Kafkafi, and Y. Benjamini Associating quantitative behavioral traits with gene expression in the brain: searching for diamonds in the hay Bioinformatics, September 1, 2007; 23(17): 2239 - 2246. [Abstract] [Full Text] [PDF]
|
|