Articles |
The Benjamini–Hochberg method with infinitely many contrasts in linear models
Area of Information Systems and Quantitative Sciences, Texas Tech University, Lubbock, Texas 79409, U.S.A. peter.westfall{at}ttu.edu
Received for publication 1 May 2007. Revision received 1 February 2008.
Benjamini and Hochberg's method for controlling the false discovery rate is applied to the problem of testing infinitely many contrasts in linear models. Exact, easily calculated critical values are derived, defining a new multiple comparisons method for testing contrasts in linear models. The method is adaptive, depending on the data through the F-statistic, like the Waller–Duncan Bayesian multiple comparisons method. Comparisons with Scheffé's method are given, and the method is extended to the simultaneous confidence intervals of Benjamini and Yekutieli.
Key Words: False coverage rate False discovery rate Multiple comparisons Multiple testing Scheffé's method Waller–Duncan method
References
-
Abramowitz M., Stegun I. A. Handbook of Mathematical Functions (1970) Washington, D.C.: National Bureau of Standards.
Benjamini Y., Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Statist. Soc (1995) B 57:289–300.
Benjamini Y., Yekutieli D. False discovery rate–adjusted multiple confidence intervals for selected parameters. J. Am. Statist. Assoc (2005) 100:71–81.[CrossRef][Web of Science]
Duncan D. B. A Bayesian approach to multiple comparisons. Technometrics (1965) 7:171–222.[CrossRef][Web of Science]
Efron B., Tibshirani R., Storey J., Tusher V. Empirical Bayes analysis of a microarray experiment. J. Am. Statist. Assoc (2001) 96:1151–60.[CrossRef][Web of Science]
Genovese C. R., Wasserman L. Operating characteristics and extensions of the false discovery rate procedure. J. R. Statist. Soc (2002) B 64:499–518.[CrossRef]
Hochberg Y., Tamhane A. C. Multiple Comparison Procedures (1987) New York: Wiley.
Holland B., Cheung S. H. Familywise robustness criteria for multiple comparisons procedures. J. R. Statist. Soc (2002) B 94:63–77.
Hsu J. C. Multiple Comparisons: Theory and Methods (1996) London: Chapman and Hall.
Jeffreys H. The Theory of Probability (1961) 3rd ed. London: Oxford University Press.
Keselman H. J., Cribbie R., Holland B. The pairwise multiple comparison multiplicity problem: An alternative approach to familywise and comparisonwise type I error control. Psychol. Meth (1999) 4:58–69.[CrossRef][Web of Science]
Lewis C., Thayer D. T. A loss function related to the FDR for random effects multiple comparisons. J. Statist. Plan. Infer (2005) 125:49–58.[CrossRef]
Scheffé H. A method for judging all contrasts in the analysis of variance. Biometrika (1953) 40:87–110.
Shaffer J. P. A semi-Bayesian study of Duncan's Bayesian multiple comparison procedure. J. Statist. Plan. Infer (1999) 82:197–213.[CrossRef]
Storey J. D. A direct approach to false discovery rates. J. R. Statist. Soc (2002) B 64:479–98.[CrossRef]
Storey J. D. The optimal discovery procedure: A new approach to simultaneous significance testing. J. R. Statist. Soc (2007) B 69:1–22.
Waller R. A., Duncan D. B. A Bayes rule for the symmetric multiple comparisons problem. J. Am. Statist. Assoc (1969) 64:1484–503.[CrossRef][Web of Science]
Watson G. S. Statistics on Spheres (1983) New York: Wiley.
Westfall P. H., Johnson W. O., Utts J. M. A Bayesian perspective on the Bonferroni adjustment. Biometrika (1997) 84:419–27.
Williams V. S. L., Jones L. V., Tukey J. W. Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. J. Educ. Behav. Statist (1999) 24:42–69.
| ||||||||||||||||||||||||||||||||||||||||||||||||