Skip Navigation

Biometrika 2008 95(3):709-719; doi:10.1093/biomet/asn033
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Westfall, P. H.
Right arrow Search for Related Content
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© 2008 Biometrika Trust

Articles

The Benjamini–Hochberg method with infinitely many contrasts in linear models

Peter H. Westfall

Area of Information Systems and Quantitative Sciences, Texas Tech University, Lubbock, Texas 79409, U.S.A. peter.westfall{at}ttu.edu

Received for publication 1 May 2007. Revision received 1 February 2008.

Benjamini and Hochberg's method for controlling the false discovery rate is applied to the problem of testing infinitely many contrasts in linear models. Exact, easily calculated critical values are derived, defining a new multiple comparisons method for testing contrasts in linear models. The method is adaptive, depending on the data through the F-statistic, like the Waller–Duncan Bayesian multiple comparisons method. Comparisons with Scheffé's method are given, and the method is extended to the simultaneous confidence intervals of Benjamini and Yekutieli.

Key Words: False coverage rate • False discovery rate • Multiple comparisons • Multiple testing • Scheffé's method • Waller–Duncan method



References

    Abramowitz M., Stegun I. A. Handbook of Mathematical Functions (1970) Washington, D.C.: National Bureau of Standards.

    Benjamini Y., Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Statist. Soc (1995) B 57:289–300.

    Benjamini Y., Yekutieli D. False discovery rate–adjusted multiple confidence intervals for selected parameters. J. Am. Statist. Assoc (2005) 100:71–81.[CrossRef][Web of Science]

    Duncan D. B. A Bayesian approach to multiple comparisons. Technometrics (1965) 7:171–222.[CrossRef][Web of Science]

    Efron B., Tibshirani R., Storey J., Tusher V. Empirical Bayes analysis of a microarray experiment. J. Am. Statist. Assoc (2001) 96:1151–60.[CrossRef][Web of Science]

    Genovese C. R., Wasserman L. Operating characteristics and extensions of the false discovery rate procedure. J. R. Statist. Soc (2002) B 64:499–518.[CrossRef]

    Hochberg Y., Tamhane A. C. Multiple Comparison Procedures (1987) New York: Wiley.

    Holland B., Cheung S. H. Familywise robustness criteria for multiple comparisons procedures. J. R. Statist. Soc (2002) B 94:63–77.

    Hsu J. C. Multiple Comparisons: Theory and Methods (1996) London: Chapman and Hall.

    Jeffreys H. The Theory of Probability (1961) 3rd ed. London: Oxford University Press.

    Keselman H. J., Cribbie R., Holland B. The pairwise multiple comparison multiplicity problem: An alternative approach to familywise and comparisonwise type I error control. Psychol. Meth (1999) 4:58–69.[CrossRef][Web of Science]

    Lewis C., Thayer D. T. A loss function related to the FDR for random effects multiple comparisons. J. Statist. Plan. Infer (2005) 125:49–58.[CrossRef]

    Scheffé H. A method for judging all contrasts in the analysis of variance. Biometrika (1953) 40:87–110.[Abstract/Free Full Text]

    Shaffer J. P. A semi-Bayesian study of Duncan's Bayesian multiple comparison procedure. J. Statist. Plan. Infer (1999) 82:197–213.[CrossRef]

    Storey J. D. A direct approach to false discovery rates. J. R. Statist. Soc (2002) B 64:479–98.[CrossRef]

    Storey J. D. The optimal discovery procedure: A new approach to simultaneous significance testing. J. R. Statist. Soc (2007) B 69:1–22.

    Waller R. A., Duncan D. B. A Bayes rule for the symmetric multiple comparisons problem. J. Am. Statist. Assoc (1969) 64:1484–503.[CrossRef][Web of Science]

    Watson G. S. Statistics on Spheres (1983) New York: Wiley.

    Westfall P. H., Johnson W. O., Utts J. M. A Bayesian perspective on the Bonferroni adjustment. Biometrika (1997) 84:419–27.[Abstract/Free Full Text]

    Williams V. S. L., Jones L. V., Tukey J. W. Controlling error in multiple comparisons, with examples from state-to-state differences in educational achievement. J. Educ. Behav. Statist (1999) 24:42–69.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Westfall, P. H.
Right arrow Search for Related Content
Social Bookmarking
 Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?