Skip Navigation


Biometrika Advance Access originally published online on November 19, 2007
Biometrika 2007 94(4):965-975; doi:10.1093/biomet/asm067
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Huang, Y.
Right arrow Articles by Hsu, J. C.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?

© 2007 Biometrika Trust

Articles

Hochberg's Step-Up Method: Cutting Corners Off Holm's Step-Down Method

Yifan Huang

H. Lee Moffitt Cancer Center and Research Institute, University of South Florida, Tampa, Florida 33612, U.S.A. yifan.huang{at}moffitt.org

Jason C. Hsu

Department of Statistics, Ohio State University, Columbus, Ohio 43210, U.S.A. jch{at}stat.ohio-state.edu

Received for publication 1 April 2006. Revision received 1 March 2007.

Holm's method and Hochberg's method for multiple testing can be viewed as step-down and step-up versions of the Bonferroni test. We show that both are special cases of partition testing. The difference is that, while Holm's method tests each partition hypothesis using the largest order statistic, setting a critical value based on the Bonferroni inequality, Hochberg's method tests each partition hypothesis using all the order statistics, setting a series of critical values based on Simes' inequality. Geometrically, Hochberg's step-up method ‘cuts corners’ off the acceptance regions of Holm's step-down method by making assumptions on the joint distribution of the test statistics. As can be expected, partition testing making use of the joint distribution of the test statistics is more powerful than partition testing using probabilistic inequalities. Thus, if the joint distribution of the test statistics is available, through modelling for example, we recommend partition step-down testing, setting exact critical values based on the joint distribution.

Key Words: Hochberg's method • Holm's method • Multiple testing • Partition testing • Step-down test • Step-up test



References

    Finner H., Roters M. On the false discovery rate and expected Type I errors. Biomet. J. (2001) 43:985–1005.[CrossRef]

    Finner H., Strassburger K. The partitioning principle: a powerful tool in multiple decision theory. Ann. Statist. (2002) 30:1194–213.[CrossRef]

    Graybill F. A. Matrices with Applications in Statistics (1983) 2nd. Belmont, CA: Wadsworth.

    Hayter A. J., Hsu J. C. On the relationship between stepwise decision procedures and confidence sets. J. Am. Statist. Assoc. (1994) 89:128–36.[CrossRef][ISI]

    Hochberg Y. A sharper Bonferroni procedure for multiple tests of significance. Biometrika (1988) 75:800–2.[Abstract/Free Full Text]

    Holm S. A simple sequentially rejective multiple test procedure. Scand. J. Statist. (1979) 6:65–70.

    Hommel G. A stagewise rejective multiple test procedure based on a modified Bonferroni test. Biometrika (1988) 75:383–6.[Abstract/Free Full Text]

    Hsu J. C. Multiple Comparisons: Theory and Methods (1996) London: Chapman and Hall.

    Karlin S., Rinott Y. Total positivity properties of absolute value multinormal variables with applications to confidence interval estimation and related probabilistic inequalities. Ann. Statist. (1981) 9:1035–49.[CrossRef]

    Paty D., Li D. Interferon beta-1b is effective in relapsing-remitting multiple sclerosis. II. MRI analysis results of a multicenter, randomised, double-blind, placebo-controlled trial. Neurology (1993) 43:662–6.[Abstract/Free Full Text]

    Sarkar S. Some probability inequalities for ordered MTP2 random variables: A proof of the Simes conjecture. Ann. Statist. (1998) 26:494–504.[CrossRef]

    Simes R. J. An improved Bonferroni procedure for multiple tests of significance. Biometrika (1986) 73:751–4.[Abstract/Free Full Text]

    Stefansson G., Kim W., Hsu J. C. On confidence sets in multiple comparisons. In: Statistical Decision Theory and Related Topics IV—Gupta S. S., Berger J. O., eds. (1988) volume 2. New York: Springer Verlag. 89–104.

    The IFNB Multiple Sclerosis Study Group. Interferon beta-1b is effective in relapsing-remitting multiple sclerosis. I. Clinical results of a multicenter, randomised, double-blind, placebo-controlled trial. Neurology (1993) 43:655–61.[Abstract/Free Full Text]

    The IFNB Multiple Sclerosis Study Group. Interferon beta-1b in the treatment of multiple sclerosis: Final outcome of the randomised, controlled trial. Neurology (1995) 45:1277–85.[Abstract]

    van der Laan M. J., Dudoit S., Pollard K. S. Multiple testing. part ii. step-down procedures for control of the family-wise error rate. Statist. Applic. Genet. Molec. Biol. (2004) 3. http://www.bepress.com/sagmb/vol3/iss1/art14.


Add to CiteULike CiteULike   Add to Connotea Connotea   Add to Del.icio.us Del.icio.us    What's this?



This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Alert me to new issues of the journal
Right arrow Add to My Personal Archive
Right arrow Download to citation manager
Right arrowRequest Permissions
Google Scholar
Right arrow Articles by Huang, Y.
Right arrow Articles by Hsu, J. C.
Right arrow Search for Related Content
Social Bookmarking
Add to CiteULike   Add to Connotea   Add to Del.icio.us  
What's this?