© 1986 by Biometrika Trust
An improved Bonferroni procedure for multiple tests of significance
Ludwig Institute for Cancer Research, University of Sydney Sydney, N.S.W. 2006, Australia
A modification of the Bonferroni procedure for testing multiple hypotheses is presented. The method, based on the ordered p-values of the individual tests, is less conservative than the classical Bonferroni procedure but is still simple to apply. A simulation study shows that the probability of a type I error of the procedure does not exceed the nominal significance level, 
, for a variety of multivariate normal and multivariate gamma test statistics. For independent tests the procedure has type I error probability equal to . The method appears particularly advantageous over the classical Bonferroni procedure when several highly-correlated test statistics are involved.
Key Words: Bonferroni inequality • Multiple comparisons • Simultaneous test procedures
CiteULike 
Connotea 
Del.icio.us What's this?
This article has been cited by other articles:
|
|
 |
|
  E. Kazakou, C. Violle, C. Roumet, C. Pintor, O. Gimenez, and E. Garnier Litter quality and decomposability of species from a Mediterranean succession depend on leaf traits but not on nitrogen supply Ann. Bot., November 1, 2009; 104(6): 1151 - 1161. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. Zhang, K. Sun, Y. Yang, H. Zhang, F. B. Hu, and R. Hui Plasma Uric Acid and Hypertension in a Chinese Community: Prospective Study and Metaanalysis Clin. Chem., November 1, 2009; 55(11): 2026 - 2034. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. Zhang, K. Sun, Y. Zhen, D. Wang, Y. Wang, J. Chen, J. Xu, F. B. Hu, and R. Hui VEGF Receptor-2 Variants Are Associated With Susceptibility to Stroke and Recurrence Stroke, August 1, 2009; 40(8): 2720 - 2726. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Turchin, M. E. Matheny, M. Shubina, J. V. Scanlon, B. Greenwood, and M. L. Pendergrass Hypoglycemia and Clinical Outcomes in Patients With Diabetes Hospitalized in the General Ward Diabetes Care, July 1, 2009; 32(7): 1153 - 1157. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Turchin, M. Shubina, E. Breydo, M. L. Pendergrass, and J. S. Einbinder Comparison of Information Content of Structured and Narrative Text Data Sources on the Example of Medication Intensification J. Am. Med. Inform. Assoc., May 1, 2009; 16(3): 362 - 370. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. A. Shabalina, D. V. Zaykin, P. Gris, A. Y. Ogurtsov, J. Gauthier, K. Shibata, I. E. Tchivileva, I. Belfer, B. Mishra, C. Kiselycznyk, et al. Expansion of the human {micro}-opioid receptor gene architecture: novel functional variants Hum. Mol. Genet., March 15, 2009; 18(6): 1037 - 1051. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E. Kulinskaya and A. Lewin On fuzzy familywise error rate and false discovery rate procedures for discrete distributions Biometrika, March 1, 2009; 96(1): 201 - 211. [Abstract] [PDF]
|
|
|
|
 |
|
 M. K. Liem, S. A. J. Lesnik Oberstein, J. Haan, I. L. van der Neut, R. van den Boom, M. D. Ferrari, M. A. van Buchem, and J. van der Grond Cerebral Autosomal Dominant Arteriopathy with Subcortical Infarcts and Leukoencephalopathy: Progression of MR Abnormalities in Prospective 7-year Follow-up Study Radiology, December 1, 2008; 249(3): 964 - 971. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. H. Buurke, A. V. Nene, G. Kwakkel, V. Erren-Wolters, M. J. IJzerman, and H. J. Hermens Recovery of Gait After Stroke: What Changes? Neurorehabil Neural Repair, November 1, 2008; 22(6): 676 - 683. [Abstract] [PDF]
|
|
|
|
 |
|
 Y. Chen, F. Rao, J. L. Rodriguez-Flores, M. Mahata, M. M. Fung, M. Stridsberg, S. M. Vaingankar, G. Wen, R. M. Salem, M. Das, et al. Naturally Occurring Human Genetic Variation in the 3'-Untranslated Region of the Secretory Protein Chromogranin A Is Associated With Autonomic Blood Pressure Regulation and Hypertension in a Sex-Dependent Fashion J. Am. Coll. Cardiol., October 28, 2008; 52(18): 1468 - 1481. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 P. Kortebein, T. B. Symons, A. Ferrando, D. Paddon-Jones, O. Ronsen, E. Protas, S. Conger, J. Lombeida, R. Wolfe, and W. J. Evans Functional Impact of 10 Days of Bed Rest in Healthy Older Adults J. Gerontol. A Biol. Sci. Med. Sci., October 1, 2008; 63(10): 1076 - 1081. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 T. S Sharma, D. D Kinnamon, C. Duggan, G. A Weinberg, L. Furuta, L. Bechard, J. Nicchitta, S. L Gorbach, and T. L Miller Changes in macronutrient intake among HIV-infected children between 1995 and 2004 Am. J. Clinical Nutrition, August 1, 2008; 88(2): 384 - 391. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. W. Hsing, L. C. Sakoda, A. Rashid, G. Andreotti, J. Chen, B.-S. Wang, M.-C. Shen, B. E. Chen, P. S. Rosenberg, M. Zhang, et al. Variants in Inflammation Genes and the Risk of Biliary Tract Cancers and Stones: A Population-Based Study in China Cancer Res., August 1, 2008; 68(15): 6442 - 6452. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A. Farcomeni A review of modern multiple hypothesis testing, with particular attention to the false discovery proportion Statistical Methods in Medical Research, August 1, 2008; 17(4): 347 - 388. [Abstract] [PDF]
|
|
|
|
 |
|
 M. Fukuda, M. Nishida, C. Juhasz, O. Muzik, S. Sood, H. T. Chugani, and E. Asano Short-latency median-nerve somatosensory-evoked potentials and induced gamma-oscillations in humans Brain, July 1, 2008; 131(7): 1793 - 1805. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S.-C. Chang, A. Rashid, Y.-T. Gao, G. Andreotti, M.-C. Shen, B.-S. Wang, T.-Q. Han, B.-H. Zhang, L. C. Sakoda, M. F. Leitzmann, et al. Polymorphism of genes related to insulin sensitivity and the risk of biliary tract cancer and biliary stone: a population-based case-control study in Shanghai, China Carcinogenesis, May 1, 2008; 29(5): 944 - 948. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 K. B. Mitchell, L. Gugerty, and E. Muth Effects of Brief Training on Use of Automated External Defibrillators by People Without Medical Expertise Human Factors: The Journal of the Human Factors and Ergonomics Society, April 1, 2008; 50(2): 301 - 310. [Abstract] [PDF]
|
|
|
|
 |
|
 P. Sehatpour, S. Molholm, T. H. Schwartz, J. R. Mahoney, A. D. Mehta, D. C. Javitt, P. K. Stanton, and J. J. Foxe A human intracranial study of long-range oscillatory coherence across a frontal-occipital-hippocampal brain network during visual object processing PNAS, March 18, 2008; 105(11): 4399 - 4404. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. Andreotti, J. Chen, Y.-T. Gao, A. Rashid, B. E. Chen, P. Rosenberg, L. C. Sakoda, J. Deng, M.-C. Shen, B.-S. Wang, et al. Polymorphisms of Genes in the Lipid Metabolism Pathway and Risk of Biliary Tract Cancers and Stones: A Population-Based Case-Control Study in Shanghai, China Cancer Epidemiol. Biomarkers Prev., March 1, 2008; 17(3): 525 - 534. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
K. N. Danforth, R. B. Hayes, C. Rodriguez, K. Yu, L. C. Sakoda, W.-Y. Huang, B. E. Chen, J. Chen, G. L. Andriole, E. E. Calle, et al. Polymorphic variants in PTGS2 and prostate cancer risk: results from two large nested case-control studies Carcinogenesis, March 1, 2008; 29(3): 568 - 572. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. M. Fung, C. Nguyen, P. Mehtani, R. M. Salem, B. Perez, B. Thomas, M. Das, N. J. Schork, S. K. Mahata, M. G. Ziegler, et al. Genetic Variation Within Adrenergic Pathways Determines In Vivo Effects of Presynaptic Stimulation in Humans Circulation, January 29, 2008; 117(4): 517 - 525. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 J. D. Brunstein, C. L. Cline, S. McKinney, and E. Thomas Evidence from Multiplex Molecular Assays for Complex Multipathogen Interactions in Acute Respiratory Infections J. Clin. Microbiol., January 1, 2008; 46(1): 97 - 102. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
W.-Y. Huang, Y.-T. Gao, A. Rashid, L. C. Sakoda, J. Deng, M.-C. Shen, B.-S. Wang, T.-Q. Han, B.-H. Zhang, B. E. Chen, et al. Selected base excision repair gene polymorphisms and susceptibility to biliary tract cancer and biliary stones: a population-based case-control study in China Carcinogenesis, January 1, 2008; 29(1): 100 - 105. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
Y. Huang and J. C. Hsu Hochberg's Step-Up Method: Cutting Corners Off Holm's Step-Down Method Biometrika, December 1, 2007; 94(4): 965 - 975. [Abstract] [PDF]
|
|
|
|
 |
|
 C. A. Chestek, A. P. Batista, G. Santhanam, B. M. Yu, A. Afshar, J. P. Cunningham, V. Gilja, S. I. Ryu, M. M. Churchland, and K. V. Shenoy Single-Neuron Stability during Repeated Reaching in Macaque Premotor Cortex J. Neurosci., October 3, 2007; 27(40): 10742 - 10750. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
F. Noel, N. Machon, and E. Porcher No Genetic Diversity at Molecular Markers and Strong Phenotypic Plasticity in Populations of Ranunculus nodiflorus, an Endangered Plant Species in France Ann. Bot., June 1, 2007; 99(6): 1203 - 1212. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. T. Enander, R. N. Gagnon, R. C. Hanumara, E. Park, T. Armstrong, and D. M. Gute Environmental Health Practice: Statistically Based Performance Measurement Am J Public Health, May 1, 2007; 97(5): 819 - 824. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
J. E. Taylor, K. J. Worsley, and F. Gosselin Maxima of discretely sampled random fields, with an application to 'bubbles' Biometrika, March 1, 2007; 94(1): 1 - 18. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 E Normann, J Gnarpe, B Wettergren, C Janson, M Wickman, and L Nordvall Association between Chlamydia pneumoniae antibodies and wheezing in young children and the influence of sex Thorax, December 1, 2006; 61(12): 1054 - 1058. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. J. GLATT, W. S. STONE, S. V. FARAONE, L. J. SEIDMAN, and M. T. TSUANG Psychopathology, personality traits and social development of young first-degree relatives of patients with schizophrenia The British Journal of Psychiatry, October 1, 2006; 189(4): 337 - 345. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 G. Montalescot, H. D. White, R. Gallo, M. Cohen, P. G. Steg, P. E.G. Aylward, C. Bode, M. Chiariello, S. B. King III, R. A. Harrington, et al. Enoxaparin versus unfractionated heparin in elective percutaneous coronary intervention. N. Engl. J. Med., September 7, 2006; 355(10): 1006 - 1017. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. F. Weinreb, J. C. Buckner, V. Williams, and J. Nicholson A Comparison of the Health and Mental Health Status of Homeless Mothers in Worcester, Mass: 1993 and 2003 Am J Public Health, August 1, 2006; 96(8): 1444 - 1448. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
E. A. Latimer, T. Lecomte, D. R. Becker, R. E. Drake, I. Duclos, M. Piat, N. Lahaie, M.-S. St-Pierre, C. Therrien, and H. Xie Generalisability of the individual placement and support model of supported employment: results of a Canadian randomised controlled trial The British Journal of Psychiatry, July 1, 2006; 189(1): 65 - 73. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 M. P. WARD SPREAD OF EQUINE WEST NILE VIRUS ENCEPHALOMYELITIS DURING THE 2002 TEXAS EPIDEMIC Am J Trop Med Hyg, June 1, 2006; 74(6): 1090 - 1095. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
L. C. Sakoda, Y.-T. Gao, B. E. Chen, J. Chen, P. S. Rosenberg, A. Rashid, J. Deng, M.-C. Shen, B.-S. Wang, T.-Q. Han, et al. Prostaglandin-endoperoxide synthase 2 (PTGS2) gene polymorphisms and risk of biliary tract cancer and gallstones: a population-based study in Shanghai, China Carcinogenesis, June 1, 2006; 27(6): 1251 - 1256. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 L Howard, S Wessely, M Leese, L Page, P McCrone, K Husain, J Tong, and A Dowson Are investigations anxiolytic or anxiogenic? A randomised controlled trial of neuroimaging to provide reassurance in chronic daily headache J. Neurol. Neurosurg. Psychiatry, November 1, 2005; 76(11): 1558 - 1564. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 R. C. Moore, S. R. Grant, and M. D. Purugganan Molecular Population Genetics of Redundant Floral-Regulatory Genes in Arabidopsis thaliana Mol. Biol. Evol., January 1, 2005; 22(1): 91 - 103. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. S. W. Wong, Z. Yang, N. Goldman, and R. Nielsen Accuracy and Power of Statistical Methods for Detecting Adaptive Evolution in Protein Coding Sequences and for Identifying Positively Selected Sites Genetics, October 1, 2004; 168(2): 1041 - 1051. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
D. V Mehrotra and J. F Heyse Use of the false discovery rate for evaluating clinical safety data Statistical Methods in Medical Research, June 1, 2004; 13(3): 227 - 238. [Abstract] [PDF]
|
|
|
|
 |
|
 K. F. Manly, D. Nettleton, and J.T. G. Hwang Genomics, Prior Probability, and Statistical Tests of Multiple Hypotheses Genome Res., June 1, 2004; 14(6): 997 - 1001. [Full Text] [PDF]
|
|
|
|
 |
|
 R. G. York, J. Barnett Jr., W. R. Brown, R. H. Garman, D. R. Mattie, and D. Dodd A Rat Neurodevelopmental Evaluation of Offspring, Including Evaluation of Adult and Neonatal Thyroid, from Mothers Treated with Ammonium Perchlorate in Drinking Water International Journal of Toxicology, May 1, 2004; 23(3): 191 - 214. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. D. Megremis, I. G. Vlachonikolis, and A. M. Tsilimigaki Spleen Length in Childhood with US: Normal Values Based on Age, Sex, and Somatometric Parameters Radiology, April 1, 2004; 231(1): 129 - 134. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. Zhu, N. D. Volkow, Y. Ma, J. S. Fowler, and G.-J. Wang RELATIONSHIP BETWEEN ETHANOL-INDUCED CHANGES IN BRAIN REGIONAL METABOLISM AND ITS MOTOR, BEHAVIOURAL AND COGNITIVE EFFECTS Alcohol Alcohol., January 1, 2004; 39(1): 53 - 58. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
R. C. Moore and M. D. Purugganan The early stages of duplicate gene evolution PNAS, December 23, 2003; 100(26): 15682 - 15687. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
T. Nichols and S. Hayasaka Controlling the familywise error rate in functional neuroimaging: a comparative review Statistical Methods in Medical Research, October 1, 2003; 12(5): 419 - 446. [Abstract] [PDF]
|
|
|
|
 |
|
 L. B. Krupp, L. G. Hyman, R. Grimson, P. K. Coyle, P. Melville, S. Ahnn, R. Dattwyler, and B. Chandler Study and treatment of post Lyme disease (STOP-LD): A randomized double masked clinical trial Neurology, June 24, 2003; 60(12): 1923 - 1930. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 A.-C. Cremieux, C. Muller-Serieys, X. Panhard, F. Delatour, M. Tchimichkian, F. Mentre, and A. Andremont Emergence of Resistance in Normal Human Aerobic Commensal Flora during Telithromycin and Amoxicillin-Clavulanic Acid Treatments Antimicrob. Agents Chemother., June 1, 2003; 47(6): 2030 - 2035. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 W. Winters, S. Devriese, I. Van Diest, B. Nemery, H. Veulemans, P. Eelen, K. Van de Woestijne, and O. Van den Bergh Media Warnings About Environmental Pollution Facilitate the Acquisition of Symptoms in Response to Chemical Substances Psychosom Med, May 1, 2003; 65(3): 332 - 338. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 Y. Ren, H. Yu, H. Wang, O. A. Carretero, and J. L. Garvin Nystatin and valinomycin induce tubuloglomerular feedback Am J Physiol Renal Physiol, December 1, 2001; 281(6): F1102 - F1108. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 S. Bortoluzzi, F. d’Alessi, and G. A. Danieli A Novel Resource for the Study of Genes Expressed in the Adult Human Retina Invest. Ophthalmol. Vis. Sci., October 1, 2000; 41(11): 3305 - 3308. [Abstract] [Full Text]
|
|
|
|
 |
|
 Y. Benjamini and Y. Hochberg On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics Journal of Educational and Behavioral Statistics, January 1, 2000; 25(1): 60 - 83. [Abstract] [PDF]
|
|
|
|
|
|
E. R. Muth, K. L. Koch, R. M. Stern, and J. F. Thayer Effect of Autonomic Nervous System Manipulations on Gastric Myoelectrical Activity and Emotional Responses in Healthy Human Subjects Psychosom Med, May 1, 1999; 61(3): 297 - 303. [Abstract] [Full Text] [PDF]
|
|
|
|
 |
|
 B. A. Bettencourt and N. Dorr Cooperative Interaction and Intergroup Bias: Effects of Numerical Representation and Cross-Cut Role Assignment Pers Soc Psychol Bull, December 1, 1998; 24(12): 1276 - 1293. [Abstract]
|
|
|
|
 |
|
 W. R. Bishai, N. M. H. Graham, S. Harrington, D. S. Pope, N. Hooper, J. Astemborski, L. Sheely, D. Vlahov, G. E. Glass, and R. E. Chaisson Molecular and Geographic Patterns of Tuberculosis Transmission After 15 Years of Directly Observed Therapy JAMA, November 18, 1998; 280(19): 1679 - 1684. [Abstract] [Full Text] [PDF]
|
|
|
|
|
|
S. Bortoluzzi, L. Rampoldi, B. Simionati, R. Zimbello, A. Barbon, F. d'Alessi, N. Tiso, A. Pallavicini, S. Toppo, N. Cannata, et al. A Comprehensive, High-Resolution Genomic Transcript Map of Human Skeletal Muscle Genome Res., August 1, 1998; 8(8): 817 - 825. [Abstract] [Full Text]
|
|
|
|
|
|
G. R. Hancock and A. J. Klockars Finite Intersection Tests: A Paradigm for Optimizing Simultaneous and Sequential Inference Journal of Educational and Behavioral Statistics, January 1, 1997; 22(3): 291 - 307. [Abstract] [PDF]
|
|
|
|
|
|
S. Olejnik, J. Li, S. Supattathum, and C. J. Huberty Multiple Testing and Statistical Power With Modified Bonferroni Procedures Journal of Educational and Behavioral Statistics, January 1, 1997; 22(4): 389 - 406. [Abstract] [PDF]
|
|
|
|
 |
|
 M. Slade The International Journal of Social Psychiatry: Index Volume 42 January--December 1996 International Journal of Social Psychiatry, March 1, 1996; 42(1): 1 - 9. [PDF]
|
|
|
|
|
|
S. R. Vrana and D. Roflock The Social Context of Emotion: Effects of Ethnicity and Authority/Peer Status on the Emotional Reports of African American College Students Pers Soc Psychol Bull, March 1, 1996; 22(3): 296 - 305. [Abstract]
|
|