When to use the Bonferroni correction

Richard A Armstrong

Research output: Contribution to journalReview article

Abstract

PURPOSE: The Bonferroni correction adjusts probability (p) values because of the increased risk of a type I error when making multiple statistical tests. The routine use of this test has been criticised as deleterious to sound statistical judgment, testing the wrong hypothesis, and reducing the chance of a type I error but at the expense of a type II error; yet it remains popular in ophthalmic research. The purpose of this article was to survey the use of the Bonferroni correction in research articles published in three optometric journals, viz. Ophthalmic & Physiological Optics, Optometry & Vision Science, and Clinical & Experimental Optometry, and to provide advice to authors contemplating multiple testing.

RECENT FINDINGS: Some authors ignored the problem of multiple testing while others used the method uncritically with no rationale or discussion. A variety of methods of correcting p values were employed, the Bonferroni method being the single most popular. Bonferroni was used in a variety of circumstances, most commonly to correct the experiment-wise error rate when using multiple 't' tests or as a post-hoc procedure to correct the family-wise error rate following analysis of variance (anova). Some studies quoted adjusted p values incorrectly or gave an erroneous rationale.

SUMMARY: Whether or not to use the Bonferroni correction depends on the circumstances of the study. It should not be used routinely and should be considered if: (1) a single test of the 'universal null hypothesis' (Ho ) that all tests are not significant is required, (2) it is imperative to avoid a type I error, and (3) a large number of tests are carried out without preplanned hypotheses.

Original languageEnglish
Pages (from-to)502-508
Number of pages7
JournalOphthalmic and Physiological Optics
Volume34
Issue number5
Early online date2 Apr 2014
DOIs
Publication statusPublished - 30 Sep 2014

Fingerprint

Optometry
Research
Analysis of Variance
Surveys and Questionnaires

Bibliographical note

© 2014 The Authors Ophthalmic & Physiological Optics © 2014 The College of Optometrists.

Keywords

  • Bonferroni correction
  • clinical &experimental optometry
  • ophthalmic & physiological optics
  • optometry & vision science
  • statistical guidelines

Cite this

Armstrong, Richard A. / When to use the Bonferroni correction. In: Ophthalmic and Physiological Optics. 2014 ; Vol. 34, No. 5. pp. 502-508.
@article{0ae3795126c249789442b20db2aaf37c,
title = "When to use the Bonferroni correction",
abstract = "PURPOSE: The Bonferroni correction adjusts probability (p) values because of the increased risk of a type I error when making multiple statistical tests. The routine use of this test has been criticised as deleterious to sound statistical judgment, testing the wrong hypothesis, and reducing the chance of a type I error but at the expense of a type II error; yet it remains popular in ophthalmic research. The purpose of this article was to survey the use of the Bonferroni correction in research articles published in three optometric journals, viz. Ophthalmic & Physiological Optics, Optometry & Vision Science, and Clinical & Experimental Optometry, and to provide advice to authors contemplating multiple testing.RECENT FINDINGS: Some authors ignored the problem of multiple testing while others used the method uncritically with no rationale or discussion. A variety of methods of correcting p values were employed, the Bonferroni method being the single most popular. Bonferroni was used in a variety of circumstances, most commonly to correct the experiment-wise error rate when using multiple 't' tests or as a post-hoc procedure to correct the family-wise error rate following analysis of variance (anova). Some studies quoted adjusted p values incorrectly or gave an erroneous rationale.SUMMARY: Whether or not to use the Bonferroni correction depends on the circumstances of the study. It should not be used routinely and should be considered if: (1) a single test of the 'universal null hypothesis' (Ho ) that all tests are not significant is required, (2) it is imperative to avoid a type I error, and (3) a large number of tests are carried out without preplanned hypotheses.",
keywords = "Bonferroni correction, clinical &experimental optometry, ophthalmic & physiological optics, optometry & vision science, statistical guidelines",
author = "Armstrong, {Richard A}",
note = "{\circledC} 2014 The Authors Ophthalmic & Physiological Optics {\circledC} 2014 The College of Optometrists.",
year = "2014",
month = "9",
day = "30",
doi = "10.1111/opo.12131",
language = "English",
volume = "34",
pages = "502--508",
journal = "Ophthalmic and Physiological Optics",
issn = "0275-5408",
publisher = "Wiley-Blackwell",
number = "5",

}

When to use the Bonferroni correction. / Armstrong, Richard A.

In: Ophthalmic and Physiological Optics, Vol. 34, No. 5, 30.09.2014, p. 502-508.

Research output: Contribution to journalReview article

TY - JOUR

T1 - When to use the Bonferroni correction

AU - Armstrong, Richard A

N1 - © 2014 The Authors Ophthalmic & Physiological Optics © 2014 The College of Optometrists.

PY - 2014/9/30

Y1 - 2014/9/30

N2 - PURPOSE: The Bonferroni correction adjusts probability (p) values because of the increased risk of a type I error when making multiple statistical tests. The routine use of this test has been criticised as deleterious to sound statistical judgment, testing the wrong hypothesis, and reducing the chance of a type I error but at the expense of a type II error; yet it remains popular in ophthalmic research. The purpose of this article was to survey the use of the Bonferroni correction in research articles published in three optometric journals, viz. Ophthalmic & Physiological Optics, Optometry & Vision Science, and Clinical & Experimental Optometry, and to provide advice to authors contemplating multiple testing.RECENT FINDINGS: Some authors ignored the problem of multiple testing while others used the method uncritically with no rationale or discussion. A variety of methods of correcting p values were employed, the Bonferroni method being the single most popular. Bonferroni was used in a variety of circumstances, most commonly to correct the experiment-wise error rate when using multiple 't' tests or as a post-hoc procedure to correct the family-wise error rate following analysis of variance (anova). Some studies quoted adjusted p values incorrectly or gave an erroneous rationale.SUMMARY: Whether or not to use the Bonferroni correction depends on the circumstances of the study. It should not be used routinely and should be considered if: (1) a single test of the 'universal null hypothesis' (Ho ) that all tests are not significant is required, (2) it is imperative to avoid a type I error, and (3) a large number of tests are carried out without preplanned hypotheses.

AB - PURPOSE: The Bonferroni correction adjusts probability (p) values because of the increased risk of a type I error when making multiple statistical tests. The routine use of this test has been criticised as deleterious to sound statistical judgment, testing the wrong hypothesis, and reducing the chance of a type I error but at the expense of a type II error; yet it remains popular in ophthalmic research. The purpose of this article was to survey the use of the Bonferroni correction in research articles published in three optometric journals, viz. Ophthalmic & Physiological Optics, Optometry & Vision Science, and Clinical & Experimental Optometry, and to provide advice to authors contemplating multiple testing.RECENT FINDINGS: Some authors ignored the problem of multiple testing while others used the method uncritically with no rationale or discussion. A variety of methods of correcting p values were employed, the Bonferroni method being the single most popular. Bonferroni was used in a variety of circumstances, most commonly to correct the experiment-wise error rate when using multiple 't' tests or as a post-hoc procedure to correct the family-wise error rate following analysis of variance (anova). Some studies quoted adjusted p values incorrectly or gave an erroneous rationale.SUMMARY: Whether or not to use the Bonferroni correction depends on the circumstances of the study. It should not be used routinely and should be considered if: (1) a single test of the 'universal null hypothesis' (Ho ) that all tests are not significant is required, (2) it is imperative to avoid a type I error, and (3) a large number of tests are carried out without preplanned hypotheses.

KW - Bonferroni correction

KW - clinical &experimental optometry

KW - ophthalmic & physiological optics

KW - optometry & vision science

KW - statistical guidelines

UR - http://www.scopus.com/inward/record.url?scp=84925884578&partnerID=8YFLogxK

U2 - 10.1111/opo.12131

DO - 10.1111/opo.12131

M3 - Review article

VL - 34

SP - 502

EP - 508

JO - Ophthalmic and Physiological Optics

JF - Ophthalmic and Physiological Optics

SN - 0275-5408

IS - 5

ER -