Contents
When should Bonferroni correction be used?
The Bonferroni correction is appropriate when a single false positive in a set of tests would be a problem. It is mainly useful when there are a fairly small number of multiple comparisons and you’re looking for one or two that might be significant.
What tests use Bonferroni correction?
Bonferroni was used in a variety of circumstances, most commonly to correct the experiment-wise error rate when using multiple ‘t’ tests or as a post-hoc procedure to correct the family-wise error rate following analysis of variance (anova).
What is the problem with the Bonferroni correction?
Irrelevant null hypothesis The first problem is that Bonferroni adjustments are concerned with the wrong hypothesis. The study- wide error rate applies only to the hypothesis that the two groups are identical on all 20 variables (the universal null hypothesis).
Does Bonferroni assume independence?
The Bonferroni correction assumes that all of the hypothesis tests are statistically independent, however, and that is almost surely false. The multivariate approach controls for the multiple chances to find differences, and it does so without assuming independence of the DVs.
Is the Bonferroni correction really necessary?
Classicists argue that correction for multiple testing is mandatory. Epidemiologists or rationalists argue that the Bonferroni adjustment defies common sense and increases type II errors (the chance of false negatives). “No Adjustments Are Needed for Multiple Comparisons.” Epidemiology 1(1): 43-46.
How is Bonferroni calculated?
The Bonferroni correction method formula To perform the correction, simply divide the original alpha level (most like set to 0.05) by the number of tests being performed.
Does Bonferroni correction increase power?
Although sequential Bonferroni corrections do not reduce the power of the tests to the same extent, on average (33–61% per t test), the probability of making a Type II error for some of the tests (β = 1 − power, so 39–66%) remains unacceptably high. Bonferroni procedures appear to raise another set of problems.
Is Bonferroni a post hoc test?
The Bonferroni is probably the most commonly used post hoc test, because it is highly flexible, very simple to compute, and can be used with any type of statistical test (e.g., correlations)—not just post hoc tests with ANOVA.
What is one drawback of the Bonferroni correction?
In particular, Bonferroni designed an adjustment to prevent data from incorrectly appearing to be statistically significant. An important limitation of Bonferroni correction is that it may lead analysts to mix actual true results.
How do I calculate Bonferroni correction?
To perform the correction, simply divide the original alpha level (most like set to 0.05) by the number of tests being performed. The output from the equation is a Bonferroni-corrected p value which will be the new threshold that needs to be reached for a single test to be classed as significant.
What is the Bonferroni test used for?
The Bonferroni test is a statistical test used to reduce the instance of a false positive. In particular, Bonferroni designed an adjustment to prevent data from incorrectly appearing to be statistically significant.