When do you not correct for multiple comparisons?
Corrections for multiple comparisons may not be needed if you make only a few planned comparisons. The term planned comparison is used when: You focus in on a few scientifically sensible comparisons rather than every possible comparison. The choice of which comparisons to make was part of the experimental design.
What is a significant p adjusted value?
The adjusted P value is the smallest familywise significance level at which a particular comparison will be declared statistically significant as part of the multiple comparison testing.
What is the p value of a post hoc test?
To follow along with this example, download the CSV dataset: PostHocTests. The p-value of 0.004 indicates that we can reject the null hypothesis and conclude that the four means are not all equal. The Means table at the bottom displays the group means.
What’s the difference between Holm and Tukey’s post hoc tests?
If you compare the p-values of this test with the p-values from Tukey’s Test, you’ll notice that each of the pairwise comparisons lead to the same conclusion, except for the difference between group C and D. The p-value for this difference was .0505 in Tukey’s Test compared to .02108 in Holm’s Method.
Which is the most conservative post hoc test?
Another post hoc test we can perform is holm’s method. This is generally viewed as a more conservative test compared to Tukey’s Test. This test provides a grid of p-values for each pairwise comparison. For example, the p-value for the difference between the group A and group B mean is 0
When to use post hoc test with Anova statology?
For example, suppose we have four groups: A, B, C, and D. This means there are a total of six pairwise comparisons we want to look at with a post hoc test: If we have more than four groups, the number of pairwise comparisons we will want to look at will only increase even more.