Contents
Would we do a post hoc test for a non-significant result?
Yes dear it is possible to get insignificant result after ANOVA. Not achieving a statistically significant result does not mean you should not report group means ± standard deviation also. However, running post hoc tests is not warranted and should not be carried out (p-value is greater than 0.05).
Is it possible to get non-significant results in post hoc test when we got the significant result in ANOVA?
Surprisingly, the answer is yes. With one exception, post tests are valid even if the overall ANOVA did not find a significant difference among means. The exception is the first multiple comparison test invented, the protected Fisher Least Significant Difference (LSD) test.
What does it mean when ANOVA is not significant?
If your one-way ANOVA p-value is less than your significance level, you know that some of the group means are different, but not which pairs of groups. Confidence intervals that do not contain zero indicate a mean difference that is statistically significant.
Is it possible to get non significant results in post hoc test?
Dear Ivan, You’ve mentioned a good point, but in regression you can not control error types as far as I know. For example, If we have 12 groups to compare, we simply can control FWER using Tukey, Sidak, Bon, etc at different levels and if they came from same population, you have very low type I error.
When to use a post hoc test with Anova?
Using Post Hoc Tests with ANOVA. Post hoc tests are an integral part of ANOVA. When you use ANOVA to test the equality of at least three group means, statistically significant results indicate that not all of the group means are equal. However, ANOVA results do not identify which particular differences between pairs of means are significant.
How are post hoc tests used in statology?
Post hoc tests allow us to control the family-wise error rate while performing multiple pairwise comparisons. The tradeoff of controlling the family-wise error rate is lower statistical power. We can reduce the effects of lower statistical power by making fewer pairwise comparisons.
How does a post hoc test control the error rate?
Post hoc tests control the experiment-wise error rate by reducing the statistical power of the comparisons. Here’s how that works and what it means for your study. To obtain the family error rate you specify, post hoc procedures must lower the significance level for all individual comparisons.