What does the post hoc analysis inform?
In a scientific study, post hoc analysis (from Latin post hoc, “after this”) consists of statistical analyses that were specified after the data were seen. This typically creates a multiple testing problem because each potential analysis is effectively a statistical test.
Why is post-hoc analysis bad?
Post hoc power analysis identifies population-level parameters with sample-specific statistics and makes no conceptual sense. Analytically, such analysis can yield quite different power estimates that are difficult and can be misleading.
What level of evidence is a post-hoc analysis?
In my opinión you can consider a post-hoc analysis as high evidence when you have observed a completely unexpected result of the intervention (i.e. a benefit on an outcome that you were not expecting) and therefore was not hypothesized when you designed the study.
How to do post hoc test in linear mixed models?
Post hoc test in linear mixed models: how to do? I’m now working with a mixed model (lme) in R software. The model has two factors (random and fixed); fixed factor (4 levels) have a p <.05. Now I want to do a multiple comparison but I don’t know how to do with it R or another statistical software. Can anyone help me?
When to use Multicomp in linear mixed models?
Carole, if you have such interaction (factor vs. continuous variable), it does not make sense to do a multicomp as, what you have, is actually n equations (one for each level of the factor) and the significance of the interaction does already tell you whether the slope is significantly influenced by your factor or not.
How are post hoc tests used to adjust p-value?
Post Hoc tests are just different ways to adjust p-value regarding the number of comparisons performed. So, if you have two factors and only one is significant (I assume that there is no significant interaction either), you actually have four groups, one to each level of your significant factor.
Do you do post hoc test with LM or lmer?
PLus, if I may say, that’s the nature of your sampling design (or your data) that drives the fact that you’ll do lm or lmer (eg if your sampling desing is nested) not the possibility to do post-hoc test or not.