Can you have a large effect size without statistical significance?
In fact, it is also possible (perhaps rarer) to see a large estimated effect size without there being statistically significant evidence it isn’t zero. The issue is that your effect size is just a point estimate and hence is a random variable that depends on the particular sample you have available for analysis.
Do you measure effect size for non significant results?
A statistical result being not significant is not a guaranty the effect your looking for does not exist, just that your not 95% sure it does. There can be two reasons for this. 1. The effect really does not exist.
Why is the effect size of a covariate important?
Covariates may be of such substantive importance that they have to be there. The effect size of a covariate may be high, even if it is not significant. The covariate may affect other aspects of the model. The covariate may be a part of how your hypothesis was worded.
Are there reasons to keep or drop covariates?
There are reasons to keep covariates and reasons to drop covariates. Statistical significance should not be a key factor, in the vast majority of cases. Covariates may be of such substantive importance that they have to be there. The effect size of a covariate may be high, even if it is not significant.
When is a correlation coefficient too small to be statistically significant?
For example, a sample Pearson correlation coefficient of 0.01 is statistically significant if the sample size is 1000. Reporting only the significant p -value from this analysis could be misleading if a correlation of 0.01 is too small to be of interest in a particular application.
What does the term effect size mean in statistics?
Population and sample effect sizes. The term effect size can refer to the value of a statistic calculated from a sample of data, the value of a parameter of a hypothetical statistical population, or to the equation that operationalizes how statistics or parameters lead to the effect size value.