Why confidence intervals are important when providing context for reported data and what should be included when reporting them?
The important distinction is that the CI provides more context than a p-value because it includes the direction of the effect (e.g. whether a treatment increases or decreases risk of death) and is reported in the same units as the point estimate, while also indicating the uncertainty in our estimation [4].
How is confidence interval reported?
“ When reporting confidence intervals, use the format 95% CI [LL, UL] where LL is the lower limit of the confidence interval and UL is the upper limit. ” For example, one might report: 95% CI [5.62, 8.31].
When to use p-values and confidence intervals?
In summary, p-values can be very misleading, especially when they are presented in the context of statistical hypothesis testing without corresponding point estimates and confidence intervals. Their use detracts from potentially interesting results that do not meet the significance threshold due to factors such as few outcome events.
Is the 95% confidence interval true or false?
The null hypothesis is rejected in favour of the alternative, with the conclusion that there is a significant difference between treatment groups. Therefore, similar to the P value, the 95% confidence interval can be used to perform a dichotomous test of statistical hypothesis testing ( d is true).
What’s the difference between significance and confidence intervals?
The difference between the perspective provided by the confidence interval and significance testing is particularly clear when considering non-significant results. The image below shows two confidence intervals; neither of them is “statistically significant” using the criterion of P < 0.05, because both of them embrace the null (risk ratio = 1.0).
What is the p value for rejecting the null hypothesis?
If the null value is “embraced”, then it is certainly not rejected, i.e. the p-value must be greater than 0.05 (not statistically significant) if the null value is within the interval. However, if the 95% CI excludes the null value, then the null hypothesis has been rejected, and the p-value must be < 0.05.