Contents
What is an inflated error rate?
The familywise error rate (FWE or FWER) is the probability of a coming to at least one false conclusion in a series of hypothesis tests . In other words, it’s the probability of making at least one Type I Error. The FWER is also called alpha inflation or cumulative Type I error.
What is inflation of type 1 error?
The inflation of Type I error rate occurs when the one attempts to test another variable that is correlated with the true version of the censored variable, while “controlling” for the censored version with ordinary regression.
Why do we fix type 1 error?
Type 1 errors can (and do) result from flawless experimentation. Understanding type 1 errors allows you to: Choose the level of risk you’re willing to accept (e.g., increase your sample size to achieve a higher level of statistical significance)
What is the chance of making a type I error?
Every time you conduct a t-test there is a chance that you will make a Type I error. This error is usually 5%. By running two t-tests on the same data you will have increased your chance of “making a mistake” to 10%. The formula for determining the new error rate for multiple t-tests is not as simple as multiplying 5% by the number of tests.
How to calculate error rate for multiple t-tests?
By running two t-tests on the same data you will have increased your chance of “making a mistake” to 10%. The formula for determining the new error rate for multiple t-tests is not as simple as multiplying 5% by the number of tests. However, if you are only making a few multiple comparisons,…
What happens when you run two t tests?
By running two t-tests on the same data you will have increased your chance of “making a mistake” to 10%. The formula for determining the new error rate for multiple t-tests is not as simple as multiplying 5% by the number of tests.
How does ANOVA control for Type I errors?
An ANOVA controls for these errors so that the Type I error remains at 5% and you can be more confident that any statistically significant result you find is not just running lots of tests. See our guide on hypothesis testing for more information on Type I errors.