Contents
What is the proper way to apply multiple comparison test?
The classic approach for solving a multiple comparison problem involves controlling FWER. A threshold value of α less than 0.05, which is conventionally used, can be set. If the H0 is true for all tests, the probability of obtaining a significant result from this new, lower critical value is 0.05.
Can you do multiple t tests instead of ANOVA?
Even when more than two groups are compared, some researchers erroneously apply the t test by implementing multiple t tests on multiple pairs of means. For a comparison of more than two group means the one-way analysis of variance (ANOVA) is the appropriate method instead of the t test.
Which is the best procedure for multiple comparisons?
Virtually all the multiple comparison procedures can be computed using the lowly ttest; either a ttest for independent means, or a ttest for related means, whichever is appropriate. Certainly textbooks give different procedures for different tests, but the basic underlying structure is the ttest.
Why do we ( usually ) not have to worry about multiple comparisons?
Why We (Usually) Don’t Have to Worry About Multiple Comparisons Journal of Research on Educational Effectiveness,5:189–211,2012 Copyright © Taylor & Francis Group, LLC ISSN: 1934-5747 print / 1934-5739 online DOI: 10.1080/19345747
Why are multiple comparisons not allowed in Excel?
The problem is that a correction factor computed on the full set of data does not apply well to tests based on only part of the data, so although the overall analysis might be protected, the multiple comparisons are not. A Comment on Multiple Comparison Procedures
How are multiple comparisons with repeated measures different?
However, the arithmetic is no different is we compare (Mean1 + Mean2 + Mean3)/3 with (Mean4 + Mean5)/2. In other words, we can compare means of means. If you had two control groups and three treatment groups, that particular contrast might make a lot of sense.