Contents
What does a paired t test compare?
The Paired Samples t Test compares the means of two measurements taken from the same individual, object, or related units. These “paired” measurements can represent things like: A measurement taken at two different times (e.g., pre-test and post-test score with an intervention administered between the two time points)
Why would you use ANOVA instead of at test?
Why not compare groups with multiple t-tests? Every time you conduct a t-test there is a chance that you will make a Type I error. An ANOVA controls for these errors so that the Type I error remains at 5% and you can be more confident that any statistically significant result you find is not just running lots of tests.
What does a paired sample t test tell us?
One continuous, dependent variable (e.g. Fear of Statistics Test scores) measured on two different occasions or under different conditions. A paired-samples t-test will tell us whether there is a statistically significant difference in the mean scores for Time 1 and Time 2. Assumptions: The basic assumptions for t-tests should be checked.
How are the results of a paired test obtained?
Subjects are independent. Each student does their own work on the two exams. Each of the paired measurements are obtained from the same subject. Each student takes both tests. The distribution of differences is normally distributed. For now, we will assume this is true.
What should the proc ttest p-value be?
Since the Shapiro-Wilk Test p-values are > 0.05 for each group, we conclude the data is normally distributed. PROC TTEST provides a QQ Plot of the differences between days. The vast majority of points should follow the theoretical normal line.
How is the t statistic used in machine learning?
The t statistic computed above is used with the Student-t distribution with n-1 degrees of freedom to quantify the level of confidence or significance in the difference between the performance of models. This allows stronger and more reliable claims to be made as part of model selection than using the original paired Student’s t-test.