Is intraclass correlation coefficient a measure of reliability?
Intraclass correlation coefficient (ICC) is a widely used reliability index in test-retest, intrarater, and interrater reliability analyses.
What does intraclass correlation tell you?
Intraclass correlation measures the reliability of ratings or measurements for clusters — data that has been collected as groups or sorted into groups. A high Intraclass Correlation Coefficient (ICC) close to 1 indicates high similarity between values from the same group.
What is an acceptable level of interrater reliability?
Table 3.
| Value of Kappa | Level of Agreement | % of Data that are Reliable |
|---|---|---|
| .40–.59 | Weak | 15–35% |
| .60–.79 | Moderate | 35–63% |
| .80–.90 | Strong | 64–81% |
| Above.90 | Almost Perfect | 82–100% |
Are there different forms of the intraclass correlation coefficient?
Ebel, 1951 ; Haggard, 1958). There are numerous versions of the intraclass correlation coefficient (ICC) that can give quite different results when applied to the same data. Unfortunately, many researchers are not aware of the differences between the forms, and those who are often fail to report which form they used.
How is interrater reliability used in continuous data?
For continuous data, ICC often used to assess interraterreliability ICC is the correlation between two measurements made on same subject = Corr(,)
Which is the appropriate form of the ICC?
The guidelines for choosing the appropriate form of the ICC call for three decisions: (a) Is a one-way or two-way analysis of variance (ANOVA) appropriate for the analysis of the reliability study? (b) Are differences between the judges’ mean ratings relevant to the reliability of interest?
When was intraclass correlations first published in Psychological Bulletin?
Copyright 1979 by the American Psychological Association, Inc. 0033-2909/79/8602-0420$00.75 INTRACLASS CORRELATIONS 42 1 Table 1 Analysis of Variance and Mean Square Expectations for One- and Two- Way Random EJects and Two- Way Mixed Model Designs