Test . | Ratings analyzed . | α estimate . | Level of agreement . |
---|---|---|---|
Interrater reliability | Grader 1 (second), grader 2 (second), grader 3 (second) | 0.545 | Moderate |
Intrarater reliability | Grader 1 (first), grader 1 (second) | 0.979 | Almost perfect |
Grader 2 (first), grader 2 (second) | 0.847 | Almost perfect | |
Grader 3 (first), grader 3 (second) | 0.781 | Substantial |
Test . | Ratings analyzed . | α estimate . | Level of agreement . |
---|---|---|---|
Interrater reliability | Grader 1 (second), grader 2 (second), grader 3 (second) | 0.545 | Moderate |
Intrarater reliability | Grader 1 (first), grader 1 (second) | 0.979 | Almost perfect |
Grader 2 (first), grader 2 (second) | 0.847 | Almost perfect | |
Grader 3 (first), grader 3 (second) | 0.781 | Substantial |
Test . | Ratings analyzed . | α estimate . | Level of agreement . |
---|---|---|---|
Interrater reliability | Grader 1 (second), grader 2 (second), grader 3 (second) | 0.545 | Moderate |
Intrarater reliability | Grader 1 (first), grader 1 (second) | 0.979 | Almost perfect |
Grader 2 (first), grader 2 (second) | 0.847 | Almost perfect | |
Grader 3 (first), grader 3 (second) | 0.781 | Substantial |
Test . | Ratings analyzed . | α estimate . | Level of agreement . |
---|---|---|---|
Interrater reliability | Grader 1 (second), grader 2 (second), grader 3 (second) | 0.545 | Moderate |
Intrarater reliability | Grader 1 (first), grader 1 (second) | 0.979 | Almost perfect |
Grader 2 (first), grader 2 (second) | 0.847 | Almost perfect | |
Grader 3 (first), grader 3 (second) | 0.781 | Substantial |
This PDF is available to Subscribers Only
View Article Abstract & Purchase OptionsFor full access to this pdf, sign in to an existing account, or purchase an annual subscription.