Table 2.

Interrater and Intrarater Reliability for the Grading Scale

TestRatings analyzedα estimateLevel of agreement
Interrater reliabilityGrader 1 (second), grader 2 (second), grader 3 (second)0.545Moderate
Intrarater reliabilityGrader 1 (first), grader 1 (second)0.979Almost perfect
Grader 2 (first), grader 2 (second)0.847Almost perfect
Grader 3 (first), grader 3 (second)0.781Substantial
TestRatings analyzedα estimateLevel of agreement
Interrater reliabilityGrader 1 (second), grader 2 (second), grader 3 (second)0.545Moderate
Intrarater reliabilityGrader 1 (first), grader 1 (second)0.979Almost perfect
Grader 2 (first), grader 2 (second)0.847Almost perfect
Grader 3 (first), grader 3 (second)0.781Substantial
Table 2.

Interrater and Intrarater Reliability for the Grading Scale

TestRatings analyzedα estimateLevel of agreement
Interrater reliabilityGrader 1 (second), grader 2 (second), grader 3 (second)0.545Moderate
Intrarater reliabilityGrader 1 (first), grader 1 (second)0.979Almost perfect
Grader 2 (first), grader 2 (second)0.847Almost perfect
Grader 3 (first), grader 3 (second)0.781Substantial
TestRatings analyzedα estimateLevel of agreement
Interrater reliabilityGrader 1 (second), grader 2 (second), grader 3 (second)0.545Moderate
Intrarater reliabilityGrader 1 (first), grader 1 (second)0.979Almost perfect
Grader 2 (first), grader 2 (second)0.847Almost perfect
Grader 3 (first), grader 3 (second)0.781Substantial
Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close