Comparison of Paired Human Reviewers on EIM Status Determination . | ||||||
---|---|---|---|---|---|---|
EIM Status . | Reviewer 1 . | |||||
Not Active . | Active . | |||||
Negated . | Historical . | Resolved . | Improved . | Worsened . | Uncertain . | |
Negated | 166 | 2 | 8 | 3 | 1 | 11 |
Historical | 8 | 516 | 11 | 14 | 1 | 108 |
Resolved | 16 | 3 | 63 | 8 | 3 | 12 |
Improved | 2 | 5 | 11 | 94 | 11 | 42 |
Worsened | 2 | 2 | 1 | 12 | 114 | 43 |
Uncertain | 3 | 10 | 10 | 21 | 21 | 344 |
Comparison of Paired Human Reviewers on EIM Status Determination . | ||||||
---|---|---|---|---|---|---|
EIM Status . | Reviewer 1 . | |||||
Not Active . | Active . | |||||
Negated . | Historical . | Resolved . | Improved . | Worsened . | Uncertain . | |
Negated | 166 | 2 | 8 | 3 | 1 | 11 |
Historical | 8 | 516 | 11 | 14 | 1 | 108 |
Resolved | 16 | 3 | 63 | 8 | 3 | 12 |
Improved | 2 | 5 | 11 | 94 | 11 | 42 |
Worsened | 2 | 2 | 1 | 12 | 114 | 43 |
Uncertain | 3 | 10 | 10 | 21 | 21 | 344 |
Comparison of Human Reviewer Detection and Agreement on EIM Status . | ||||||
---|---|---|---|---|---|---|
EIM Type . | Detection Accuracy . | Specific EIM Agreement . | General EIM Agreement . | |||
Accuracy . | Agreement . | Accuracy . | Agreement . | |||
Kappa (95% CI) . | Kappa (95% CI) . | |||||
Arthritis | 96.6% | 0.80 | 0.74 (0.69-0.80) | 0.89 | 0.78 (0.74-0.82) | |
Psoriasis | 90.8% | 0.72 | 0.75 (0.66-0.85) | 0.81 | 0.62 (0.52-0.73) | |
Ocular EIM | 96.4% | 0.70 | 0.69 (0.58-0.80) | 0.85 | 0.71 (0.62-0.78) | |
Erythema nodosum | 87.3% | 0.85 | 0.79 (0.62-0.96) | 0.88 | 0.74 (0.57-0.91) | |
Pyoderma gangrenosum | 92.3% | 0.75 | 0.72 (0.53-0.91) | 0.89 | 0.77 (0.61-0.93) | |
Hidradenitis suppurativa | 96.4% | 0.63 | 0.45 (0.13-0.77) | 0.86 | 0.39 (0.03-0.76) | |
Overall | 94.6% | 0.76 | 0.74 (0.70-0.78) | 0.88 | 0.76 (0.73-0.79) |
Comparison of Human Reviewer Detection and Agreement on EIM Status . | ||||||
---|---|---|---|---|---|---|
EIM Type . | Detection Accuracy . | Specific EIM Agreement . | General EIM Agreement . | |||
Accuracy . | Agreement . | Accuracy . | Agreement . | |||
Kappa (95% CI) . | Kappa (95% CI) . | |||||
Arthritis | 96.6% | 0.80 | 0.74 (0.69-0.80) | 0.89 | 0.78 (0.74-0.82) | |
Psoriasis | 90.8% | 0.72 | 0.75 (0.66-0.85) | 0.81 | 0.62 (0.52-0.73) | |
Ocular EIM | 96.4% | 0.70 | 0.69 (0.58-0.80) | 0.85 | 0.71 (0.62-0.78) | |
Erythema nodosum | 87.3% | 0.85 | 0.79 (0.62-0.96) | 0.88 | 0.74 (0.57-0.91) | |
Pyoderma gangrenosum | 92.3% | 0.75 | 0.72 (0.53-0.91) | 0.89 | 0.77 (0.61-0.93) | |
Hidradenitis suppurativa | 96.4% | 0.63 | 0.45 (0.13-0.77) | 0.86 | 0.39 (0.03-0.76) | |
Overall | 94.6% | 0.76 | 0.74 (0.70-0.78) | 0.88 | 0.76 (0.73-0.79) |
Abbreviations: CI, confidence interval; EIM, extraintestinal manifestation.
Comparison of Paired Human Reviewers on EIM Status Determination . | ||||||
---|---|---|---|---|---|---|
EIM Status . | Reviewer 1 . | |||||
Not Active . | Active . | |||||
Negated . | Historical . | Resolved . | Improved . | Worsened . | Uncertain . | |
Negated | 166 | 2 | 8 | 3 | 1 | 11 |
Historical | 8 | 516 | 11 | 14 | 1 | 108 |
Resolved | 16 | 3 | 63 | 8 | 3 | 12 |
Improved | 2 | 5 | 11 | 94 | 11 | 42 |
Worsened | 2 | 2 | 1 | 12 | 114 | 43 |
Uncertain | 3 | 10 | 10 | 21 | 21 | 344 |
Comparison of Paired Human Reviewers on EIM Status Determination . | ||||||
---|---|---|---|---|---|---|
EIM Status . | Reviewer 1 . | |||||
Not Active . | Active . | |||||
Negated . | Historical . | Resolved . | Improved . | Worsened . | Uncertain . | |
Negated | 166 | 2 | 8 | 3 | 1 | 11 |
Historical | 8 | 516 | 11 | 14 | 1 | 108 |
Resolved | 16 | 3 | 63 | 8 | 3 | 12 |
Improved | 2 | 5 | 11 | 94 | 11 | 42 |
Worsened | 2 | 2 | 1 | 12 | 114 | 43 |
Uncertain | 3 | 10 | 10 | 21 | 21 | 344 |
Comparison of Human Reviewer Detection and Agreement on EIM Status . | ||||||
---|---|---|---|---|---|---|
EIM Type . | Detection Accuracy . | Specific EIM Agreement . | General EIM Agreement . | |||
Accuracy . | Agreement . | Accuracy . | Agreement . | |||
Kappa (95% CI) . | Kappa (95% CI) . | |||||
Arthritis | 96.6% | 0.80 | 0.74 (0.69-0.80) | 0.89 | 0.78 (0.74-0.82) | |
Psoriasis | 90.8% | 0.72 | 0.75 (0.66-0.85) | 0.81 | 0.62 (0.52-0.73) | |
Ocular EIM | 96.4% | 0.70 | 0.69 (0.58-0.80) | 0.85 | 0.71 (0.62-0.78) | |
Erythema nodosum | 87.3% | 0.85 | 0.79 (0.62-0.96) | 0.88 | 0.74 (0.57-0.91) | |
Pyoderma gangrenosum | 92.3% | 0.75 | 0.72 (0.53-0.91) | 0.89 | 0.77 (0.61-0.93) | |
Hidradenitis suppurativa | 96.4% | 0.63 | 0.45 (0.13-0.77) | 0.86 | 0.39 (0.03-0.76) | |
Overall | 94.6% | 0.76 | 0.74 (0.70-0.78) | 0.88 | 0.76 (0.73-0.79) |
Comparison of Human Reviewer Detection and Agreement on EIM Status . | ||||||
---|---|---|---|---|---|---|
EIM Type . | Detection Accuracy . | Specific EIM Agreement . | General EIM Agreement . | |||
Accuracy . | Agreement . | Accuracy . | Agreement . | |||
Kappa (95% CI) . | Kappa (95% CI) . | |||||
Arthritis | 96.6% | 0.80 | 0.74 (0.69-0.80) | 0.89 | 0.78 (0.74-0.82) | |
Psoriasis | 90.8% | 0.72 | 0.75 (0.66-0.85) | 0.81 | 0.62 (0.52-0.73) | |
Ocular EIM | 96.4% | 0.70 | 0.69 (0.58-0.80) | 0.85 | 0.71 (0.62-0.78) | |
Erythema nodosum | 87.3% | 0.85 | 0.79 (0.62-0.96) | 0.88 | 0.74 (0.57-0.91) | |
Pyoderma gangrenosum | 92.3% | 0.75 | 0.72 (0.53-0.91) | 0.89 | 0.77 (0.61-0.93) | |
Hidradenitis suppurativa | 96.4% | 0.63 | 0.45 (0.13-0.77) | 0.86 | 0.39 (0.03-0.76) | |
Overall | 94.6% | 0.76 | 0.74 (0.70-0.78) | 0.88 | 0.76 (0.73-0.79) |
Abbreviations: CI, confidence interval; EIM, extraintestinal manifestation.
This PDF is available to Subscribers Only
View Article Abstract & Purchase OptionsFor full access to this pdf, sign in to an existing account, or purchase an annual subscription.