Table 2.

Comparison of Overall Status Agreement Between Human Reviewers

Comparison of Paired Human Reviewers on EIM Status Determination
EIM StatusReviewer 1
Not ActiveActive
NegatedHistoricalResolvedImprovedWorsenedUncertain
 Negated166283111
 Historical851611141108
 Resolved163638312
 Improved2511941142
 Worsened2211211443
 Uncertain310102121344
Comparison of Paired Human Reviewers on EIM Status Determination
EIM StatusReviewer 1
Not ActiveActive
NegatedHistoricalResolvedImprovedWorsenedUncertain
 Negated166283111
 Historical851611141108
 Resolved163638312
 Improved2511941142
 Worsened2211211443
 Uncertain310102121344
Comparison of Human Reviewer Detection and Agreement on EIM Status
EIM TypeDetection AccuracySpecific EIM AgreementGeneral EIM Agreement
AccuracyAgreementAccuracyAgreement
Kappa (95% CI)Kappa (95% CI)
Arthritis96.6%0.800.74 (0.69-0.80)0.890.78 (0.74-0.82)
Psoriasis90.8%0.720.75 (0.66-0.85)0.810.62 (0.52-0.73)
Ocular EIM96.4%0.700.69 (0.58-0.80)0.850.71 (0.62-0.78)
Erythema nodosum87.3%0.850.79 (0.62-0.96)0.880.74 (0.57-0.91)
Pyoderma gangrenosum92.3%0.750.72 (0.53-0.91)0.890.77 (0.61-0.93)
Hidradenitis suppurativa96.4%0.630.45 (0.13-0.77)0.860.39 (0.03-0.76)
Overall94.6%0.760.74 (0.70-0.78)0.880.76 (0.73-0.79)
Comparison of Human Reviewer Detection and Agreement on EIM Status
EIM TypeDetection AccuracySpecific EIM AgreementGeneral EIM Agreement
AccuracyAgreementAccuracyAgreement
Kappa (95% CI)Kappa (95% CI)
Arthritis96.6%0.800.74 (0.69-0.80)0.890.78 (0.74-0.82)
Psoriasis90.8%0.720.75 (0.66-0.85)0.810.62 (0.52-0.73)
Ocular EIM96.4%0.700.69 (0.58-0.80)0.850.71 (0.62-0.78)
Erythema nodosum87.3%0.850.79 (0.62-0.96)0.880.74 (0.57-0.91)
Pyoderma gangrenosum92.3%0.750.72 (0.53-0.91)0.890.77 (0.61-0.93)
Hidradenitis suppurativa96.4%0.630.45 (0.13-0.77)0.860.39 (0.03-0.76)
Overall94.6%0.760.74 (0.70-0.78)0.880.76 (0.73-0.79)

Abbreviations: CI, confidence interval; EIM, extraintestinal manifestation.

Table 2.

Comparison of Overall Status Agreement Between Human Reviewers

Comparison of Paired Human Reviewers on EIM Status Determination
EIM StatusReviewer 1
Not ActiveActive
NegatedHistoricalResolvedImprovedWorsenedUncertain
 Negated166283111
 Historical851611141108
 Resolved163638312
 Improved2511941142
 Worsened2211211443
 Uncertain310102121344
Comparison of Paired Human Reviewers on EIM Status Determination
EIM StatusReviewer 1
Not ActiveActive
NegatedHistoricalResolvedImprovedWorsenedUncertain
 Negated166283111
 Historical851611141108
 Resolved163638312
 Improved2511941142
 Worsened2211211443
 Uncertain310102121344
Comparison of Human Reviewer Detection and Agreement on EIM Status
EIM TypeDetection AccuracySpecific EIM AgreementGeneral EIM Agreement
AccuracyAgreementAccuracyAgreement
Kappa (95% CI)Kappa (95% CI)
Arthritis96.6%0.800.74 (0.69-0.80)0.890.78 (0.74-0.82)
Psoriasis90.8%0.720.75 (0.66-0.85)0.810.62 (0.52-0.73)
Ocular EIM96.4%0.700.69 (0.58-0.80)0.850.71 (0.62-0.78)
Erythema nodosum87.3%0.850.79 (0.62-0.96)0.880.74 (0.57-0.91)
Pyoderma gangrenosum92.3%0.750.72 (0.53-0.91)0.890.77 (0.61-0.93)
Hidradenitis suppurativa96.4%0.630.45 (0.13-0.77)0.860.39 (0.03-0.76)
Overall94.6%0.760.74 (0.70-0.78)0.880.76 (0.73-0.79)
Comparison of Human Reviewer Detection and Agreement on EIM Status
EIM TypeDetection AccuracySpecific EIM AgreementGeneral EIM Agreement
AccuracyAgreementAccuracyAgreement
Kappa (95% CI)Kappa (95% CI)
Arthritis96.6%0.800.74 (0.69-0.80)0.890.78 (0.74-0.82)
Psoriasis90.8%0.720.75 (0.66-0.85)0.810.62 (0.52-0.73)
Ocular EIM96.4%0.700.69 (0.58-0.80)0.850.71 (0.62-0.78)
Erythema nodosum87.3%0.850.79 (0.62-0.96)0.880.74 (0.57-0.91)
Pyoderma gangrenosum92.3%0.750.72 (0.53-0.91)0.890.77 (0.61-0.93)
Hidradenitis suppurativa96.4%0.630.45 (0.13-0.77)0.860.39 (0.03-0.76)
Overall94.6%0.760.74 (0.70-0.78)0.880.76 (0.73-0.79)

Abbreviations: CI, confidence interval; EIM, extraintestinal manifestation.

Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close