Table 2

Artificial intelligence electrocardiogram model performance metrics by site

SiteAUCOptimal probability thresholdAccuracySensitivitySpecificity
Overall0.922 (0.910, 0.934)0.11a86.9% (85.8%, 87.8%) 4030/464082.8% (79.9%, 85.4%) 640/77387.7% (86.6%, 88.7%) 3390/3867
0.18b89.2% (88.3%, 90.1%) 4139/464080.6% (77.6%, 83.3%) 623/77390.9% (90.0%, 91.8%) 3516/3867
Bern0.835 (0.782, 0.887)0.11a87.2% (86.0%, 88.3%) 2978/341662.1% (49.3%, 73.8%) 41/6687.7% (86.5%, 88.8%) 2937/3350
0.07b83.3% (82.0%, 84.5%)
2844/3416
68.2% (55.6%, 79.1%)
45/66
83.6% (82.3%, 84.8%)
2799/3350
Oxford0.900 (0.869, 0.931)0.11a78.4% (74.1%, 82.2%) 330/42173.7% (68.4%, 78.5%) 224/30490.6% (83.8%, 95.2%) 106/117
0.04b84.6% (80.7%, 87.9%) 356/42183.9% (79.3%, 87.8%) 255/30486.3% (78.7%, 92.0%) 101/117
Seoul0.948 (0.933, 0.964)0.11a89.9% (87.6%, 91.9%) 722/80393.1% (90.1%, 95.3%) 375/40386.8% (83.0%, 89.9%) 347/400
0.18b90.4% (88.2%, 92.4%)
726/803
91.6% (88.4%, 94.1%)
369/403
89.2% (85.8%, 92.1%)
357/400
SiteAUCOptimal probability thresholdAccuracySensitivitySpecificity
Overall0.922 (0.910, 0.934)0.11a86.9% (85.8%, 87.8%) 4030/464082.8% (79.9%, 85.4%) 640/77387.7% (86.6%, 88.7%) 3390/3867
0.18b89.2% (88.3%, 90.1%) 4139/464080.6% (77.6%, 83.3%) 623/77390.9% (90.0%, 91.8%) 3516/3867
Bern0.835 (0.782, 0.887)0.11a87.2% (86.0%, 88.3%) 2978/341662.1% (49.3%, 73.8%) 41/6687.7% (86.5%, 88.8%) 2937/3350
0.07b83.3% (82.0%, 84.5%)
2844/3416
68.2% (55.6%, 79.1%)
45/66
83.6% (82.3%, 84.8%)
2799/3350
Oxford0.900 (0.869, 0.931)0.11a78.4% (74.1%, 82.2%) 330/42173.7% (68.4%, 78.5%) 224/30490.6% (83.8%, 95.2%) 106/117
0.04b84.6% (80.7%, 87.9%) 356/42183.9% (79.3%, 87.8%) 255/30486.3% (78.7%, 92.0%) 101/117
Seoul0.948 (0.933, 0.964)0.11a89.9% (87.6%, 91.9%) 722/80393.1% (90.1%, 95.3%) 375/40386.8% (83.0%, 89.9%) 347/400
0.18b90.4% (88.2%, 92.4%)
726/803
91.6% (88.4%, 94.1%)
369/403
89.2% (85.8%, 92.1%)
357/400

95% confidence intervals are shown in parentheses.

aOptimal AI-ECG probability threshold as defined in the algorithm derivation cohort.

bArtificial intelligence electrocardiogram probability threshold as optimized for each cohort using the Youden index method.

Table 2

Artificial intelligence electrocardiogram model performance metrics by site

SiteAUCOptimal probability thresholdAccuracySensitivitySpecificity
Overall0.922 (0.910, 0.934)0.11a86.9% (85.8%, 87.8%) 4030/464082.8% (79.9%, 85.4%) 640/77387.7% (86.6%, 88.7%) 3390/3867
0.18b89.2% (88.3%, 90.1%) 4139/464080.6% (77.6%, 83.3%) 623/77390.9% (90.0%, 91.8%) 3516/3867
Bern0.835 (0.782, 0.887)0.11a87.2% (86.0%, 88.3%) 2978/341662.1% (49.3%, 73.8%) 41/6687.7% (86.5%, 88.8%) 2937/3350
0.07b83.3% (82.0%, 84.5%)
2844/3416
68.2% (55.6%, 79.1%)
45/66
83.6% (82.3%, 84.8%)
2799/3350
Oxford0.900 (0.869, 0.931)0.11a78.4% (74.1%, 82.2%) 330/42173.7% (68.4%, 78.5%) 224/30490.6% (83.8%, 95.2%) 106/117
0.04b84.6% (80.7%, 87.9%) 356/42183.9% (79.3%, 87.8%) 255/30486.3% (78.7%, 92.0%) 101/117
Seoul0.948 (0.933, 0.964)0.11a89.9% (87.6%, 91.9%) 722/80393.1% (90.1%, 95.3%) 375/40386.8% (83.0%, 89.9%) 347/400
0.18b90.4% (88.2%, 92.4%)
726/803
91.6% (88.4%, 94.1%)
369/403
89.2% (85.8%, 92.1%)
357/400
SiteAUCOptimal probability thresholdAccuracySensitivitySpecificity
Overall0.922 (0.910, 0.934)0.11a86.9% (85.8%, 87.8%) 4030/464082.8% (79.9%, 85.4%) 640/77387.7% (86.6%, 88.7%) 3390/3867
0.18b89.2% (88.3%, 90.1%) 4139/464080.6% (77.6%, 83.3%) 623/77390.9% (90.0%, 91.8%) 3516/3867
Bern0.835 (0.782, 0.887)0.11a87.2% (86.0%, 88.3%) 2978/341662.1% (49.3%, 73.8%) 41/6687.7% (86.5%, 88.8%) 2937/3350
0.07b83.3% (82.0%, 84.5%)
2844/3416
68.2% (55.6%, 79.1%)
45/66
83.6% (82.3%, 84.8%)
2799/3350
Oxford0.900 (0.869, 0.931)0.11a78.4% (74.1%, 82.2%) 330/42173.7% (68.4%, 78.5%) 224/30490.6% (83.8%, 95.2%) 106/117
0.04b84.6% (80.7%, 87.9%) 356/42183.9% (79.3%, 87.8%) 255/30486.3% (78.7%, 92.0%) 101/117
Seoul0.948 (0.933, 0.964)0.11a89.9% (87.6%, 91.9%) 722/80393.1% (90.1%, 95.3%) 375/40386.8% (83.0%, 89.9%) 347/400
0.18b90.4% (88.2%, 92.4%)
726/803
91.6% (88.4%, 94.1%)
369/403
89.2% (85.8%, 92.1%)
357/400

95% confidence intervals are shown in parentheses.

aOptimal AI-ECG probability threshold as defined in the algorithm derivation cohort.

bArtificial intelligence electrocardiogram probability threshold as optimized for each cohort using the Youden index method.

Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close