Table 3.

Effect of averaging score from many models rather than using just one model

StageAverage Individual ROC AUCROC AUC using average confidence score
PN0.591 ± 0.01150.603
2-cell0.555 ± 0.007790.575
4-cell0.567 ± 0.01140.581
8- to 16-cell0.585 ± 0.007790.585
Blastocyst0.686 ± 0.009370.680
StageAverage Individual ROC AUCROC AUC using average confidence score
PN0.591 ± 0.01150.603
2-cell0.555 ± 0.007790.575
4-cell0.567 ± 0.01140.581
8- to 16-cell0.585 ± 0.007790.585
Blastocyst0.686 ± 0.009370.680

The average individual ROC AUC scores are the average scores on the test set after 50 training iterations each with a different randomly allocated train/validation/test split with 25 embryos in the successful class and 48 embryos in the unsuccessful class for both the test and validation set. The accompanying errors are the standard error across these 50 training attempts. For the ROC AUC using average confidence score, the average confidence score was first calculated from 50 models (using 5-fold cross-validation and 50 training attempts) and these average confidence scores were then used to calculate the ROC AUC.

Table 3.

Effect of averaging score from many models rather than using just one model

StageAverage Individual ROC AUCROC AUC using average confidence score
PN0.591 ± 0.01150.603
2-cell0.555 ± 0.007790.575
4-cell0.567 ± 0.01140.581
8- to 16-cell0.585 ± 0.007790.585
Blastocyst0.686 ± 0.009370.680
StageAverage Individual ROC AUCROC AUC using average confidence score
PN0.591 ± 0.01150.603
2-cell0.555 ± 0.007790.575
4-cell0.567 ± 0.01140.581
8- to 16-cell0.585 ± 0.007790.585
Blastocyst0.686 ± 0.009370.680

The average individual ROC AUC scores are the average scores on the test set after 50 training iterations each with a different randomly allocated train/validation/test split with 25 embryos in the successful class and 48 embryos in the unsuccessful class for both the test and validation set. The accompanying errors are the standard error across these 50 training attempts. For the ROC AUC using average confidence score, the average confidence score was first calculated from 50 models (using 5-fold cross-validation and 50 training attempts) and these average confidence scores were then used to calculate the ROC AUC.

Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close