Introduction and Aims: A risk stratification model that accurately identifies high-risk patients could help in clinical decision making, informing patients on their prognosis and risk stratification in research context. Various models to predict mortality in dialysis patients have been published. However these have rarely been validated and none are used in clinical practice. A direct comparison of the predictive performance of existing models could help bridge the gap between the development of risk prediction models and their clinical application. The aim of the current study was to identify existing models for predicting the risk of death in dialysis patients through a systematic review, in order to subsequently validate these models externally in the same large independent cohort.

Methods: A systematic review was performed following the PRISMA guidelines. Titles, abstracts and articles were screened by two independent researchers following pre-defined inclusion criteria. The original prediction models with the regression coefficients per predictor and intercept or baseline hazard were extracted from the selected studies and used to evaluate the predictive performance within NECOSAD, a prospective cohort of incident dialysis patients. To account for missing data on predictors, multiple imputation was performed using the fully conditional specification. The probability of death was calculated for each individual and the predictive performance of the models was assessed based on their discrimination and calibration.

Results: In total 15 articles were included in the systematic review. Many studies used specific predictors not routinely collected and only 60% of the studies provided the full prediction formula. External validation was performed in 1943 dialysis patients from NECOSAD for a total of 7 models. Table 1 shows the discrimination in which the C-statistics are presented as the median and interquartile range from the pooled imputation results. Figure 1 shows the calibration plots per model, for Wagner's model calibration could not be determined due to a missing baseline hazard value.

Table 1:

Discrimination results of external validation in NECOSAD.

StudyTime-frameOriginal PopulationDiscrimination: C-statistic HD & PD
Floege 1 y1 yearHD0.740 (0.738–0.742)
Floege 2 y2 yearHD0.740 (0.737–0.742)
Holme3 yearHD0.734 (0.730–0.737)
Wagner3 yearHD & PD0.730 (0.729–0.731)
Mauri1 yearHD0.728 (0.725–0.730)
Geddes1 yearHD & PD0.721 (0.717–0.723)
2 year0.706 (0.704–0.708)
3 year0.705 (0.702–0.707)
5 year0.698 (0.695–0.700)
Hutchinson1 yearHD0.710 (0.708–0.711)
2 year0.702 (0.701–0.706)
3 year0.700 (0.699–0.702)
5 year0.697 (0.696–0.699)
StudyTime-frameOriginal PopulationDiscrimination: C-statistic HD & PD
Floege 1 y1 yearHD0.740 (0.738–0.742)
Floege 2 y2 yearHD0.740 (0.737–0.742)
Holme3 yearHD0.734 (0.730–0.737)
Wagner3 yearHD & PD0.730 (0.729–0.731)
Mauri1 yearHD0.728 (0.725–0.730)
Geddes1 yearHD & PD0.721 (0.717–0.723)
2 year0.706 (0.704–0.708)
3 year0.705 (0.702–0.707)
5 year0.698 (0.695–0.700)
Hutchinson1 yearHD0.710 (0.708–0.711)
2 year0.702 (0.701–0.706)
3 year0.700 (0.699–0.702)
5 year0.697 (0.696–0.699)
Table 1:

Discrimination results of external validation in NECOSAD.

StudyTime-frameOriginal PopulationDiscrimination: C-statistic HD & PD
Floege 1 y1 yearHD0.740 (0.738–0.742)
Floege 2 y2 yearHD0.740 (0.737–0.742)
Holme3 yearHD0.734 (0.730–0.737)
Wagner3 yearHD & PD0.730 (0.729–0.731)
Mauri1 yearHD0.728 (0.725–0.730)
Geddes1 yearHD & PD0.721 (0.717–0.723)
2 year0.706 (0.704–0.708)
3 year0.705 (0.702–0.707)
5 year0.698 (0.695–0.700)
Hutchinson1 yearHD0.710 (0.708–0.711)
2 year0.702 (0.701–0.706)
3 year0.700 (0.699–0.702)
5 year0.697 (0.696–0.699)
StudyTime-frameOriginal PopulationDiscrimination: C-statistic HD & PD
Floege 1 y1 yearHD0.740 (0.738–0.742)
Floege 2 y2 yearHD0.740 (0.737–0.742)
Holme3 yearHD0.734 (0.730–0.737)
Wagner3 yearHD & PD0.730 (0.729–0.731)
Mauri1 yearHD0.728 (0.725–0.730)
Geddes1 yearHD & PD0.721 (0.717–0.723)
2 year0.706 (0.704–0.708)
3 year0.705 (0.702–0.707)
5 year0.698 (0.695–0.700)
Hutchinson1 yearHD0.710 (0.708–0.711)
2 year0.702 (0.701–0.706)
3 year0.700 (0.699–0.702)
5 year0.697 (0.696–0.699)

graphic

Conclusions: Overall, the performance of the models was poorer in the external validation than in the original ones. Of the validated models, the ones proposed by Floege may be the best suited for predicting mortality in dialysis patients over a time-frame of 1 or 2 years. This study is a step forward in the use of a model with which personalized information on prognosis can be given to dialysis patients, aiding patient-centred decision making.

Comments

0 Comments
Submit a comment
You have entered an invalid code
Thank you for submitting a comment on this article. Your comment will be reviewed and published at the journal's discretion. Please check for further notifications by email.