Kidney Failure Prediction Models: A Comprehensive External Validation Study in Patients with Advanced CKD
- 3 May 2021
- journal article
- research article
- Published by Ovid Technologies (Wolters Kluwer Health) in Journal of the American Society of Nephrology
- Vol. 32 (5), 1174-1186
- https://doi.org/10.1681/asn.2020071077
Abstract
Background Various prediction models have been developed to predict the risk of kidney failure in patients with CKD. However, guideline-recommended models have yet to be compared head to head, their validation in patients with advanced CKD is lacking, and most do not account for competing risks. Methods To externally validate 11 existing models of kidney failure, taking the competing risk of death into account, we included patients with advanced CKD from two large cohorts: the European Quality Study (EQUAL), an ongoing European prospective, multicenter cohort study of older patients with advanced CKD, and the Swedish Renal Registry (SRR), an ongoing registry of nephrology-referred patients with CKD in Sweden. The outcome of the models was kidney failure (defined as RRT-treated ESKD). We assessed model performance with discrimination and calibration. Results The study included 1580 patients from EQUAL and 13,489 patients from SRR. The average c statistic over the 11 validated models was 0.74 in EQUAL and 0.80 in SRR, compared with 0.89 in previous validations. Most models with longer prediction horizons overestimated the risk of kidney failure considerably. The 5-year Kidney Failure Risk Equation (KFRE) overpredicted risk by 10%–18%. The four- and eight-variable 2-year KFRE and the 4-year Grams model showed excellent calibration and good discrimination in both cohorts. Conclusions Some existing models can accurately predict kidney failure in patients with advanced CKD. KFRE performed well for a shorter time frame (2 years), despite not accounting for competing events. Models predicting over a longer time frame (5 years) overestimated risk because of the competing risk of death. The Grams model, which accounts for the latter, is suitable for longer-term predictions (4 years).Keywords
Funding Information
- Nierstichting (16OKG12)
This publication has 51 references indexed in Scilit:
- Discussions of the Kidney Disease Trajectory by Elderly Patients and Nephrologists: A Qualitative StudyAmerican Journal of Kidney Diseases, 2012
- Prediction of ESRD and Death Among People With CKD: The Chronic Renal Impairment in Birmingham (CRIB) Prospective Cohort StudyAmerican Journal of Kidney Diseases, 2010
- External Validity of Risk Models: Use of Benchmark Values to Disentangle a Case-Mix Effect From Incorrect CoefficientsAmerican Journal of Epidemiology, 2010
- Prediction of ESRD in Pauci-immune Necrotizing Glomerulonephritis: Quantitative Histomorphometric Assessment and Serum CreatinineAmerican Journal of Kidney Diseases, 2010
- Assessing the Performance of Prediction ModelsEpidemiology, 2010
- Prognostic Models With Competing RisksEpidemiology, 2009
- Predicting the Risk of Dialysis and Transplant Among Patients With CKD: A Retrospective Cohort StudyAmerican Journal of Kidney Diseases, 2008
- Statistical Evaluation of Prognostic versus Diagnostic Models: Beyond the ROC CurveClinical Chemistry, 2008
- Multiple imputation of discrete and continuous data by fully conditional specificationStatistical Methods in Medical Research, 2007
- Use and Misuse of the Receiver Operating Characteristic Curve in Risk PredictionCell Metabolism, 2007