Multicenter Development and Validation of a Risk Stratification Tool for Ward Patients
- 15 September 2014
- journal article
- research article
- Published by American Thoracic Society in American Journal of Respiratory and Critical Care Medicine
- Vol. 190 (6), 649-655
- https://doi.org/10.1164/rccm.201406-1022oc
Abstract
Most ward risk scores were created using subjective opinion in individual hospitals and only use vital signs. To develop and validate a risk score using commonly collected electronic health record data. All patients hospitalized on the wards in five hospitals were included in this observational cohort study. Discrete-time survival analysis was used to predict the combined outcome of cardiac arrest (CA), intensive care unit (ICU) transfer, or death on the wards. Laboratory results, vital signs, and demographics were used as predictor variables. The model was developed in the first 60% of the data at each hospital and then validated in the remaining 40%. The final model was compared with the Modified Early Warning Score (MEWS) using the area under the receiver operating characteristic curve and the net reclassification index (NRI). A total of 269,999 patient admissions were included, with 424 CAs, 13,188 ICU transfers, and 2,840 deaths occurring during the study period. The derived model was more accurate than the MEWS in the validation dataset for all outcomes (area under the receiver operating characteristic curve, 0.83 vs. 0.71 for CA; 0.75 vs. 0.68 for ICU transfer; 0.93 vs. 0.88 for death; and 0.77 vs. 0.70 for the combined outcome; P value < 0.01 for all comparisons). This accuracy improvement was seen across all hospitals. The NRI for the electronic Cardiac Arrest Risk Triage compared with the MEWS was 0.28 (0.18-0.38), with a positive NRI of 0.19 (0.09-0.29) and a negative NRI of 0.09 (0.09-0.09). We developed an accurate ward risk stratification tool using commonly collected electronic health record variables in a large multicenter dataset. Further study is needed to determine whether implementation in real-time would improve patient outcomes.Keywords
This publication has 41 references indexed in Scilit:
- Trends in Survival after In-Hospital Cardiac ArrestNew England Journal of Medicine, 2012
- Predicting Cardiac Arrest on the Wards: A Nested Case-Control StudyChest, 2012
- Development and validation of PRE-DELIRIC (PREdiction of DELIRium in ICu patients) delirium prediction model for intensive care patients: observational multicentre studyBMJ, 2012
- Incidence of treated cardiac arrest in hospitalized patients in the United States*Critical Care Medicine, 2011
- The use of combined physiological parameters in the early recognition of the deteriorating acute medical patientJournal of the Royal College of Physicians of Edinburgh, 2010
- Evaluating the added predictive ability of a new marker: From area under the ROC curve to reclassification and beyondStatistics in Medicine, 2007
- Waiting for organ transplantation: results of an analysis by an Institute of Medicine CommitteeBiostatistics, 2003
- It's about Time: Using Discrete-Time Survival Analysis to Study Duration and the Timing of EventsJournal of Educational Statistics, 1993
- Logistic Regression, Survival Analysis, and the Kaplan-Meier CurveJournal of the American Statistical Association, 1988
- APACHE IICritical Care Medicine, 1985