A new measure of prognostic separation in survival data

Abstract

Multivariable prognostic models are widely used in cancer and other disease areas, and have a range of applications in clinical medicine, clinical trials and allocation of health services resources. A well‐founded and reliable measure of the prognostic ability of a model would be valuable to help define the separation between patients or prognostic groups that the model could provide, and to act as a benchmark of model performance in a validation setting. We propose such a measure for models of survival data. Its motivation derives originally from the idea of separation between Kaplan–Meier curves. We define the criteria for a successful measure and discuss them with respect to our approach. Adjustments for ‘optimism’, the tendency for a model to predict better on the data on which it was derived than on new data, are suggested. We study the properties of the measure by simulation and by example in three substantial data sets. We believe that our new measure will prove useful as a tool to evaluate the separation available‐with a prognostic model. Copyright © 2004 John Wiley & Sons, Ltd.