The importance of defining periods of complete mortality reporting for research using automated data from primary care

Abstract
Purpose To define periods of acceptable mortality reporting in primary care and to demonstrate through examples the implication for research using automated medical data. Methods Annual death counts were obtained for each primary care practice participating in The Health Improvement Network “THIN” (UK). Expected counts were calculated from national death rates, accounting for the practice's age/sex structure. The standardized mortality ratio (SMR) was calculated with 95% confidence intervals (CI). A visual review process was undertaken to assign the year from which the practice had acceptable mortality reporting (AMR). The process involved reviewer pairs who were blinded to each other's decisions. Patterns of death reporting were checked. The AMR year was applied as a filter to THIN data to assess its impact on the SMR. Results For most practices the SMR was relatively stable and the AMR year was easily identified with 86% agreement between the blinded reviewer pairs. Applying the AMR to THIN removed under-reporting of death. However, the total computerized follow-up reduced from 37 to 32 million patient-years. Problematic death recording patterns included some practices keeping only live patient records when converting their software systems thereby creating ‘immortal periods’ prior to this moment, and peaks occurring when practices updated the vital status of their patients' records. Conclusions This is the first time that an external standard has been used to assess completeness of mortality in automated primary care data. The resulting AMR year provides a natural filter for research and avoids biases associated with ‘immortal periods’, record updating and under-reporting. Copyright © 2008 John Wiley & Sons, Ltd.