Agreement between patient-reported symptoms and their documentation in the medical record.
- 1 August 2008
- journal article
- Vol. 14 (8), 530-9
Abstract
To determine the agreement between patient-reported symptoms of chest pain, dyspnea, and cough and the documentation of these symptoms by physicians in the electronic medical record. Symptoms reported on patient-provided information forms between January 1, 2006, and June 30, 2006, were compared with those identified by natural language processing of the text of clinical notes from care providers. Terms that represent the 3 symptoms were used to search clinical notes electronically with subsequent manual identification of the context (eg, affirmative, negated, family history) in which they occurred. Results were reported using positive and negative agreement, and kappa statistics. Symptoms reported by 1119 patients age 18 years or older were compared with the nonnegated terms identified in their clinical notes. Positive agreement was 74, 70, and 63 for chest pain, dyspnea, and cough, while negative agreement was 78, 76, and 75, respectively. Kappa statistics were 0.52 (95% confidence interval [CI] = 0.44, 0.60) for chest pain, 0.46 (95% CI = 0.37, 0.54) for dyspnea, and 0.38 (95% CI = 0.28, 0.48) for cough. Positive agreement was higher for older men (P >.05), and negative agreement was higher for younger women (P >.05). We found discordance between patient self-report and documentation of symptoms in the medical record. This discordance has important implications for research studies that rely on symptom information for patient identification and may have clinical implications that must be evaluated for potential impact on quality of care, patient safety, and outcomes.Keywords
This publication has 25 references indexed in Scilit:
- Epidemiology of angina pectoris: Role of natural language processing of the medical recordAmerican Heart Journal, 2007
- President’s Page: Achieving the Heights of Quality With Electronic Health RecordsJournal of the American College of Cardiology, 2007
- Developing a corpus of clinical notes manually annotated for part-of-speechInternational Journal of Medical Informatics, 2006
- Heart Disease and Stroke Statistics—2006 UpdateCirculation, 2006
- Automated Detection of Adverse Events Using Natural Language Processing of Discharge SummariesJournal of the American Medical Informatics Association, 2005
- Prognosis of angina with and without a diagnosis: 11 year follow up in the Whitehall II prospective cohort studyBMJ, 2003
- Gender differences in descriptions of angina symptoms and health problems immediately prior to angiography: the ACRE studySocial Science & Medicine, 2001
- Natural Language Processing and the Representation of Clinical DataJournal of the American Medical Informatics Association, 1994
- An International Randomized Trial Comparing Four Thrombolytic Strategies for Acute Myocardial InfarctionNew England Journal of Medicine, 1993
- High agreement but low Kappa: I. the problems of two paradoxesJournal of Clinical Epidemiology, 1990