Agreement in Computer-Assisted Manual Scoring of Polysomnograms across Sleep Centers
Open Access
- 1 April 2013
- journal article
- research article
- Published by Oxford University Press (OUP) in Sleep
- Vol. 36 (4), 583-589
- https://doi.org/10.5665/sleep.2550
Abstract
To determine intersite agreement in respiratory event scoring of polysomnograms (PSGs) using different hypopnea definitions. Technical assessment. Five academic medical centers. N/A. N/A. Seventy good-quality PSGs performed in middle-aged women were manually scored by two experienced technologists at each of the five sleep centers using the particular laboratory's own software system. Studies were scored once by each scorer using American Academy of Sleep Medicine (AASM) standards for scoring sleep stages, arousals, and apneas. Hypopneas were then scored using three different AASM criteria: recommended, alternate, and research (Chicago). Means of each PSG variable for the scorers at each site were used to calculate an across-site intraclass correlation coefficient (ICC). Average AHI across the 10 scorers was 7.4 ± 12.3 (standard deviation) events/h using recommended criteria (ICC 0.984; 95% confidence interval [CI] 0.977-0.990), 12.1 ± 13.3 events/h using alternate criteria (ICC 0.947; 95% CI 0.889-0.972), and 15.1 ± 13.9 events/h with Chicago criteria (ICC 0.800; 95% CI 0.768-0.828). ICC across sites was 0.870 (95% CI = 0.847-0.889) for total sleep time, 0.861 (95% CI 0.837-0.881) for number of obstructive apneas and 0.683 (95% CI 0.640-0.722) for number of central apneas. ICCs across sites for hypopneas were very good using recommended criteria (ICC 0.843; 95% CI 0.820-0.870) but decreased when alternate criteria (ICC 0.728; 95% CI 0.689-0.763) and Chicago criteria (ICC 0.535; 95% CI 0.485-0.583) were used. Experienced scorers at different laboratories have very good agreement in hypopnea and AHI results when good-quality PSGs are scored using AASM-recommended criteria. Substantial degradation of reliability was observed for alternative definitions of hypopneas, particularly that proposed for research.Keywords
This publication has 25 references indexed in Scilit:
- Agreement in the Scoring of Respiratory Events and Sleep Among International Sleep CentersSleep, 2013
- Performance of an Automated Polysomnography Scoring System Versus Computer-Assisted Manual ScoringSleep, 2013
- Noninferiority of Functional Outcome in Ambulatory Management of Obstructive Sleep ApneaAmerican Journal of Respiratory and Critical Care Medicine, 2011
- Obstructive Sleep Apnea Among Obese Patients With Type 2 DiabetesDiabetes Care, 2009
- Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standardJournal of Sleep Research, 2009
- Choice of Oximeter Affects Apnea-Hypopnea IndexChest, 2005
- Proposed supplements and amendments to ‘A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects’, the Rechtschaffen & Kales (1968) standardPsychiatry and Clinical Neurosciences, 2001
- Effects of Varying Approaches for Identifying Respiratory Disturbances on Sleep Apnea AssessmentAmerican Journal of Respiratory and Critical Care Medicine, 2000
- Interobserver Variability in Recognizing Arousal in Respiratory Sleep DisordersAmerican Journal of Respiratory and Critical Care Medicine, 1998
- A simple format for exchange of digitized polygraphic recordingsElectroencephalography and Clinical Neurophysiology, 1992