Dataset Information

Home sleep apnea testing: comparison of manual and automated scoring across international sleep centers.

ABSTRACT: PURPOSE:To determine the agreement between the manual scoring of home sleep apnea tests (HSATs) by international sleep technologists and automated scoring systems. METHODS:Fifteen HSATs, previously recorded using a type 3 monitor, were saved in European Data Format. The studies were scored by nine experienced technologists from the sleep centers of the Sleep Apnea Global Interdisciplinary Consortium (SAGIC) using the locally available software. Each study was scored separately by human scorers using the nasal pressure (NP), flow derived from the NP signal (transformed NP), or respiratory inductive plethysmography (RIP) flow. The same procedure was followed using two automated scoring systems: Remlogic (RLG) and Noxturnal (NOX). RESULTS:The intra-class correlation coefficients (ICCs) of the apnea-hypopnea index (AHI) scoring using the NP, transformed NP, and RIP flow were 0.96 [95% CI 0.93-0.99], 0.98 [0.96-0.99], and 0.97 [0.95-0.99], respectively. Using the NP signal, the mean differences in AHI between the average of the manual scoring and the automated systems were -?0.9?±?3.1/h (AHIRLG vs AHIMANUAL) and -?1.3?±?2.6/h (AHINOX vs AHIMANUAL). Using the transformed NP, the mean differences in AHI were -?1.9?±?3.3/h (AHIRLG vs AHIMANUAL) and 1.6?±?3.0/h (AHINOX vs AHIMANUAL). Using the RIP flow, the mean differences in AHI were -?2.7?±?4.5/h (AHIRLG vs AHIMANUAL) and 2.3?±?3.4/h (AHINOX vs AHIMANUAL). CONCLUSIONS:There is very strong agreement in the scoring of the AHI for HSATs between the automated systems and experienced international technologists. Automated scoring of HSATs using commercially available software may be useful to standardize scoring in future endeavors involving international sleep centers.

SUBMITTER: Magalang UJ

PROVIDER: S-EPMC6615031 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Home sleep apnea testing: comparison of manual and automated scoring across international sleep centers.

Magalang Ulysses J UJ Johns Jennica N JN Wood Katherine A KA Mindel Jesse W JW Lim Diane C DC Bittencourt Lia R LR Chen Ning-Hung NH Cistulli Peter A PA Gíslason Thorarinn T Arnardottir Erna S ES Penzel Thomas T Tufik Sergio S Pack Allan I AI

Sleep & breathing = Schlaf & Atmung 20180910 1

<h4>Purpose</h4>To determine the agreement between the manual scoring of home sleep apnea tests (HSATs) by international sleep technologists and automated scoring systems.<h4>Methods</h4>Fifteen HSATs, previously recorded using a type 3 monitor, were saved in European Data Format. The studies were scored by nine experienced technologists from the sleep centers of the Sleep Apnea Global Interdisciplinary Consortium (SAGIC) using the locally available software. Each study was scored separately by ...[more]

PMID: 30203176

Similar Datasets

Project description:Study objectivesThe objective of the study is to validate the performance of Belun Ring Platform, a novel home sleep apnea testing system using a patented pulse oximeter sensor and a proprietary cloud-based neural networks algorithm.MethodsThe Belun Ring captures oxygen saturation, photoplethysmography, and accelerometer signals. The Belun Ring total sleep time is derived from features extracted from accelerometer, oxygen saturation, and photoplethysmography signals. The Belun Ring respiratory event index is derived from Belun Ring total sleep time and features extracted from heart rate variability and oxygen saturation changes. A total of 50 adults without significant cardiopulmonary or neuromuscular comorbidities and heart rate affecting medications were evaluated. In-lab sleep studies were performed simultaneously with the Ring and the studies were manually scored using the American Academy of Sleep Medicine Scoring Manual 4% desaturation criteria.ResultsThe Belun Ring respiratory event index correlated well with the polysomnography-apnea-hypopnea index (AHI; r = .894, P < .001). The sensitivity and specificity in categorizing AHI ≥ 15 events/h were 0.85 and 0.87, respectively, and the positive predictive value and negative predictive value were 0.88 and 0.83, respectively. The Belun Ring total sleep time also correlated well with the polysomnography-total sleep time (r = .945, P < .001). Although the Belun Ring Platform has a good overall performance, it tends to overestimate AHI in individuals with AHI under 15 events/h and underestimate AHI in those with AHI over 15 events/h. Conclusions: In this proof-of-concept study, the Belun Ring Platform demonstrated a reasonable accuracy in predicting AHI and total sleep time in patients without significant comorbidities and heart rate-affecting medications.Clinical trial registrationRegistry: ClinicalTrials.gov; Name: Validation of a Novel Device for Screening Patients With Symptoms of Obstructive Sleep Apnea; URL: https://clinicaltrials.gov/ct2/show/NCT04121923; Identifier: NCT04121923.

Project description:BackgroundThe advent of home sleep testing has allowed for the development of an ambulatory care model for OSA that most health-care providers can easily deploy. Although automated algorithms that accompany home sleep monitors can identify and classify disordered breathing events, it is unclear whether manual scoring followed by expert review of home sleep recordings is of any value. Thus, this study examined the agreement between automated and manual scoring of home sleep recordings.MethodsTwo type 3 monitors (ApneaLink Plus [ResMed] and Embletta [Embla Systems]) were examined in distinct study samples. Data from manual and automated scoring were available for 200 subjects. Two thresholds for oxygen desaturation (≥ 3% and ≥ 4%) were used to define disordered breathing events. Agreement between manual and automated scoring was examined using Pearson correlation coefficients and Bland-Altman analyses.ResultsAutomated scoring consistently underscored disordered breathing events compared with manual scoring for both sleep monitors irrespective of whether a ≥ 3% or ≥ 4% oxygen desaturation threshold was used to define the apnea-hypopnea index (AHI). For the ApneaLink Plus monitor, Bland-Altman analyses revealed an average AHI difference between manual and automated scoring of 6.1 (95% CI, 4.9-7.3) and 4.6 (95% CI, 3.5-5.6) events/h for the ≥ 3% and ≥ 4% oxygen desaturation thresholds, respectively. Similarly for the Embletta monitor, the average difference between manual and automated scoring was 5.3 (95% CI, 3.2-7.3) and 8.4 (95% CI, 7.2-9.6) events/h, respectively.ConclusionsAlthough agreement between automated and manual scoring of home sleep recordings varies based on the device used, modest agreement was observed between the two approaches. However, manual review of home sleep test recordings can decrease the misclassification of OSA severity, particularly for those with mild disease.Trial registryClinicalTrials.gov; No.: NCT01503164; www.clinicaltrials.gov.

Project description:Objectives: Sleep time information is essential for monitoring of obstructive sleep apnea (OSA), as the severity assessment depends on the number of breathing disturbances per hour of sleep. However, clinical procedures for sleep monitoring rely on numerous uncomfortable sensors, which could affect sleeping patterns. Therefore, an automated method to identify sleep intervals from unobtrusive data is required. However, most unobtrusive sensors suffer from data loss and sensitivity to movement artifacts. Thus, current sleep detection methods are inadequate, as these require long intervals of good quality. Moreover, sleep monitoring of OSA patients is often less reliable due to heart rate disturbances, movement and sleep fragmentation. The primary aim was to develop a sleep-wake classifier for sleep time estimation of suspected OSA patients, based on single short-term segments of their cardiac and respiratory signals. The secondary aim was to define metrics to detect OSA patients directly from their predicted sleep-wake pattern and prioritize them for clinical diagnosis. Methods: This study used a dataset of 183 suspected OSA patients, of which 36 test subjects. First, a convolutional neural network was designed for sleep-wake classification based on healthier patients (AHI < 10). It employed single 30 s epochs of electrocardiograms and respiratory inductance plethysmograms. Sleep information and Total Sleep Time (TST) was derived for all patients using the short-term segments. Next, OSA patients were detected based on the average confidence of sleep predictions and the percentage of sleep-wake transitions in the predicted sleep architecture. Results: Sleep-wake classification on healthy, mild and moderate patients resulted in moderate κ scores of 0.51, 0.49, and 0.48, respectively. However, TST estimates decreased in accuracy with increasing AHI. Nevertheless, severe patients were detected with a sensitivity of 78% and specificity of 89%, and prioritized for clinical diagnosis. As such, their inaccurate TST estimate becomes irrelevant. Excluding detected OSA patients resulted in an overall estimated TST with a mean bias error of 21.9 (± 55.7) min and Pearson correlation of 0.74 to the reference. Conclusion: The presented framework offered a realistic tool for unobtrusive sleep monitoring of suspected OSA patients. Moreover, it enabled fast prioritization of severe patients for clinical diagnosis.

Dataset Information

Home sleep apnea testing: comparison of manual and automated scoring across international sleep centers.

Publications

Home sleep apnea testing: comparison of manual and automated scoring across international sleep centers.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets