Dataset Information

Weak supervision as an efficient approach for automated seizure detection in electroencephalography.

ABSTRACT: Automated seizure detection from electroencephalography (EEG) would improve the quality of patient care while reducing medical costs, but achieving reliably high performance across patients has proven difficult. Convolutional Neural Networks (CNNs) show promise in addressing this problem, but they are limited by a lack of large labeled training datasets. We propose using imperfect but plentiful archived annotations to train CNNs for automated, real-time EEG seizure detection across patients. While these weak annotations indicate possible seizures with precision scores as low as 0.37, they are commonly produced in large volumes within existing clinical workflows by a mixed group of technicians, fellows, students, and board-certified epileptologists. We find that CNNs trained using such weak annotations achieve Area Under the Receiver Operating Characteristic curve (AUROC) values of 0.93 and 0.94 for pediatric and adult seizure onset detection, respectively. Compared to currently deployed clinical software, our model provides a 31% increase (18 points) in F1-score for pediatric patients and a 17% increase (11 points) for adult patients. These results demonstrate that weak annotations, which are sustainably collected via existing clinical workflows, can be leveraged to produce clinically useful seizure detection models.

SUBMITTER: Saab K

PROVIDER: S-EPMC7170880 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Weak supervision as an efficient approach for automated seizure detection in electroencephalography.

Saab Khaled K Dunnmon Jared J Ré Christopher C Rubin Daniel D Lee-Messer Christopher C

NPJ digital medicine 20200420

Automated seizure detection from electroencephalography (EEG) would improve the quality of patient care while reducing medical costs, but achieving reliably high performance across patients has proven difficult. Convolutional Neural Networks (CNNs) show promise in addressing this problem, but they are limited by a lack of large labeled training datasets. We propose using imperfect but plentiful archived annotations to train CNNs for automated, real-time EEG seizure detection across patients. Whi ...[more]

PMID: 32352037

Similar Datasets

Project description:OBJECTIVE:Seizure diaries kept by patients are unreliable. Automated electroencephalography (EEG)-based seizure detection systems are a useful support tool to objectively detect and register seizures during long-term video-EEG recording. However, this standard full scalp-EEG recording setup is of limited use outside the hospital, and a discreet, wearable device is needed for capturing seizures in the home setting. We are developing a wearable device that records EEG with behind-the-ear electrodes. In this study, we determined whether the recognition of ictal patterns using only behind-the-ear EEG channels is possible. Second, an automated seizure detection algorithm was developed using only those behind-the-ear EEG channels. METHODS:Fifty-four patients with a total of 182 seizures, mostly temporal lobe epilepsy (TLE), and 5284 hours of data, were recorded with a standard video-EEG at University Hospital Leuven. In addition, extra behind-the-ear EEG channels were recorded. First, a neurologist was asked to annotate behind-the-ear EEG segments containing selected seizure and nonseizure fragments. Second, a data-driven algorithm was developed using only behind-the-ear EEG. This algorithm was trained using data from other patients (patient-independent model) or from the same patient (patient-specific model). RESULTS:The visual recognition study resulted in 65.7% sensitivity and 94.4% specificity. By using those seizure annotations, the automated algorithm obtained 64.1% sensitivity and 2.8 false-positive detections (FPs)/24 hours with the patient-independent model. The patient-specific model achieved 69.1% sensitivity and 0.49 FPs/24 hours. SIGNIFICANCE:Visual recognition of ictal EEG patterns using only behind-the-ear EEG is possible in a significant number of patients with TLE. A patient-specific seizure detection algorithm using only behind-the-ear EEG was able to detect more seizures automatically than what patients typically report, with 0.49 FPs/24 hours. We conclude that a large number of refractory TLE patients can benefit from using this device.

Project description:OBJECTIVE:The purpose of this study was to evaluate and validate an offline, automated scalp EEG-based seizure detection system and to compare its performance to commercially available seizure detection software. METHODS:The test seizure detection system, IdentEvent™, was developed to enhance the efficiency of post-hoc long-term EEG review in epilepsy monitoring units. It translates multi-channel scalp EEG signals into multiple EEG descriptors and recognizes ictal EEG patterns. Detection criteria and thresholds were optimized in 47 long-term scalp EEG recordings selected for training (47 subjects, ?3653h with 141 seizures). The detection performance of IdentEvent was evaluated using a separate test dataset consisting of 436 EEG segments obtained from 55 subjects (?1200h with 146 seizures). Each of the test EEG segments was reviewed by three independent epileptologists and the presence or absence of seizures in each epoch was determined by majority rule. Seizure detection sensitivity and false detection rate were calculated for IdentEvent as well as for the comparable detection software (Persyst's Reveal®, version 2008.03.13, with three parameter settings). Bootstrap re-sampling was applied to establish the 95% confidence intervals of the estimates and for the performance comparison between two detection algorithms. RESULTS:The overall detection sensitivity of IdentEvent was 79.5% with a false detection rate (FDR) of 2 per 24h, whereas the comparison system had 80.8%, 76%, and 74% sensitivity using its three detection thresholds (perception score) with FDRs of 13, 8, and 6 per 24h, respectively. Bootstrap 95% confidence intervals of the performance difference revealed that the two detection systems had comparable detection sensitivity, but IdentEvent generated a significantly (p<0.05) smaller FDR. CONCLUSIONS:The study validates the performance of the IdentEvent™ seizure detection system. SIGNIFICANCE:With comparable detection sensitivity, an improved false detection rate makes the automated seizure detection software more useful in clinical practice.

Dataset Information

Weak supervision as an efficient approach for automated seizure detection in electroencephalography.

Publications

Weak supervision as an efficient approach for automated seizure detection in electroencephalography.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets