Dataset Information

Development of Expert-Level Automated Detection of Epileptiform Discharges During Electroencephalogram Interpretation.

ABSTRACT: Importance:Interictal epileptiform discharges (IEDs) in electroencephalograms (EEGs) are a biomarker of epilepsy, seizure risk, and clinical decline. However, there is a scarcity of experts qualified to interpret EEG results. Prior attempts to automate IED detection have been limited by small samples and have not demonstrated expert-level performance. There is a need for a validated automated method to detect IEDs with expert-level reliability. Objective:To develop and validate a computer algorithm with the ability to identify IEDs as reliably as experts and classify an EEG recording as containing IEDs vs no IEDs. Design, Setting, and Participants:A total of 9571 scalp EEG records with and without IEDs were used to train a deep neural network (SpikeNet) to perform IED detection. Independent training and testing data sets were generated from 13?262 IED candidates, independently annotated by 8 fellowship-trained clinical neurophysiologists, and 8520 EEG records containing no IEDs based on clinical EEG reports. Using the estimated spike probability, a classifier designating the whole EEG recording as positive or negative was also built. Main Outcomes and Measures:SpikeNet accuracy, sensitivity, and specificity compared with fellowship-trained neurophysiology experts for identifying IEDs and classifying EEGs as positive or negative or negative for IEDs. Statistical performance was assessed via calibration error and area under the receiver operating characteristic curve (AUC). All performance statistics were estimated using 10-fold cross-validation. Results:SpikeNet surpassed both expert interpretation and an industry standard commercial IED detector, based on calibration error (SpikeNet, 0.041; 95% CI, 0.033-0.049; vs industry standard, 0.066; 95% CI, 0.060-0.078; vs experts, mean, 0.183; range, 0.081-0.364) and binary classification performance based on AUC (SpikeNet, 0.980; 95% CI, 0.977-0.984; vs industry standard, 0.882; 95% CI, 0.872-0.893). Whole EEG classification had a mean calibration error of 0.126 (range, 0.109-0.1444) vs experts (mean, 0.197; range, 0.099-0.372) and AUC of 0.847 (95% CI, 0.830-0.865). Conclusions and Relevance:In this study, SpikeNet automatically detected IEDs and classified whole EEGs as IED-positive or IED-negative. This may be the first time an algorithm has been shown to exceed expert performance for IED detection in a representative sample of EEGs and may thus be a valuable tool for expedited review of EEGs.

SUBMITTER: Jing J

PROVIDER: S-EPMC6806668 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of Expert-Level Automated Detection of Epileptiform Discharges During Electroencephalogram Interpretation.

Jing Jin J Sun Haoqi H Kim Jennifer A JA Herlopian Aline A Karakis Ioannis I Ng Marcus M Halford Jonathan J JJ Maus Douglas D Chan Fonda F Dolatshahi Marjan M Muniz Carlos C Chu Catherine C Sacca Valeria V Pathmanathan Jay J Ge Wendong W Dauwels Justin J Lam Alice A Cole Andrew J AJ Cash Sydney S SS Westover M Brandon MB

JAMA neurology 20200101 1

<h4>Importance</h4>Interictal epileptiform discharges (IEDs) in electroencephalograms (EEGs) are a biomarker of epilepsy, seizure risk, and clinical decline. However, there is a scarcity of experts qualified to interpret EEG results. Prior attempts to automate IED detection have been limited by small samples and have not demonstrated expert-level performance. There is a need for a validated automated method to detect IEDs with expert-level reliability.<h4>Objective</h4>To develop and validate a ...[more]

PMID: 31633740

Similar Datasets

Project description:Background: Decision-making in epilepsy surgery is strongly connected to the interpretation of the intracranial EEG (iEEG). Although deep learning approaches have demonstrated efficiency in processing extracranial EEG, few studies have addressed iEEG seizure detection, in part due to the small number of seizures per patient typically available from intracranial investigations. This study aims to evaluate the efficiency of deep learning methodology in detecting iEEG seizures using a large dataset of ictal patterns collected from epilepsy patients implanted with a responsive neurostimulation system (RNS). Methods: Five thousand two hundred and twenty-six ictal events were collected from 22 patients implanted with RNS. A convolutional neural network (CNN) architecture was created to provide personalized seizure annotations for each patient. Accuracy of seizure identification was tested in two scenarios: patients with seizures occurring following a period of chronic recording (scenario 1) and patients with seizures occurring immediately following implantation (scenario 2). The accuracy of the CNN in identifying RNS-recorded iEEG ictal patterns was evaluated against human neurophysiology expertise. Statistical performance was assessed via the area-under-precision-recall curve (AUPRC). Results: In scenario 1, the CNN achieved a maximum mean binary classification AUPRC of 0.84 ± 0.19 (95%CI, 0.72-0.93) and mean regression accuracy of 6.3 ± 1.0 s (95%CI, 4.3-8.5 s) at 30 seed samples. In scenario 2, maximum mean AUPRC was 0.80 ± 0.19 (95%CI, 0.68-0.91) and mean regression accuracy was 6.3 ± 0.9 s (95%CI, 4.8-8.3 s) at 20 seed samples. We obtained near-maximum accuracies at seed size of 10 in both scenarios. CNN classification failures can be explained by ictal electro-decrements, brief seizures, single-channel ictal patterns, highly concentrated interictal activity, changes in the sleep-wake cycle, and progressive modulation of electrographic ictal features. Conclusions: We developed a deep learning neural network that performs personalized detection of RNS-derived ictal patterns with expert-level accuracy. These results suggest the potential for automated techniques to significantly improve the management of closed-loop brain stimulation, including during the initial period of recording when the device is otherwise naïve to a given patient's seizures.

Project description:Epileptic cortex is characterized by paroxysmal electrical discharges. Analysis of these interictal discharges typically manifests as spike-wave complexes on electroencephalography, and plays a critical role in diagnosing and treating epilepsy. Despite their fundamental importance, little is known about the neurophysiological mechanisms generating these events in human focal epilepsy. Using three different systems of microelectrodes, we recorded local field potentials and single-unit action potentials during interictal discharges in patients with medically intractable focal epilepsy undergoing diagnostic workup for localization of seizure foci. We studied 336 single units in 20 patients. Ten different cortical areas and the hippocampus, including regions both inside and outside the seizure focus, were sampled. In three of these patients, high density microelectrode arrays simultaneously recorded between 43 and 166 single units from a small (4 mm x 4 mm) patch of cortex. We examined how the firing rates of individual neurons changed during interictal discharges by determining whether the firing rate during the event was the same, above or below a median baseline firing rate estimated from interictal discharge-free periods (Kruskal-Wallis one-way analysis, P<0.05). Only 48% of the recorded units showed such a modulation in firing rate within 500 ms of the discharge. Units modulated during the discharge exhibited significantly higher baseline firing and bursting rates than unmodulated units. As expected, many units (27% of the modulated population) showed an increase in firing rate during the fast segment of the discharge (+ or - 35 ms from the peak of the discharge), while 50% showed a decrease during the slow wave. Notably, in direct contrast to predictions based on models of a pure paroxysmal depolarizing shift, 7.7% of modulated units recorded in or near the seizure focus showed a decrease in activity well ahead (0-300 ms) of the discharge onset, while 12.2% of units increased in activity in this period. No such pre-discharge changes were seen in regions well outside the seizure focus. In many recordings there was also a decrease in broadband field potential activity during this same pre-discharge period. The different patterns of interictal discharge-modulated firing were classified into more than 15 different categories. This heterogeneity in single unit activity was present within small cortical regions as well as inside and outside the seizure onset zone, suggesting that interictal epileptiform activity in patients with epilepsy is not a simple paroxysm of hypersynchronous excitatory activity, but rather represents an interplay of multiple distinct neuronal types within complex neuronal networks.

Project description:Importance:Decades of effort have been devoted to establishing an automated microscopic diagnosis of malaria, but there are challenges in achieving expert-level performance in real-world clinical settings because publicly available annotated data for benchmark and validation are required. Objective:To assess an expert-level malaria detection algorithm using a publicly available benchmark image data set. Design, Setting, and Participants:In this diagnostic study, clinically validated malaria image data sets, the Taiwan Images for Malaria Eradication (TIME), were created by digitizing thin blood smears acquired from patients with malaria selected from the biobank of the Taiwan Centers for Disease Control from January 1, 2003, to December 31, 2018. These smear images were annotated by 4 clinical laboratory scientists who worked in medical centers in Taiwan and trained for malaria microscopic diagnosis at the national reference laboratory of the Taiwan Centers for Disease Control. With TIME, a convolutional neural network-based object detection algorithm was developed for identification of malaria-infected red blood cells. A diagnostic challenge using another independent data set within TIME was performed to compare the algorithm performance against that of human experts as clinical validation. Main Outcomes and Measures:Performance on detecting Plasmodium falciparum-infected blood cells was measured by average precision, and performance on detecting P falciparum infection at the image level was measured using sensitivity, specificity, and area under the receiver operating characteristic curve (AUC). Results:The TIME data sets contained 8145 images of 36 blood smears from patients with suspected malaria (30 P falciparum-positive and 6 P falciparum-negative smears) that had reliable annotations. For clinical validation, the average precision was 0.885 for detecting P falciparum-infected blood cells and 0.838 for ring form. For detecting P falciparum infection on blood smear images, the algorithm had expert-level performance (sensitivity, 0.995; specificity, 0.900; AUC, 0.997 [95% CI, 0.993-0.999]), especially in detecting ring form (sensitivity, 0.968; specificity, 0.960; AUC, 0.995 [95% CI, 0.990-0.998]) compared with experienced microscopists (mean sensitivity, 0.995 [95% CI, 0.993-0.998]; mean specificity, 0.955 [95% CI, 0.885-1.000]). Conclusions and Relevance:The findings suggest that a clinically validated expert-level malaria detection algorithm can be developed by using reliable data sets.

Dataset Information

Development of Expert-Level Automated Detection of Epileptiform Discharges During Electroencephalogram Interpretation.

Publications

Development of Expert-Level Automated Detection of Epileptiform Discharges During Electroencephalogram Interpretation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets