Dataset Information

Interictal Epileptiform Discharge Detection in EEG in Different Practice Settings.

ABSTRACT: OBJECTIVE:The goal of the study was to measure the performance of academic and private practice (PP) neurologists in detecting interictal epileptiform discharges in routine scalp EEG recordings. METHODS:Thirty-five EEG scorers (EEGers) participated (19 academic and 16 PP) and marked the location of ETs in 200 30-second EEG segments using a web-based EEG annotation system. All participants provided board certification status, years of Epilepsy Fellowship Training (EFT), and years in practice. The Persyst P13 automated IED detection algorithm was also run on the EEG segments for comparison. RESULTS:Academic EEGers had an average of 1.66 years of EFT versus 0.50 years of EFT for PP EEGers (P < 0.0001) and had higher rates of board certification. Inter-rater agreement for the 35 EEGers was fair. There was higher performance for EEGers in academics, with at least 1.5 years of EFT, and with American Board of Clinical Neurophysiology and American Board of Psychiatry and Neurology-E specialty board certification. The Persyst P13 algorithm at its default setting (perception value = 0.4) did not perform as well at the EEGers, but at substantially higher perception value settings, the algorithm performed almost as well human experts. CONCLUSIONS:Inter-rater agreement among EEGers in both academic and PP settings varies considerably. Practice location, years of EFT, and board certification are associated with significantly higher performance for IED detection in routine scalp EEG. Continued medical education of PP neurologists and neurologists without EFT is needed to improve routine scalp EEG interpretation skills. The performance of automated detection algorithms is approaching that of human experts.

SUBMITTER: Halford JJ

PROVIDER: S-EPMC6126936 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Interictal Epileptiform Discharge Detection in EEG in Different Practice Settings.

Halford Jonathan J JJ Westover M Brandon MB LaRoche Suzette M SM Macken Micheal P MP Kutluay Ekrem E Edwards Jonathan C JC Bonilha Leonardo L Kalamangalam Giridhar P GP Ding Kan K Hopp Jennifer L JL Arain Amir A Dawson Rachael A RA Martz Gabriel U GU Wolf Bethany J BJ Waters Chad G CG Dean Brian C BC

Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society 20180901 5

<h4>Objective</h4>The goal of the study was to measure the performance of academic and private practice (PP) neurologists in detecting interictal epileptiform discharges in routine scalp EEG recordings.<h4>Methods</h4>Thirty-five EEG scorers (EEGers) participated (19 academic and 16 PP) and marked the location of ETs in 200 30-second EEG segments using a web-based EEG annotation system. All participants provided board certification status, years of Epilepsy Fellowship Training (EFT), and years i ...[more]

PMID: 30028830

Similar Datasets

Project description:OBJECTIVE:The presence of interictal epileptiform discharges (IED) in the electroencephalogram (EEG) is a key finding in the medical workup of a patient with suspected epilepsy. However, inter-rater agreement (IRA) regarding the presence of IED is imperfect, leading to incorrect and delayed diagnoses. An improved understanding of which IED attributes mediate expert IRA might help in developing automatic methods for IED detection able to emulate the abilities of experts. Therefore, using a set of IED scored by a large number of experts, we set out to determine which attributes of IED predict expert agreement regarding the presence of IED. METHODS:IED were annotated on a 5-point scale by 18 clinical neurophysiologists within 200 30-s EEG segments from recordings of 200 patients. 5538 signal analysis features were extracted from the waveforms, including wavelet coefficients, morphological features, signal energy, nonlinear energy operator response, electrode location, and spectrogram features. Feature selection was performed by applying elastic net regression and support vector regression (SVR) was applied to predict expert opinion, with and without the feature selection procedure and with and without several types of signal normalization. RESULTS:Multiple types of features were useful for predicting expert annotations, but particular types of wavelet features performed best. Local EEG normalization also enhanced best model performance. As the size of the group of EEGers used to train the models was increased, the performance of the models leveled off at a group size of around 11. CONCLUSIONS:The features that best predict inter-rater agreement among experts regarding the presence of IED are wavelet features, using locally standardized EEG. Our models for predicting expert opinion based on EEGer's scores perform best with a large group of EEGers (more than 10). SIGNIFICANCE:By examining a large group of EEG signal analysis features we found that wavelet features with certain wavelet basis functions performed best to identify IEDs. Local normalization also improves predictability, suggesting the importance of IED morphology over amplitude-based features. Although most IED detection studies in the past have used opinion from three or fewer experts, our study suggests a "wisdom of the crowd" effect, such that pooling over a larger number of expert opinions produces a better correlation between expert opinion and objectively quantifiable features of the EEG.

Project description:ObjectiveTo evaluate the diagnostic performance of artificial intelligence (AI)-based algorithms for identifying the presence of interictal epileptiform discharges (IEDs) in routine (20-min) electroencephalography (EEG) recordings.MethodsWe evaluated two approaches: a fully automated one and a hybrid approach, where three human raters applied an operational IED definition to assess the automated detections grouped into clusters by the algorithms. We used three previously developed AI algorithms: Encevis, SpikeNet, and Persyst. The diagnostic gold standard (epilepsy or not) was derived from video-EEG recordings of patients' habitual clinical episodes. We compared the algorithms with the gold standard at the recording level (epileptic or not). The independent validation data set (not used for training) consisted of 20-min EEG recordings containing sharp transients (epileptiform or not) from 60 patients: 30 with epilepsy (with a total of 340 IEDs) and 30 with nonepileptic paroxysmal events. We compared sensitivity, specificity, overall accuracy, and the review time-burden of the fully automated and hybrid approaches, with the conventional visual assessment of the whole recordings, based solely on unrestricted expert opinion.ResultsFor all three AI algorithms, the specificity of the fully automated approach was too low for clinical implementation (16.67%; 63.33%; 3.33%), despite the high sensitivity (96.67%; 66.67%; 100.00%). Using the hybrid approach significantly increased the specificity (93.33%; 96.67%; 96.67%) with good sensitivity (93.33%; 56.67%; 76.67%). The overall accuracy of the hybrid methods (93.33%; 76.67%; 86.67%) was similar to the conventional visual assessment of the whole recordings (83.33%; 95% confidence interval [CI]: 71.48-91.70%; p > .5), yet the time-burden of review was significantly lower (p < .001).SignificanceThe hybrid approach, where human raters apply the operational IED criteria to automated detections of AI-based algorithms, has high specificity, good sensitivity, and overall accuracy similar to conventional EEG reading, with a significantly lower time-burden. The hybrid approach is accurate and suitable for clinical implementation.

Dataset Information

Interictal Epileptiform Discharge Detection in EEG in Different Practice Settings.

Publications

Interictal Epileptiform Discharge Detection in EEG in Different Practice Settings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets