Dataset Information

Prospective validation study of an epilepsy seizure risk system for outpatient evaluation.

ABSTRACT:

Objective

We conducted clinical testing of an automated Bayesian machine learning algorithm (Epilepsy Seizure Assessment Tool [EpiSAT]) for outpatient seizure risk assessment using seizure counting data, and validated performance against specialized epilepsy clinician experts.

Methods

We conducted a prospective longitudinal study of EpiSAT performance against 24 specialized clinician experts at three tertiary referral epilepsy centers in the United States. Accuracy, interrater reliability, and intra-rater reliability of EpiSAT for correctly identifying changes in seizure risk (improvements, worsening, or no change) were evaluated using 120 seizures from four synthetic seizure diaries (seizure risk known) and 120 seizures from four real seizure diaries (seizure risk unknown). The proportion of observed agreement between EpiSAT and clinicians was evaluated to assess compatibility of EpiSAT with clinical decision patterns by epilepsy experts.

Results

EpiSAT exhibited substantial observed agreement (75.4%) with clinicians for assessing seizure risk. The mean accuracy of epilepsy providers for correctly assessing seizure risk was 74.7%. EpiSAT accurately identified seizure risk in 87.5% of seizure diary entries, corresponding to a significant improvement of 17.4% (P = .002). Clinicians exhibited low-to-moderate interrater reliability for seizure risk assessment (Krippendorff's ? = 0.46) with good intrarater reliability across a 4- to 12-week evaluation period (Scott's ? = 0.89).

Significance

These results validate the ability of EpiSAT to yield objective clinical recommendations on seizure risk which follow decision patterns similar to those from specialized epilepsy providers, but with improved accuracy and reproducibility. This algorithm may serve as a useful clinical decision support system for quantitative analysis of clinical seizure frequency in clinical epilepsy practice.

SUBMITTER: Chiang S

PROVIDER: S-EPMC6980278 | biostudies-literature | 2020 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Prospective validation study of an epilepsy seizure risk system for outpatient evaluation.

Chiang Sharon S Goldenholz Daniel M DM Moss Robert R Rao Vikram R VR Haneef Zulfi Z Theodore William H WH Kleen Jonathan K JK Gavvala Jay J Vannucci Marina M Stern John M JM

Epilepsia 20191202 1

<h4>Objective</h4>We conducted clinical testing of an automated Bayesian machine learning algorithm (Epilepsy Seizure Assessment Tool [EpiSAT]) for outpatient seizure risk assessment using seizure counting data, and validated performance against specialized epilepsy clinician experts.<h4>Methods</h4>We conducted a prospective longitudinal study of EpiSAT performance against 24 specialized clinician experts at three tertiary referral epilepsy centers in the United States. Accuracy, interrater rel ...[more]

PMID: 31792970

Similar Datasets

Project description:BackgroundPeople with epilepsy are burdened with the apparent unpredictability of seizures. In the past decade, converging evidence from studies using chronic EEG (cEEG) revealed that epileptic brain activity shows robust cycles, operating over hours (circadian) and days (multidien). We hypothesised that these cycles can be leveraged to estimate future seizure probability, and we tested the feasibility of forecasting seizures days in advance.MethodsWe did a feasibility study in distinct development and validation cohorts, involving retrospective analysis of cEEG data recorded with an implanted device in adults (age ?18 years) with drug-resistant focal epilepsy followed at 35 centres across the USA between Jan 19, 2004, and May 18, 2018. Patients were required to have had 20 or more electrographic seizures (development cohort) or self-reported seizures (validation cohort). In all patients, the device recorded interictal epileptiform activity (IEA; ?6 months of continuous hourly data), the fluctuations in which helped estimate varying seizure risk. Point process statistical models trained on initial portions of each patient's cEEG data (both cohorts) generated forecasts of seizure probability that were tested on subsequent unseen seizure data and evaluated against surrogate time-series. The primary outcome was the percentage of patients with forecasts showing improvement over chance (IoC).FindingsWe screened 72 and 256 patients, and included 18 and 157 patients in the development and validation cohorts, respectively. Models incorporating information about multidien IEA cycles alone generated daily seizure forecasts for the next calendar day with IoC in 15 (83%) patients in the development cohort and 103 (66%) patients in the validation cohort. The forecasting horizon could be extended up to 3 days while maintaining IoC in two (11%) of 18 patients and 61 (39%) of 157 patients. Forecasts with a shorter horizon of 1 h, possible only for electrographic seizures in the development cohort, showed IoC in all 18 (100%) patients.InterpretationThis study shows that seizure probability can be forecasted days in advance by leveraging multidien IEA cycles recorded with an implanted device. This study will serve as a basis for prospective clinical trials to establish how people with epilepsy might benefit from seizure forecasting over long horizons.FundingNone. VIDEO ABSTRACT.

Project description:Background: Using machine learning to combine wrist accelerometer (ACM) and electrodermal activity (EDA) has been shown effective to detect primarily and secondarily generalized tonic-clonic seizures, here termed as convulsive seizures (CS). A prospective study was conducted for the FDA clearance of an ACM and EDA-based CS-detection device based on a predefined machine learning algorithm. Here we present its performance on pediatric and adult patients in epilepsy monitoring units (EMUs). Methods: Patients diagnosed with epilepsy participated in a prospective multi-center clinical study. Three board-certified neurologists independently labeled CS from video-EEG. The Detection Algorithm was evaluated in terms of Sensitivity and false alarm rate per 24 h-worn (FAR) on all the data and on only periods of rest. Performance were analyzed also applying the Detection Algorithm offline, with a less sensitive but more specific parameters configuration ("Active mode"). Results: Data from 152 patients (429 days) were used for performance evaluation (85 pediatric aged 6-20 years, and 67 adult aged 21-63 years). Thirty-six patients (18 pediatric) experienced a total of 66 CS (35 pediatric). The Sensitivity (corrected for clustered data) was 0.92, with a 95% confidence interval (CI) of [0.85-1.00] for the pediatric population, not significantly different (p > 0.05) from the adult population's Sensitivity (0.94, CI: [0.89-1.00]). The FAR on the pediatric population was 1.26 (CI: [0.87-1.73]), higher (p < 0.001) than in the adult population (0.57, CI: [0.36-0.81]). Using the Active mode, the FAR decreased by 68% while reducing Sensitivity to 0.95 across the population. During rest periods, the FAR's were 0 for all patients, lower than during activity periods (p < 0.001). Conclusions: Performance complies with FDA's requirements of a lower bound of CI for Sensitivity higher than 0.7 and of a FAR lower than 2, for both age groups. The pediatric FAR was higher than the adult FAR, likely due to higher pediatric activity. The high Sensitivity and precision (having no false alarms) during sleep might help mitigate SUDEP risk by summoning caregiver intervention. The Active mode may be advantageous for some patients, reducing the impact of the FAR on daily life. Future work will examine the performance and usability outside of EMUs.

Project description:ObjectivesSeveral COVID-19 vaccines list "uncontrolled epilepsy" as a contraindication for vaccination. This consequently restricts vaccination against COVID-19 in patients with epilepsy (PWE). However, there is no strong evidence that COVID-19 vaccination can exacerbate conditions in PWE. This study aims to determine the impact of COVID-19 vaccination on PWE.MethodsPWE were prospectively recruited from 25 epilepsy centers. We recorded the seizure frequency at three time periods (one month before the first vaccination and one month after the first and second vaccinations). A generalized linear mixed-effects model (GLMM) was used for analysis, and the adjusted incidence rate ratio (AIRR) with 95% CI was presented and interpreted accordingly.ResultsOverall, 859 PWE were included in the analysis. Thirty-one (3.6%) and 35 (4.1%) patients were found to have increased seizure frequency after the two doses, respectively. Age had an interaction with time. The seizure frequency in adults decreased by 81% after the first dose (AIRR=0.19, 95% CI:0.11-0.34) and 85% after the second dose (AIRR=0.16, 95% CI:0.08-0.30). In juveniles (<18), it was 25% (AIRR=0.75, 95% CI:0.42-1.34) and 51% (AIRR=0.49, 95% CI:0.25-0.95), respectively. Interval between the last seizure before vaccination and the first dose of vaccination (ILSFV) had a significant effect on seizure frequency after vaccination. Seizure frequency in PWE with hereditary epilepsy after vaccination was significantly higher than that in PWE with unknown etiology (AIRR=1.95, 95% CI: 1.17-3.24). Two hundred and seventeen (25.3%) patients experienced non-epileptic but not serious adverse reactions.DiscussionThe inactivated COVID-19 vaccine does not significantly increase seizure frequency in PWE. The limitations of vaccination in PWE should focus on aspects other than control status. Juvenile PWE should be of greater concern after vaccination because they have lower safety. Finally, PWE should not reduce the dosage of anti-seizure medication during the peri-vaccination period.

Dataset Information

Prospective validation study of an epilepsy seizure risk system for outpatient evaluation.

Objective

Methods

Results

Significance

Publications

Prospective validation study of an epilepsy seizure risk system for outpatient evaluation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets