Dataset Information

Crowdsourcing reproducible seizure forecasting in human and canine epilepsy.

ABSTRACT: SEE MORMANN AND ANDRZEJAK DOI101093/BRAIN/AWW091 FOR A SCIENTIFIC COMMENTARY ON THIS ARTICLE : Accurate forecasting of epileptic seizures has the potential to transform clinical epilepsy care. However, progress toward reliable seizure forecasting has been hampered by lack of open access to long duration recordings with an adequate number of seizures for investigators to rigorously compare algorithms and results. A seizure forecasting competition was conducted on kaggle.com using open access chronic ambulatory intracranial electroencephalography from five canines with naturally occurring epilepsy and two humans undergoing prolonged wide bandwidth intracranial electroencephalographic monitoring. Data were provided to participants as 10-min interictal and preictal clips, with approximately half of the 60 GB data bundle labelled (interictal/preictal) for algorithm training and half unlabelled for evaluation. The contestants developed custom algorithms and uploaded their classifications (interictal/preictal) for the unknown testing data, and a randomly selected 40% of data segments were scored and results broadcasted on a public leader board. The contest ran from August to November 2014, and 654 participants submitted 17 856 classifications of the unlabelled test data. The top performing entry scored 0.84 area under the classification curve. Following the contest, additional held-out unlabelled data clips were provided to the top 10 participants and they submitted classifications for the new unseen data. The resulting area under the classification curves were well above chance forecasting, but did show a mean 6.54 ± 2.45% (min, max: 0.30, 20.2) decline in performance. The kaggle.com model using open access data and algorithms generated reproducible research that advanced seizure forecasting. The overall performance from multiple contestants on unseen data was better than a random predictor, and demonstrates the feasibility of seizure forecasting in canine and human epilepsy.media-1vid110.1093/brain/aww045_video_abstractaww045_video_abstract.

SUBMITTER: Brinkmann BH

PROVIDER: S-EPMC5022671 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundPeople with epilepsy are burdened with the apparent unpredictability of seizures. In the past decade, converging evidence from studies using chronic EEG (cEEG) revealed that epileptic brain activity shows robust cycles, operating over hours (circadian) and days (multidien). We hypothesised that these cycles can be leveraged to estimate future seizure probability, and we tested the feasibility of forecasting seizures days in advance.MethodsWe did a feasibility study in distinct development and validation cohorts, involving retrospective analysis of cEEG data recorded with an implanted device in adults (age ≥18 years) with drug-resistant focal epilepsy followed at 35 centres across the USA between Jan 19, 2004, and May 18, 2018. Patients were required to have had 20 or more electrographic seizures (development cohort) or self-reported seizures (validation cohort). In all patients, the device recorded interictal epileptiform activity (IEA; ≥6 months of continuous hourly data), the fluctuations in which helped estimate varying seizure risk. Point process statistical models trained on initial portions of each patient's cEEG data (both cohorts) generated forecasts of seizure probability that were tested on subsequent unseen seizure data and evaluated against surrogate time-series. The primary outcome was the percentage of patients with forecasts showing improvement over chance (IoC).FindingsWe screened 72 and 256 patients, and included 18 and 157 patients in the development and validation cohorts, respectively. Models incorporating information about multidien IEA cycles alone generated daily seizure forecasts for the next calendar day with IoC in 15 (83%) patients in the development cohort and 103 (66%) patients in the validation cohort. The forecasting horizon could be extended up to 3 days while maintaining IoC in two (11%) of 18 patients and 61 (39%) of 157 patients. Forecasts with a shorter horizon of 1 h, possible only for electrographic seizures in the development cohort, showed IoC in all 18 (100%) patients.InterpretationThis study shows that seizure probability can be forecasted days in advance by leveraging multidien IEA cycles recorded with an implanted device. This study will serve as a basis for prospective clinical trials to establish how people with epilepsy might benefit from seizure forecasting over long horizons.FundingNone. VIDEO ABSTRACT.

Project description:The unpredictability of epileptic seizures exposes people with epilepsy to potential physical harm, restricts day-to-day activities, and impacts mental well-being. Accurate seizure forecasters would reduce the uncertainty associated with seizures but need to be feasible and accessible in the long-term. Wearable devices are perfect candidates to develop non-invasive, accessible forecasts but are yet to be investigated in long-term studies. We hypothesized that machine learning models could utilize heart rate as a biomarker for well-established cycles of seizures and epileptic activity, in addition to other wearable signals, to forecast high and low risk seizure periods. This feasibility study tracked participants' (n = 11) heart rates, sleep, and step counts using wearable smartwatches and seizure occurrence using smartphone seizure diaries for at least 6 months (mean = 14.6 months, SD = 3.8 months). Eligible participants had a diagnosis of refractory epilepsy and reported at least 20 seizures (mean = 135, SD = 123) during the recording period. An ensembled machine learning and neural network model estimated seizure risk either daily or hourly, with retraining occurring on a weekly basis as additional data was collected. Performance was evaluated retrospectively against a rate-matched random forecast using the area under the receiver operating curve. A pseudo-prospective evaluation was also conducted on a held-out dataset. Of the 11 participants, seizures were predicted above chance in all (100%) participants using an hourly forecast and in ten (91%) participants using a daily forecast. The average time spent in high risk (prediction time) before a seizure occurred was 37 min in the hourly forecast and 3 days in the daily forecast. Cyclic features added the most predictive value to the forecasts, particularly circadian and multiday heart rate cycles. Wearable devices can be used to produce patient-specific seizure forecasts, particularly when biomarkers of seizure and epileptic activity cycles are utilized.

Project description:Accurate seizure prediction will transform epilepsy management by offering warnings to patients or triggering interventions. However, state-of-the-art algorithm design relies on accessing adequate long-term data. Crowd-sourcing ecosystems leverage quality data to enable cost-effective, rapid development of predictive algorithms. A crowd-sourcing ecosystem for seizure prediction is presented involving an international competition, a follow-up held-out data evaluation, and an online platform, Epilepsyecosystem.org, for yielding further improvements in prediction performance. Crowd-sourced algorithms were obtained via the 'Melbourne-University AES-MathWorks-NIH Seizure Prediction Challenge' conducted at kaggle.com. Long-term continuous intracranial electroencephalography (iEEG) data (442 days of recordings and 211 lead seizures per patient) from prediction-resistant patients who had the lowest seizure prediction performances from the NeuroVista Seizure Advisory System clinical trial were analysed. Contestants (646 individuals in 478 teams) from around the world developed algorithms to distinguish between 10-min inter-seizure versus pre-seizure data clips. Over 10 000 algorithms were submitted. The top algorithms as determined by using the contest data were evaluated on a much larger held-out dataset. The data and top algorithms are available online for further investigation and development. The top performing contest entry scored 0.81 area under the classification curve. The performance reduced by only 6.7% on held-out data. Many other teams also showed high prediction reproducibility. Pseudo-prospective evaluation demonstrated that many algorithms, when used alone or weighted by circadian information, performed better than the benchmarks, including an average increase in sensitivity of 1.9 times the original clinical trial sensitivity for matched time in warning. These results indicate that clinically-relevant seizure prediction is possible in a wider range of patients than previously thought possible. Moreover, different algorithms performed best for different patients, supporting the use of patient-specific algorithms and long-term monitoring. The crowd-sourcing ecosystem for seizure prediction will enable further worldwide community study of the data to yield greater improvements in prediction performance by way of competition, collaboration and synergism.10.1093/brain/awy210_video1awy210media15817489051001.

Dataset Information

Crowdsourcing reproducible seizure forecasting in human and canine epilepsy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets