Performance metrics for online seizure prediction.
Ontology highlight
ABSTRACT:
SUBMITTER: Chen HH
PROVIDER: S-EPMC7340210 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Assay Performance Metrics for Low RNA Inputs and Single Cells
2012-02-27 | GSE34363 | GEO
Project description:Software is a complex entity, and its development needs careful planning and a high amount of time and cost. To assess quality of program, software measures are very helpful. Amongst the existing measures, coupling is an important design measure, which computes the degree of interdependence among the entities of a software system. Higher coupling leads to cognitive complexity and thus a higher probability occurrence of faults. Well in time prediction of fault-prone modules assists in saving time and cost of testing. This paper aims to capture important aspects of coupling and then assess the effectiveness of these aspects in determining fault-prone entities in the software system. We propose two coupling metrics, i.e., Vovel-in and Vovel-out, that capture the level of coupling and the volume of information flow. We empirically evaluate the effectiveness of the Vovel metrics in determining the fault-prone classes using five projects, i.e., Eclipse JDT, Equinox framework, Apache Lucene, Mylyn, and Eclipse PDE UI. Model building is done using univariate logistic regression and later Spearman correlation coefficient is computed with the existing coupling metrics to assess the coverage of unique information. Finally, the least correlated metrics are used for building multivariate logistic regression with and without the use of Vovel metrics, to assess the effectiveness of Vovel metrics. The results show the proposed metrics significantly improve the predicting of fault prone classes. Moreover, the proposed metrics cover a significant amount of unique information which is not covered by the existing well-known coupling metrics, i.e., CBO, RFC, Fan-in, and Fan-out. This paper, empirically evaluates the impact of coupling metrics, and more specifically the importance of level and volume of coupling in software fault prediction. The results advocate the prudent addition of proposed metrics due to their unique information coverage and significant predictive ability.
| S-EPMC8205299 | biostudies-literature
Project description:Focus on predictive algorithm and its performance evaluation is extensively covered in most research studies to determine best or appropriate predictive model with Optimum prediction solution indicated by prediction accuracy score, precision, recall, f1score etc. Prediction accuracy score from performance evaluation has been used extensively as the main determining metric for performance recommendation. It is one of the most widely used metric for identifying optimal prediction solution irrespective of dataset class distribution context or nature of dataset and output class distribution between the minority and majority variables. The key research question however is the impact of class inequality on prediction accuracy score in such datasets with output class distribution imbalance as compared to balanced accuracy score in the determination of model performance in healthcare and other real-world application systems. Answering this question requires an appraisal of current state of knowledge in both prediction accuracy score and balanced accuracy score use in real-world applications where there is unequal class distribution. Review of related works that highlight the use of imbalanced class distribution datasets with evaluation metrics will assist in contextualizing this systematic review.
| S-EPMC10688675 | biostudies-literature
Project description:Epilepsy is a chronic non-communicable disorder of the brain that affects individuals of all ages. It is caused by a sudden abnormal discharge of brain neurons leading to temporary dysfunction. In this regard, if seizures could be predicted a reasonable period of time before their occurrence, epilepsy patients could take precautions against them and improve their safety and quality of life. However, the potential that permutation entropy(PE) can be applied in human epilepsy prediction from intracranial electroencephalogram (iEEG) recordings remains unclear. Here, we described the novel application of PE to track the dynamical changes of human brain activity from iEEG recordings for the epileptic seizure prediction. The iEEG signals of 19 patients were obtained from the Epilepsy Centre at the University Hospital of Freiburg. After preprocessing, PE was extracted in a sliding time window, and a support vector machine (SVM) was employed to discriminate cerebral state. Then a two-step post-processing method was applied for the purpose of prediction. The results showed that we obtained an average sensitivity (SS) of 94% and false prediction rates (FPR) with 0.111 h-1. The best results with SS of 100% and FPR of 0 h-1 were achieved for some patients. The average prediction horizon was 61.93 min, leaving sufficient treatment time before a seizure. These results indicated that applying PE as a feature to extract information and SVM for classification could predict seizures, and the presented method shows great potential in clinical seizure prediction for human.
| S-EPMC6060283 | biostudies-literature
Project description:A subset of patients with epilepsy successfully self-predicted seizures in a paper diary study. We conducted an e-diary study to ensure that prediction precedes seizures, and to characterize the prodromal features and time windows that underlie self-prediction.Subjects 18 or older with localization-related epilepsy (LRE) and ?3 seizures per month maintained an e-diary, reporting a.m./p.m. data daily, including mood, premonitory symptoms, and all seizures. Self-prediction was rated by, "How likely are you to experience a seizure (time frame)?" Five choices ranged from almost certain (>95% chance) to very unlikely. Relative odds of seizure (odds ratio, OR) within time frames was examined using Poisson models with log normal random effects to adjust for multiple observations.Nineteen subjects reported 244 eligible seizures. OR for prediction choices within 6 h was as high as 9.31 (CI 1.92-45.23) for "almost certain." Prediction was most robust within 6 h of diary entry, and remained significant up to 12 h. For nine best predictors, average sensitivity was 50%. Older age contributed to successful self-prediction, and self-prediction appeared to be driven by mood and premonitory symptoms. In multivariate modeling of seizure occurrence, self-prediction (2.84; CI 1.68-4.81), favorable change in mood (0.82; CI 0.67-0.99), and number of premonitory symptoms (1.11; CI 1.00-1.24) were significant.Some persons with epilepsy can self-predict seizures. In these individuals, the odds of a seizure following a positive prediction are high. Predictions were robust, not attributable to recall bias, and were related to self-awareness of mood and premonitory features. The 6-h prediction window is suitable for the development of preemptive therapy.
| S-EPMC3833277 | biostudies-literature
Project description: Not available
| S-EPMC8531996 | biostudies-literature
Project description:LC-MS/MS-based proteomics studies rely on stable analytical system performance that can be evaluated by objective criteria. The National Institute of Standards and Technology (NIST) introduced the MSQC software to compute diverse metrics from experimental LC-MS/MS data, enabling quality analysis and quality control (QA/QC) of proteomics instrumentation. In practice, however, several attributes of the MSQC software prevent its use for routine instrument monitoring. Here, we present QuaMeter, an open-source tool that improves MSQC in several aspects. QuaMeter can directly read raw data from instruments manufactured by different vendors. The software can work with a wide variety of peptide identification software for improved reliability and flexibility. Finally, QC metrics implemented in QuaMeter are rigorously defined and tested. The source code and binary versions of QuaMeter are available under Apache 2.0 License at http://fenchurch.mc.vanderbilt.edu.
| S-EPMC3730131 | biostudies-other
Project description:BackgroundEpilepsy surgery is a potentially curative treatment option for pharmacoresistent patients. If non-invasive methods alone do not allow to delineate the epileptogenic brain areas the surgical candidates undergo long-term monitoring with intracranial EEG. Visual EEG analysis is then used to identify the seizure onset zone for targeted resection as a standard procedure.MethodsDespite of its great potential to assess the epileptogenicty of brain tissue, quantitative EEG analysis has not yet found its way into routine clinical practice. To demonstrate that quantitative EEG may yield clinically highly relevant information we retrospectively investigated how post-operative seizure control is associated with four selected EEG measures evaluated in the resected brain tissue and the seizure onset zone. Importantly, the exact spatial location of the intracranial electrodes was determined by coregistration of pre-operative MRI and post-implantation CT and coregistration with post-resection MRI was used to delineate the extent of tissue resection. Using data-driven thresholding, quantitative EEG results were separated into normally contributing and salient channels.ResultsIn patients with favorable post-surgical seizure control a significantly larger fraction of salient channels in three of the four quantitative EEG measures was resected than in patients with unfavorable outcome in terms of seizure control (median over the whole peri-ictal recordings). The same statistics revealed no association with post-operative seizure control when EEG channels contributing to the seizure onset zone were studied.ConclusionsWe conclude that quantitative EEG measures provide clinically relevant and objective markers of target tissue, which may be used to optimize epilepsy surgery. The finding that differentiation between favorable and unfavorable outcome was better for the fraction of salient values in the resected brain tissue than in the seizure onset zone is consistent with growing evidence that spatially extended networks might be more relevant for seizure generation, evolution and termination than a single highly localized brain region (i.e. a "focus") where seizures start.
| S-EPMC4626164 | biostudies-literature
Project description:The purpose of the present study is to investigate whether the effectiveness of a new ad on digital channels (YouTube) can be predicted by using neural networks and neuroscience-based metrics (brain response, heart rate variability and eye tracking). Neurophysiological records from 35 participants were exposed to 8 relevant TV Super Bowl commercials. Correlations between neurophysiological-based metrics, ad recall, ad liking, the ACE metrix score and the number of views on YouTube during a year were investigated. Our findings suggest a significant correlation between neuroscience metrics and self-reported of ad effectiveness and the direct number of views on the YouTube channel. In addition, and using an artificial neural network based on neuroscience metrics, the model classifies (82.9% of average accuracy) and estimate the number of online views (mean error of 0.199). The results highlight the validity of neuromarketing-based techniques for predicting the success of advertising responses. Practitioners can consider the proposed methodology at the design stages of advertising content, thus enhancing advertising effectiveness. The study pioneers the use of neurophysiological methods in predicting advertising success in a digital context. This is the first article that has examined whether these measures could actually be used for predicting views for advertising on YouTube.
| S-EPMC5671759 | biostudies-literature
Project description:ObjectiveIn the present study, we have developed a novel patient-specific rule-based seizure prediction system for focal neocortical epilepsy.MethodsFive univariate measures including correlation dimension, correlation entropy, noise level, Lempel-Ziv complexity, and largest Lyapunov exponent as well as one bivariate measure, nonlinear interdependence, were extracted from non-overlapping 10-s segments of intracranial electroencephalogram (iEEG) data recorded using electrodes implanted deep in the brain and/or placed on the cortical surface. The spatio-temporal information was then integrated by using rules established based on patient-specific changes observed in the period prior to a seizure sample for each patient. The system was tested on 316 h of iEEG data containing 49 seizures recorded in 11 patients with medically intractable focal neocortical epilepsy.ResultsFor seizure occurrence periods of 30 and 50 min our method showed an average sensitivity of 79.9% and 90.2% with an average false prediction rate of 0.17 and 0.11/h, respectively. In terms of sensitivity and false prediction rate, the system showed superiority to random and periodical predictors.ConclusionsThe nonlinear analysis of iEEG in the period prior to seizures revealed patient-specific spatio-temporal changes that were significantly different from those observed within baselines in the majority of the seizures analyzed in this study.SignificanceThe present results suggest that the patient specific rule-based approach may become a potentially useful approach for predicting seizures prior to onset.
| S-EPMC3361618 | biostudies-literature