Dataset Information

Multicenter Validation of a Deep Learning Detection Algorithm for Focal Cortical Dysplasia.

ABSTRACT:

Background and objective

To test the hypothesis that a multicenter-validated computer deep learning algorithm detects MRI-negative focal cortical dysplasia (FCD).

Methods

We used clinically acquired 3-dimensional (3D) T1-weighted and 3D fluid-attenuated inversion recovery MRI of 148 patients (median age 23 years [range 2-55 years]; 47% female) with histologically verified FCD at 9 centers to train a deep convolutional neural network (CNN) classifier. Images were initially deemed MRI-negative in 51% of patients, in whom intracranial EEG determined the focus. For risk stratification, the CNN incorporated bayesian uncertainty estimation as a measure of confidence. To evaluate performance, detection maps were compared to expert FCD manual labels. Sensitivity was tested in an independent cohort of 23 cases with FCD (13 ± 10 years). Applying the algorithm to 42 healthy controls and 89 controls with temporal lobe epilepsy disease tested specificity.

Results

Overall sensitivity was 93% (137 of 148 FCD detected) using a leave-one-site-out cross-validation, with an average of 6 false positives per patient. Sensitivity in MRI-negative FCD was 85%. In 73% of patients, the FCD was among the clusters with the highest confidence; in half, it ranked the highest. Sensitivity in the independent cohort was 83% (19 of 23; average of 5 false positives per patient). Specificity was 89% in healthy and disease controls.

Discussion

This first multicenter-validated deep learning detection algorithm yields the highest sensitivity to date in MRI-negative FCD. By pairing predictions with risk stratification, this classifier may assist clinicians in adjusting hypotheses relative to other tests, increasing diagnostic confidence. Moreover, generalizability across age and MRI hardware makes this approach ideal for presurgical evaluation of MRI-negative epilepsy.

Classification of evidence

This study provides Class III evidence that deep learning on multimodal MRI accurately identifies FCD in patients with epilepsy initially diagnosed as MRI negative.

SUBMITTER: Gill RS

PROVIDER: S-EPMC8548962 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ImportanceThe improvement of pulmonary nodule detection, which is a challenging task when using chest radiographs, may help to elevate the role of chest radiographs for the diagnosis of lung cancer.ObjectiveTo assess the performance of a deep learning-based nodule detection algorithm for the detection of lung cancer on chest radiographs from participants in the National Lung Screening Trial (NLST).Design, setting, and participantsThis diagnostic study used data from participants in the NLST ro assess the performance of a deep learning-based artificial intelligence (AI) algorithm for the detection of pulmonary nodules and lung cancer on chest radiographs using separate training (in-house) and validation (NLST) data sets. Baseline (T0) posteroanterior chest radiographs from 5485 participants (full T0 data set) were used to assess lung cancer detection performance, and a subset of 577 of these images (nodule data set) were used to assess nodule detection performance. Participants aged 55 to 74 years who currently or formerly (ie, quit within the past 15 years) smoked cigarettes for 30 pack-years or more were enrolled in the NLST at 23 US centers between August 2002 and April 2004. Information on lung cancer diagnoses was collected through December 31, 2009. Analyses were performed between August 20, 2019, and February 14, 2020.ExposuresAbnormality scores produced by the AI algorithm.Main outcomes and measuresThe performance of an AI algorithm for the detection of lung nodules and lung cancer on radiographs, with lung cancer incidence and mortality as primary end points.ResultsA total of 5485 participants (mean [SD] age, 61.7 [5.0] years; 3030 men [55.2%]) were included, with a median follow-up duration of 6.5 years (interquartile range, 6.1-6.9 years). For the nodule data set, the sensitivity and specificity of the AI algorithm for the detection of pulmonary nodules were 86.2% (95% CI, 77.8%-94.6%) and 85.0% (95% CI, 81.9%-88.1%), respectively. For the detection of all cancers, the sensitivity was 75.0% (95% CI, 62.8%-87.2%), the specificity was 83.3% (95% CI, 82.3%-84.3%), the positive predictive value was 3.8% (95% CI, 2.6%-5.0%), and the negative predictive value was 99.8% (95% CI, 99.6%-99.9%). For the detection of malignant pulmonary nodules in all images of the full T0 data set, the sensitivity was 94.1% (95% CI, 86.2%-100.0%), the specificity was 83.3% (95% CI, 82.3%-84.3%), the positive predictive value was 3.4% (95% CI, 2.2%-4.5%), and the negative predictive value was 100.0% (95% CI, 99.9%-100.0%). In digital radiographs of the nodule data set, the AI algorithm had higher sensitivity (96.0% [95% CI, 88.3%-100.0%] vs 88.0% [95% CI, 75.3%-100.0%]; P = .32) and higher specificity (93.2% [95% CI, 89.9%-96.5%] vs 82.8% [95% CI, 77.8%-87.8%]; P = .001) for nodule detection compared with the NLST radiologists. For malignant pulmonary nodule detection on digital radiographs of the full T0 data set, the sensitivity of the AI algorithm was higher (100.0% [95% CI, 100.0%-100.0%] vs 94.1% [95% CI, 82.9%-100.0%]; P = .32) compared with the NLST radiologists, and the specificity (90.9% [95% CI, 89.6%-92.1%] vs 91.0% [95% CI, 89.7%-92.2%]; P = .91), positive predictive value (8.2% [95% CI, 4.4%-11.9%] vs 7.8% [95% CI, 4.1%-11.5%]; P = .65), and negative predictive value (100.0% [95% CI, 100.0%-100.0%] vs 99.9% [95% CI, 99.8%-100.0%]; P = .32) were similar to those of NLST radiologists.Conclusions and relevanceIn this study, the AI algorithm performed better than NLST radiologists for the detection of pulmonary nodules on digital radiographs. When used as a second reader, the AI algorithm may help to detect lung cancer.

Project description:We aimed to differentiate between the interictal and preictal states in epilepsy patients with focal cortical dysplasia (FCD) type-II using deep learning-based classifiers based on intracranial electroencephalography (EEG). We also investigated the practical conditions for high interictal-preictal discriminability in terms of spatiotemporal EEG characteristics and data size efficiency. Intracranial EEG recordings of nine epilepsy patients with FCD type-II (four female, five male; mean age: 10.7 years) were analyzed. Seizure onset and channel ranking were annotated by two epileptologists. We performed three consecutive interictal-preictal classification steps by varying the preictal length, number of electrodes, and sampling frequency with convolutional neural networks (CNN) using 30 s time-frequency data matrices. Classification performances were evaluated based on accuracy, F1 score, precision, and recall with respect to the above-mentioned three parameters. We found that (1) a 5 min preictal length provided the best classification performance, showing a remarkable enhancement of >13% on average compared to that with the 120 min preictal length; (2) four electrodes provided considerably high classification performance with a decrease of only approximately 1% on average compared to that with all channels; and (3) there was minimal performance change when quadrupling the sampling frequency from 128 Hz. Patient-specific performance variations were noticeable with respect to the preictal length, and three patients showed above-average performance enhancements of >28%. However, performance enhancements were low with respect to both the number of electrodes and sampling frequencies, and some patients showed at most 1-2% performance change. CNN-based classifiers from intracranial EEG recordings using a small number of electrodes and efficient sampling frequency are feasible for predicting the interictal-preictal state transition preceding seizures in epilepsy patients with FCD type-II. Preictal lengths affect the predictability in a patient-specific manner; therefore, pre-examinations for optimal preictal length will be helpful in seizure prediction.

Project description:Focal cortical dysplasias are a common subtype of malformation of cortical development, which frequently presents with a spectrum of cognitive and behavioural abnormalities as well as pharmacoresistant epilepsy. Focal cortical dysplasia type II is typically caused by somatic mutations resulting in mammalian target of rapamycin (mTOR) hyperactivity, and is the commonest pathology found in children undergoing epilepsy surgery. However, surgical resection does not always result in seizure freedom, and is often precluded by proximity to eloquent brain regions. Gene therapy is a promising potential alternative treatment and may be appropriate in cases that represent an unacceptable surgical risk. Here, we evaluated a gene therapy based on overexpression of the Kv1.1 potassium channel in a mouse model of frontal lobe focal cortical dysplasia. An engineered potassium channel (EKC) transgene was placed under control of a human promoter that biases expression towards principal neurons (CAMK2A) and packaged in an adeno-associated viral vector (AAV9). We used an established focal cortical dysplasia model generated by in utero electroporation of frontal lobe neural progenitors with a constitutively active human Ras homolog enriched in brain (RHEB) plasmid, an activator of mTOR complex 1. We characterized the model by quantifying electrocorticographic and behavioural abnormalities, both in mice developing spontaneous generalized seizures and in mice only exhibiting interictal discharges. Injection of AAV9-CAMK2A-EKC in the dysplastic region resulted in a robust decrease (∼64%) in the frequency of seizures. Despite the robust anti-epileptic effect of the treatment, there was neither an improvement nor a worsening of performance in behavioural tests sensitive to frontal lobe function. AAV9-CAMK2A-EKC had no effect on interictal discharges or behaviour in mice without generalized seizures. AAV9-CAMK2A-EKC gene therapy is a promising therapy with translational potential to treat the epileptic phenotype of mTOR-related malformations of cortical development. Cognitive and behavioural co-morbidities may, however, resist an intervention aimed at reducing circuit excitability.