Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer.
Ontology highlight
ABSTRACT:
SUBMITTER: Kather JN
PROVIDER: S-EPMC7423299 | biostudies-literature | 2019 Jul
REPOSITORIES: biostudies-literature
Publications
Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer.
Kather Jakob Nikolas JN Pearson Alexander T AT Halama Niels N Jäger Dirk D Krause Jeremias J Loosen Sven H SH Marx Alexander A Boor Peter P Tacke Frank F Neumann Ulf Peter UP Grabsch Heike I HI Yoshikawa Takaki T Brenner Hermann H Chang-Claude Jenny J Hoffmeister Michael M Trautwein Christian C Luedde Tom T
Nature medicine 20190603 7
Microsatellite instability determines whether patients with gastrointestinal cancer respond exceptionally well to immunotherapy. However, in clinical practice, not every patient is tested for MSI, because this requires additional genetic or immunohistochemical tests. Here we show that deep residual learning can predict MSI directly from H&E histology, which is ubiquitously available. This approach has the potential to provide immunotherapy to a much broader subset of patients with gastrointestin ...[more]
Similar Datasets
Project description:The detection of Epstein-Barr virus (EBV) in gastric cancer patients is crucial for clinical decision making, as it is related with specific treatment responses and prognoses. Despite its importance, the limited medical resources preclude universal EBV testing. Herein, we propose a deep learning-based EBV prediction method from H&E-stained whole-slide images (WSI). Our model was developed using 319 H&E stained WSI (26 EBV positive; TCGA dataset) from the Cancer Genome Atlas, and 108 WSI (8 EBV positive; ISH dataset) from an independent institution. Our deep learning model, EBVNet consists of two sequential components: a tumor classifier and an EBV classifier. We visualized the learned representation by the classifiers using UMAP. We externally validated the model using 60 additional WSI (7 being EBV positive; HGH dataset). We compared the model's performance with those of four pathologists. EBVNet achieved an AUPRC of 0.65, whereas the four pathologists yielded a mean AUPRC of 0.41. Moreover, EBVNet achieved an negative predictive value, sensitivity, specificity, precision, and F1-score of 0.98, 0.86, 0.92, 0.60, and 0.71, respectively. Our proposed model is expected to contribute to prescreen patients for confirmatory testing, potentially to save test-related cost and labor.
| S-EPMC9630260 | biostudies-literature
Project description:ObjectivesThis study aims to develop and validate a virtual biopsy model to predict microsatellite instability (MSI) status in preoperative gastric cancer (GC) patients based on clinical information and the radiomics of deep learning algorithms.MethodsA total of 223 GC patients with MSI status detected by postoperative immunohistochemical staining (IHC) were retrospectively recruited and randomly assigned to the training (n = 167) and testing (n = 56) sets in a 3:1 ratio. In the training set, 982 high-throughput radiomic features were extracted from preoperative abdominal dynamic contrast-enhanced CT (CECT) and screened. According to the deep learning multilayer perceptron (MLP), 15 optimal features were optimized to establish the radiomic feature score (Rad-score), and LASSO regression was used to screen out clinically independent predictors. Based on logistic regression, the Rad-score and clinically independent predictors were integrated to build the clinical radiomics model and visualized as a nomogram and independently verified in the testing set. The performance and clinical applicability of hybrid model in identifying MSI status were evaluated by the area under the receiver operating characteristic (AUC) curve, calibration curve, and decision curve (DCA).ResultsThe AUCs of the clinical image model in training set and testing set were 0.883 [95% CI: 0.822-0.945] and 0.802 [95% CI: 0.666-0.937], respectively. This hybrid model showed good consistency in the calibration curve and clinical applicability in the DCA curve, respectively.ConclusionsUsing preoperative imaging and clinical information, we developed a deep-learning-based radiomics model for the non-invasive evaluation of MSI in GC patients. This model maybe can potentially support clinical treatment decision making for GC patients.
| S-EPMC10247640 | biostudies-literature
Project description:Background & aimsMicrosatellite instability (MSI) and mismatch-repair deficiency (dMMR) in colorectal tumors are used to select treatment for patients. Deep learning can detect MSI and dMMR in tumor samples on routine histology slides faster and less expensively than molecular assays. However, clinical application of this technology requires high performance and multisite validation, which have not yet been performed.MethodsWe collected H&E-stained slides and findings from molecular analyses for MSI and dMMR from 8836 colorectal tumors (of all stages) included in the MSIDETECT consortium study, from Germany, the Netherlands, the United Kingdom, and the United States. Specimens with dMMR were identified by immunohistochemistry analyses of tissue microarrays for loss of MLH1, MSH2, MSH6, and/or PMS2. Specimens with MSI were identified by genetic analyses. We trained a deep-learning detector to identify samples with MSI from these slides; performance was assessed by cross-validation (N = 6406 specimens) and validated in an external cohort (n = 771 specimens). Prespecified endpoints were area under the receiver operating characteristic (AUROC) curve and area under the precision-recall curve (AUPRC).ResultsThe deep-learning detector identified specimens with dMMR or MSI with a mean AUROC curve of 0.92 (lower bound, 0.91; upper bound, 0.93) and an AUPRC of 0.63 (range, 0.59-0.65), or 67% specificity and 95% sensitivity, in the cross-validation development cohort. In the validation cohort, the classifier identified samples with dMMR with an AUROC of 0.95 (range, 0.92-0.96) without image preprocessing and an AUROC of 0.96 (range, 0.93-0.98) after color normalization.ConclusionsWe developed a deep-learning system that detects colorectal cancer specimens with dMMR or MSI using H&E-stained slides; it detected tissues with dMMR with an AUROC of 0.96 in a large, international validation cohort. This system might be used for high-throughput, low-cost evaluation of colorectal tissue specimens.
| S-EPMC7578071 | biostudies-literature
Project description:Recent progress in cancer genome analysis using next-generation sequencing has revealed a high mutation burden in some tumors. The particularly high rate of somatic mutation in these tumors correlates with the generation of neo-antigens capable of eliciting an immune response. Identification of hypermutated tumors is therefore clinically valuable for selecting patients suitable for immunotherapy treatment. There are several known causes of hypermutation in tumors, such as ultraviolet light in melanoma, tobacco smoke in lung cancer, and excessive APOBEC (apolipoprotein B mRNA editing enzyme, catalytic polypeptide-like) activity in breast and gastric cancer. In gastrointestinal cancers, one of the leading causes of hypermutation is a defect in DNA mismatch repair, which results in microsatellite instability (MSI). This review will focus on the frequency, characteristics and genomic signature of hypermutated gastrointestinal cancers with MSI. Detection of tumor hypermutation in cancer is expected to not only predict the clinical benefit of immune checkpoint inhibitor treatment, but also to provide better surgical strategies for the patients with hypermutated tumors. Thus, in an era of precision medicine, identification of hypermutation and MSI will play an important role directing surgical and chemotherapeutic treatment.
| S-EPMC5762383 | biostudies-literature
Project description:BackgroundMicrosatellite instability (MSI) predetermines responses to adjuvant 5-fluorouracil and immunotherapy in rectal cancer and serves as a prognostic biomarker for clinical outcomes. Our objective was to develop and validate a deep learning model that could preoperatively predict the MSI status of rectal cancer based on magnetic resonance images.MethodsThis single-center retrospective study included 491 rectal cancer patients with pathologically proven microsatellite status. Patients were randomly divided into the training/validation cohort (n = 395) and the testing cohort (n = 96). A clinical model using logistic regression was constructed to discriminate MSI status using only clinical factors. Based on a modified MobileNetV2 architecture, deep learning models were tested for the predictive ability of MSI status from magnetic resonance images, with or without integrating clinical factors.ResultsThe clinical model correctly classified 37.5% of MSI status in the testing cohort, with an AUC value of 0.573 (95% confidence interval [CI], 0.468 ~ 0.674). The pure imaging-based model and the combined model correctly classified 75.0% and 85.4% of MSI status in the testing cohort, with AUC values of 0.820 (95% CI, 0.718 ~ 0.884) and 0.868 (95% CI, 0.784 ~ 0.929), respectively. Both deep learning models performed better than the clinical model (p < 0.05). There was no statistically significant difference between the deep learning models with or without integrating clinical factors.ConclusionsDeep learning based on high-resolution T2-weighted magnetic resonance images showed a good predictive performance for MSI status in rectal cancer patients. The proposed model may help to identify patients who would benefit from chemotherapy or immunotherapy and determine individualized therapeutic strategies for these patients.
| S-EPMC8209621 | biostudies-literature
Project description:Microsatellite instability (MSI), an important biomarker for immunotherapy and the diagnosis of Lynch syndrome, refers to the change of microsatellite (MS) sequence length caused by insertion or deletion during DNA replication. However, traditional wet-lab experiment-based MSI detection is time-consuming and relies on experimental conditions. In addition, a comprehensive study on the associations between MSI status and various molecules like mRNA and miRNA has not been performed. In this study, we first studied the association between MSI status and several molecules including mRNA, miRNA, lncRNA, DNA methylation, and copy number variation (CNV) using colorectal cancer data from The Cancer Genome Atlas (TCGA). Then, we developed a novel deep learning framework to predict MSI status based solely on hematoxylin and eosin (H&E) staining images, and combined the H&E image with the above-mentioned molecules by multimodal compact bilinear pooling. Our results showed that there were significant differences in mRNA, miRNA, and lncRNA between the high microsatellite instability (MSI-H) patient group and the low microsatellite instability or microsatellite stability (MSI-L/MSS) patient group. By using the H&E image alone, one can predict MSI status with an acceptable prediction area under the curve (AUC) of 0.809 in 5-fold cross-validation. The fusion models integrating H&E image with a single type of molecule have higher prediction accuracies than that using H&E image alone, with the highest AUC of 0.952 achieved when combining H&E image with DNA methylation data. However, prediction accuracy will decrease when combining H&E image with all types of molecular data. In conclusion, combining H&E image with deep learning can predict the MSI status of colorectal cancer, the accuracy of which can further be improved by integrating appropriate molecular data. This study may have clinical significance in practice.
| S-EPMC9295995 | biostudies-literature
Project description:Deep learning-based approaches in histopathology can be largely divided into two categories: a high-level approach using an end-to-end model and a low-level approach using feature extractors. Although the advantages and disadvantages of both approaches are empirically well known, there exists no scientific basis for choosing a specific approach in research, and direct comparative analysis of the two approaches has rarely been performed. Using the Cancer Genomic Atlas (TCGA)-based dataset, we compared these two different approaches in microsatellite instability (MSI) prediction and analyzed morphological image features associated with MSI. Our high-level approach was based solely on EfficientNet, while our low-level approach relied on LightGBM and multiple deep learning models trained on publicly available multiclass tissue, nuclei, and gland datasets. We compared their performance and important image features. Our high-level approach showed superior performance compared to our low-level approach. In both approaches, debris, lymphocytes, and necrotic cells were revealed as important features of MSI, which is consistent with clinical knowledge. Then, during qualitative analysis, we discovered the weaknesses of our low-level approach and demonstrated that its performance can be improved by using different image features in a complementary way. We performed our study using open-access data, and we believe this study can serve as a useful basis for discovering imaging biomarkers for clinical application.
| S-EPMC9293930 | biostudies-literature
Project description:Background and Objectives: This study aimed to objectively determine microsatellite instability (MSI) status using a next-generation sequencing (NGS)-based MSI panel and to resolve the discrepancy regarding whether or not MSI is a rare phenomenon, irrespective of diverse genomic alterations in gastrointestinal stromal tumors (GISTs). Materials and Methods: Genomic DNA was subjected to MSI panel sequencing using an Ion AmpliSeq Microsatellite Instability Assay, as well as to cancer gene panel sequencing using an Oncomine Focus DNA Assay. Results: All of our GIST patients showed microsatellite-stable (MSS) status, which confirmed that MSI status did not affect the molecular pathogenesis of GIST. The KIT gene (79%, 38/48) was the most frequently mutated gene, followed by the PDGFRA (8%, 4/48), PIK3CA (8%, 4/48), and ERBB2 (4%, 2/48) mutations. KIT exon 11 mutant patients were more favorable in responding to imatinib than those with exon 9 mutant or wild-type GISTs, and compared to non-KIT exon 11 mutant GISTs (p = 0.041). The NGS-based MSI panel with MSICall confirmed a rare phenomenon of microsatellite instability in GISTs irrespective of diverse genomic alterations. Conclusion: Massively parallel sequencing can simultaneously provide the MSI status as well as the somatic mutation profile in a single test. This combined approach may help us to understand the molecular pathogenesis of GIST carcinogenesis and malignant progression.
| S-EPMC7931009 | biostudies-literature
Project description:Tumor histology is an important predictor of therapeutic response and outcomes in lung cancer. Tissue sampling for pathologist review is the most reliable method for histology classification, however, recent advances in deep learning for medical image analysis allude to the utility of radiologic data in further describing disease characteristics and for risk stratification. In this study, we propose a radiomics approach to predicting non-small cell lung cancer (NSCLC) tumor histology from non-invasive standard-of-care computed tomography (CT) data. We trained and validated convolutional neural networks (CNNs) on a dataset comprising 311 early-stage NSCLC patients receiving surgical treatment at Massachusetts General Hospital (MGH), with a focus on the two most common histological types: adenocarcinoma (ADC) and Squamous Cell Carcinoma (SCC). The CNNs were able to predict tumor histology with an AUC of 0.71(p = 0.018). We also found that using machine learning classifiers such as k-nearest neighbors (kNN) and support vector machine (SVM) on CNN-derived quantitative radiomics features yielded comparable discriminative performance, with AUC of up to 0.71 (p = 0.017). Our best performing CNN functioned as a robust probabilistic classifier in heterogeneous test sets, with qualitatively interpretable visual explanations to its predictions. Deep learning based radiomics can identify histological phenotypes in lung cancer. It has the potential to augment existing approaches and serve as a corrective aid for diagnosticians.
| S-EPMC7943565 | biostudies-literature
Project description:Artificial intelligence methods including deep neural networks (DNN) can provide rapid molecular classification of tumors from routine histology with accuracy that matches or exceeds human pathologists. Discerning how neural networks make their predictions remains a significant challenge, but explainability tools help provide insights into what models have learned when corresponding histologic features are poorly defined. Here, we present a method for improving explainability of DNN models using synthetic histology generated by a conditional generative adversarial network (cGAN). We show that cGANs generate high-quality synthetic histology images that can be leveraged for explaining DNN models trained to classify molecularly-subtyped tumors, exposing histologic features associated with molecular state. Fine-tuning synthetic histology through class and layer blending illustrates nuanced morphologic differences between tumor subtypes. Finally, we demonstrate the use of synthetic histology for augmenting pathologist-in-training education, showing that these intuitive visualizations can reinforce and improve understanding of histologic manifestations of tumor biology.
| S-EPMC10227067 | biostudies-literature