Dataset Information

Artificial intelligence neuropathologist for glioma classification using deep learning on hematoxylin and eosin stained slide images and molecular markers.

ABSTRACT:

Background

Pathological diagnosis of glioma subtypes is essential for treatment planning and prognosis. Standard histological diagnosis of glioma is based on postoperative hematoxylin and eosin stained slides by neuropathologists. With advancing artificial intelligence (AI), the aim of this study was to determine whether deep learning can be applied to glioma classification.

Methods

A neuropathological diagnostic platform is designed comprising a slide scanner and deep convolutional neural networks (CNNs) to classify 5 major histological subtypes of glioma to assist pathologists. The CNNs were trained and verified on over 79 990 histological patch images from 267 patients. A logical algorithm is used when molecular profiles are available.

Results

A new model of the squeeze-and-excitation block DenseNet with weighted cross-entropy (named SD-Net_WCE) is developed for the glioma classification task, which learns the recognizable features of glioma histology CNN-based independent diagnostic testing on data from 56 patients with 17 262 histological patch images demonstrated patch level accuracy of 86.5% and patient level accuracy of 87.5%. Histopathological classifications could be further amplified to integrated neuropathological diagnosis by 2 molecular markers (isocitrate dehydrogenase and 1p/19q).

Conclusion

The model is capable of solving multiple classification tasks and can satisfactorily classify glioma subtypes. The system provides a novel aid for the integrated neuropathological diagnostic workflow of glioma.

SUBMITTER: Jin L

PROVIDER: S-EPMC7850049 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Large-droplet macrovesicular steatosis (ld-MaS) in more than 30% of liver graft hepatocytes is a major risk factor for liver transplantation. An accurate assessment of the ld-MaS percentage is crucial for determining liver graft transplantability, which is currently based on pathologists' evaluations of hematoxylin and eosin (H&E)-stained liver histology specimens, with the predominant criteria being the relative size of the lipid droplets (LDs) and their propensity to displace a hepatocyte's nucleus to the cell periphery. Automated image analysis systems aimed at objectively and reproducibly quantifying ld-MaS do not accurately differentiate large LDs from small-droplet macrovesicular steatosis and do not take into account LD-mediated nuclear displacement; this leads to a poor correlation with pathologists' assessments. Here we present an improved image analysis method that incorporates nuclear displacement as a key image feature for segmenting and classifying ld-MaS from H&E-stained liver histology slides. 52,000 LDs in 54 digital images from 9 patients were analyzed, and the performance of the proposed method was compared against the performance of current image analysis methods and the ld-MaS percentage evaluations of 2 trained pathologists from different centers. We show that combining nuclear displacement and LD size information significantly improves the separation between large and small macrovesicular LDs (specificity?=?93.7%, sensitivity?=?99.3%) and the correlation with pathologists' ld-MaS percentage assessments (linear regression coefficient of determination?=?0.97). This performance vastly exceeds that of other automated image analyzers, which typically underestimate or overestimate pathologists' ld-MaS scores. This work demonstrates the potential of automated ld-MaS analysis in monitoring the steatotic state of livers. The image analysis principles demonstrated here may help to standardize ld-MaS scores among centers and ultimately help in the process of determining liver graft transplantability.

Project description:Importance:Strategies to procure high-quality core-needle biopsy (CNB) specimens are critical for making basic tissue diagnoses and for ancillary testing. Objectives:To investigate acquisition of fluorescence confocal microscopy (FCM) images of interventional radiology (IR)-guided CNB in real time in the radiology suite and to compare the accuracy of FCM diagnoses with those of hematoxylin-eosin (H&E)-stained CNB sections. Design, Setting, and Participants:In this diagnostic study, FCM imaging of IR-guided CNBs was performed in the radiology suite at a major cancer center for patients with an imaging abnormality from August 1, 2016, to April 30, 2019. The time taken to acquire FCM images and the quality of FCM images based on percentage of interpretable tissue with optimal resolution was recorded. The FCM images were read by 2 pathologists and categorized as nondiagnostic, benign/atypical, or suspicious/malignant; these diagnoses were compared with those made using H&E-stained tissue sections. Cases with discrepant diagnosis were reassessed by the pathologists together for a consensus diagnosis. Data were analyzed from June 3 to July 19, 2019. Interventions:Each IR-guided CNB was stained with 0.6mM acridine orange, subjected to FCM imaging, and then processed to generate H&E-stained sections. Main Outcomes and Measures:Mean time taken for acquisition of FCM images, quality of FCM images based on interpretable percentage of the image, and accuracy of diagnostic categorization based on FCM images compared with H&E-stained sections. Results:A total of 105 patients (57 male [54.3%]; mean [SD] age, 63 [13] years) underwent IR-guided CNBs in a mean (SD) of 7 (2) minutes each. The FCM images showed at least 20% of the tissue with optimal quality in 101 CNB specimens (96.2%). The FCM images were accurately interpreted by the 2 pathologists in 100 of 105 cases (95.2%) (2 false-positive and 3 false-negative) and 90 of 105 cases (85.7%) (6 false-positive and 9 false-negative). A reassessment of 14 discordant diagnoses resulted in consensus diagnoses that were accurate in 101 of 105 cases (96.2%) (1 false-positive and 3 false-negative). Conclusions and Relevance:The ease of acquisition of FCM images of acceptable quality and the high accuracy of the diagnoses suggest that FCM may be useful for rapid evaluation of IR-guided CNBs. This approach warrants further investigation.

Project description:We introduce a machine learning-based analysis to predict the immunohistochemical (IHC) labeling index for the cell proliferation marker Ki67/MIB1 on cancer tissues based on morphometrical features extracted from hematoxylin and eosin (H&E)-stained formalin-fixed, paraffin-embedded (FFPE) tumor tissue samples. We provided a proof-of-concept prediction of the Ki67/MIB1 IHC positivity of cancer cells through the definition and quantitation of single nuclear features. In the first instance, we set our digital framework on Ki67/MIB1-stained OSCC (oral squamous cell carcinoma) tissue sample whole slide images, using QuPath as a working platform and its integrated algorithms, and we built a classifier in order to distinguish tumor and stroma classes and, within them, Ki67-positive and Ki67-negative cells; then, we sorted the morphometric features of tumor cells related to their Ki67 IHC status. Among the evaluated features, nuclear hematoxylin mean optical density (NHMOD) presented as the best one to distinguish Ki67/MIB1 positive from negative cells. We confirmed our findings in a single-cell level analysis of H&E staining on Ki67-immunostained/H&E-decolored tissue samples. Finally, we tested our digital framework on a case series of oral squamous cell carcinomas (OSCC), arranged in tissue microarrays; we selected two consecutive sections of each OSCC FFPE TMA (tissue microarray) block, respectively stained with H&E and immuno-stained for Ki67/MIB1. We automatically detected tumor cells in H&E slides and generated a "false color map" (FCM) based on NHMOD through the QuPath measurements map tool. FCM nearly coincided with the actual immunohistochemical result, allowing the prediction of Ki67/MIB1 positive cells in a direct visual fashion. Our proposed approach provides the pathologist with a fast method of identifying the proliferating compartment of the tumor through a quantitative assessment of the nuclear features on H&E slides, readily appreciable by visual inspection. Although this technique needs to be fine-tuned and tested on larger series of tumors, the digital analysis approach appears to be a promising tool to quickly forecast the tumor's proliferation fraction directly on routinely H&E-stained digital sections.