Multi-modality artificial intelligence in digital pathology.
Ontology highlight
ABSTRACT:
SUBMITTER: Qiao Y
PROVIDER: S-EPMC9677480 | biostudies-literature | 2022 Nov
REPOSITORIES: biostudies-literature
Publications
Multi-modality artificial intelligence in digital pathology.
Qiao Yixuan Y Zhao Lianhe L Luo Chunlong C Luo Yufan Y Wu Yang Y Li Shengtong S Bu Dechao D Zhao Yi Y
Briefings in bioinformatics 20221101 6
In common medical procedures, the time-consuming and expensive nature of obtaining test results plagues doctors and patients. Digital pathology research allows using computational technologies to manage data, presenting an opportunity to improve the efficiency of diagnosis and treatment. Artificial intelligence (AI) has a great advantage in the data analytics phase. Extensive research has shown that AI algorithms can produce more up-to-date and standardized conclusions for whole slide images. In ...[more]
Similar Datasets
Project description:The field of immuno-oncology has expanded rapidly over the past decade, but key questions remain. How does tumour-immune interaction regulate disease progression? How can we prospectively identify patients who will benefit from immunotherapy? Identifying measurable features of the tumour immune-microenvironment which have prognostic or predictive value will be key to making meaningful gains in these areas. Recent developments in deep learning enable big-data analysis of pathological samples. Digital approaches allow data to be acquired, integrated and analysed far beyond what is possible with conventional techniques, and to do so efficiently and at scale. This has the potential to reshape what can be achieved in terms of volume, precision and reliability of output, enabling data for large cohorts to be summarised and compared. This review examines applications of artificial intelligence (AI) to important questions in immuno-oncology (IO). We discuss general considerations that need to be taken into account before AI can be applied in any clinical setting. We describe AI methods that have been applied to the field of IO to date and present several examples of their use.
| S-EPMC9062980 | biostudies-literature
Project description:The emergence of whole slide imaging technology allows for pathology diagnosis on a computer screen. The applications of digital pathology are expanding, from supporting remote institutes suffering from a shortage of pathologists to routine use in daily diagnosis including that of lung cancer. Through practice and research large archival databases of digital pathology images have been developed that will facilitate the development of artificial intelligence (AI) methods for image analysis. Currently, several AI applications have been reported in the field of lung cancer; these include the segmentation of carcinoma foci, detection of lymph node metastasis, counting of tumor cells, and prediction of gene mutations. Although the integration of AI algorithms into clinical practice remains a significant challenge, we have implemented tumor cell count for genetic analysis, a helpful application for routine use. Our experience suggests that pathologists often overestimate the contents of tumor cells, and the use of AI-based analysis increases the accuracy and makes the tasks less tedious. However, there are several difficulties encountered in the practical use of AI in clinical diagnosis. These include the lack of sufficient annotated data for the development and validation of AI systems, the explainability of black box AI models, such as those based on deep learning that offer the most promising performance, and the difficulty in defining the ground truth data for training and validation owing to inherent ambiguity in most applications. All of these together present significant challenges in the development and clinical translation of AI methods in the practice of pathology. Additional research on these problems will help in resolving the barriers to the clinical use of AI. Helping pathologists in developing knowledge of the working and limitations of AI will benefit the use of AI in both diagnostics and research.
| S-EPMC7653145 | biostudies-literature
Project description:Bladder cancer (BC) diagnosis and prediction of prognosis are hindered by subjective pathological evaluation, which may cause misdiagnosis and under-/over-treatment. Computational pathology (CPATH) can identify clinical outcome predictors, offering an objective approach to improve prognosis. However, a systematic review of CPATH in BC literature is lacking. Therefore, we present a comprehensive overview of studies that used CPATH in BC, analyzing 33 out of 2285 identified studies. Most studies analyzed regions of interest to distinguish normal versus tumor tissue and identify tumor grade/stage and tissue types (e.g., urothelium, stroma, and muscle). The cell's nuclear area, shape irregularity, and roundness were the most promising markers to predict recurrence and survival based on selected regions of interest, with >80% accuracy. CPATH identified molecular subtypes by detecting features, e.g., papillary structures, hyperchromatic, and pleomorphic nuclei. Combining clinicopathological and image-derived features improved recurrence and survival prediction. However, due to the lack of outcome interpretability and independent test datasets, robustness and clinical applicability could not be ensured. The current literature demonstrates that CPATH holds the potential to improve BC diagnosis and prediction of prognosis. However, more robust, interpretable, accurate models and larger datasets-representative of clinical scenarios-are needed to address artificial intelligence's reliability, robustness, and black box challenge.
| S-EPMC10526515 | biostudies-literature
Project description:The Banff Digital Pathology Working Group (DPWG) was established with the goal to establish a digital pathology repository; develop, validate, and share models for image analysis; and foster collaborations using regular videoconferencing. During the calls, a variety of artificial intelligence (AI)-based support systems for transplantation pathology were presented. Potential collaborations in a competition/trial on AI applied to kidney transplant specimens, including the DIAGGRAFT challenge (staining of biopsies at multiple institutions, pathologists' visual assessment, and development and validation of new and pre-existing Banff scoring algorithms), were also discussed. To determine the next steps, a survey was conducted, primarily focusing on the feasibility of establishing a digital pathology repository and identifying potential hosts. Sixteen of the 35 respondents (46%) had access to a server hosting a digital pathology repository, with 2 respondents that could serve as a potential host at no cost to the DPWG. The 16 digital pathology repositories collected specimens from various organs, with the largest constituent being kidney (n = 12,870 specimens). A DPWG pilot digital pathology repository was established, and there are plans for a competition/trial with the DIAGGRAFT project. Utilizing existing resources and previously established models, the Banff DPWG is establishing new resources for the Banff community.
| S-EPMC10614670 | biostudies-literature
Project description:The worldwide prevalence of non-alcoholic steatohepatitis (NASH) is increasing, causing a significant medical burden, but no approved therapeutics are currently available. NASH drug development requires histological analysis of liver biopsies by expert pathologists for trial enrolment and efficacy assessment, which can be hindered by multiple issues including sample heterogeneity, inter-reader and intra-reader variability, and ordinal scoring systems. Consequently, there is a high unmet need for accurate, reproducible, quantitative, and automated methods to assist pathologists with histological analysis to improve the precision around treatment and efficacy assessment. Digital pathology (DP) workflows in combination with artificial intelligence (AI) have been established in other areas of medicine and are being actively investigated in NASH to assist pathologists in the evaluation and scoring of NASH histology. DP/AI models can be used to automatically detect, localise, quantify, and score histological parameters and have the potential to reduce the impact of scoring variability in NASH clinical trials. This narrative review provides an overview of DP/AI tools in development for NASH, highlights key regulatory considerations, and discusses how these advances may impact the future of NASH clinical management and drug development. This should be a high priority in the NASH field, particularly to improve the development of safe and effective therapeutics.
| S-EPMC11822446 | biostudies-literature
Project description:PurposeTransthyretin amyloid cardiomyopathy (ATTR-CM) is a frequent concomitant condition in patients with severe aortic stenosis (AS), yet it often remains undetected. This study aims to comprehensively evaluate artificial intelligence-based models developed based on preprocedural and routinely collected data to detect ATTR-CM in patients with severe AS planned for transcatheter aortic valve implantation (TAVI).MethodsIn this prospective, single-center study, consecutive patients with AS were screened with [99mTc]-3,3-diphosphono-1,2-propanodicarboxylic acid ([99mTc]-DPD) for the presence of ATTR-CM. Clinical, laboratory, electrocardiogram, echocardiography, invasive measurements, 4-dimensional cardiac CT (4D-CCT) strain data, and CT-radiomic features were used for machine learning modeling of ATTR-CM detection and for outcome prediction. Feature selection and classifier algorithms were applied in single- and multi-modality classification scenarios. We split the dataset into training (70%) and testing (30%) samples. Performance was assessed using various metrics across 100 random seeds.ResultsOut of 263 patients with severe AS (57% males, age 83 ± 4.6years) enrolled, ATTR-CM was confirmed in 27 (10.3%). The lowest performances for detection of concomitant ATTR-CM were observed in invasive measurements and ECG data with area under the curve (AUC) < 0.68. Individual clinical, laboratory, interventional imaging, and CT-radiomics-based features showed moderate performances (AUC 0.70-0.76, sensitivity 0.79-0.82, specificity 0.63-0.72), echocardiography demonstrated good performance (AUC 0.79, sensitivity 0.80, specificity 0.78), and 4D-CT-strain showed the highest performance (AUC 0.85, sensitivity 0.90, specificity 0.74). The multi-modality model (AUC 0.84, sensitivity 0.87, specificity 0.76) did not outperform the model performance based on 4D-CT-strain only data (p-value > 0.05). The multi-modality model adequately discriminated low and high-risk individuals for all-cause mortality at a mean follow-up of 13 months.ConclusionArtificial intelligence-based models using collected pre-TAVI evaluation data can effectively detect ATTR-CM in patients with severe AS, offering an alternative diagnostic strategy to scintigraphy and myocardial biopsy.
| S-EPMC11732884 | biostudies-literature
Project description:Odontogenic keratocyst (OKC) is a common jaw cyst with a high recurrence rate. OKC combined with basal cell carcinoma as well as skeletal and other developmental abnormalities is thought to be associated with Gorlin syndrome. Moreover, OKC needs to be differentiated from orthokeratinized odontogenic cyst and other jaw cysts. Because of the different prognosis, differential diagnosis of several cysts can contribute to clinical management. We collected 519 cases, comprising a total of 2 157 hematoxylin and eosin-stained images, to develop digital pathology-based artificial intelligence (AI) models for the diagnosis and prognosis of OKC. The Inception_v3 neural network was utilized to train and test models developed from patch-level images. Finally, whole slide image-level AI models were developed by integrating deep learning-generated pathology features with several machine learning algorithms. The AI models showed great performance in the diagnosis (AUC = 0.935, 95% CI: 0.898-0.973) and prognosis (AUC = 0.840, 95%CI: 0.751-0.930) of OKC. The advantages of multiple slides model for integrating of histopathological information are demonstrated through a comparison with the single slide model. Furthermore, the study investigates the correlation between AI features generated by deep learning and pathological findings, highlighting the interpretative potential of AI models in the pathology. Here, we have developed the robust diagnostic and prognostic models for OKC. The AI model that is based on digital pathology shows promise potential for applications in odontogenic diseases of the jaw.
| S-EPMC10894880 | biostudies-literature
Project description:Diffuse large B-cell lymphoma (DLBCL) is a heterogeneous and prevalent subtype of aggressive non-Hodgkin lymphoma that poses diagnostic and prognostic challenges, particularly in predicting drug responsiveness. In this study, we used digital pathology and deep learning to predict responses to immunochemotherapy in patients with DLBCL. We retrospectively collected 251 slide images from 216 DLBCL patients treated with rituximab, cyclophosphamide, doxorubicin, vincristine, and prednisone (R-CHOP), with their immunochemotherapy response labels. The digital pathology images were processed using contrastive learning for feature extraction. A multi-modal prediction model was developed by integrating clinical data and pathology image features. Knowledge distillation was employed to mitigate overfitting on gigapixel histopathology images to create a model that predicts responses based solely on pathology images. Based on the importance derived from the attention mechanism of the model, we extracted histological features that were considered key textures associated with drug responsiveness. The multi-modal prediction model achieved an impressive area under the ROC curve of 0.856, demonstrating significant associations with clinical variables such as Ann Arbor stage, International Prognostic Index, and bulky disease. Survival analyses indicated their effectiveness in predicting relapse-free survival. External validation using TCGA datasets supported the model's ability to predict survival differences. Additionally, pathology-based predictions show promise as independent prognostic indicators. Histopathological analysis identified centroblastic and immunoblastic features to be associated with treatment response, aligning with previous morphological classifications and highlighting the objectivity and reproducibility of artificial intelligence-based diagnosis. This study introduces a novel approach that combines digital pathology and clinical data to predict the response to immunochemotherapy in patients with DLBCL. This model shows great promise as a diagnostic and prognostic tool for clinical management of DLBCL. Further research and genomic data integration hold the potential to enhance its impact on clinical practice, ultimately improving patient outcomes.
| S-EPMC10999948 | biostudies-literature
Project description:Prostate cancer pathology plays a crucial role in clinical management but is time-consuming. Artificial intelligence (AI) shows promise in detecting prostate cancer and grading patterns. We tested an AI-based digital twin of a pathologist, vPatho, on 2603 histological images of prostate tissue stained with hematoxylin and eosin. We analyzed various factors influencing tumor grade discordance between the vPatho system and six human pathologists. Our results demonstrated that vPatho achieved comparable performance in prostate cancer detection and tumor volume estimation, as reported in the literature. The concordance levels between vPatho and human pathologists were examined. Notably, moderate to substantial agreement was observed in identifying complementary histological features such as ductal, cribriform, nerve, blood vessel, and lymphocyte infiltration. However, concordance in tumor grading decreased when applied to prostatectomy specimens (κ = 0.44) compared to biopsy cores (κ = 0.70). Adjusting the decision threshold for the secondary Gleason pattern from 5 to 10% improved the concordance level between pathologists and vPatho for tumor grading on prostatectomy specimens (κ from 0.44 to 0.64). Potential causes of grade discordance included the vertical extent of tumors toward the prostate boundary and the proportions of slides with prostate cancer. Gleason pattern 4 was particularly associated with this population. Notably, the grade according to vPatho was not specific to any of the six pathologists involved in routine clinical grading. In conclusion, our study highlights the potential utility of AI in developing a digital twin for a pathologist. This approach can help uncover limitations in AI adoption and the practical application of the current grading system for prostate cancer pathology.
| S-EPMC10912767 | biostudies-literature
Project description:BackgroundConventional microscopy of Kato-Katz (KK1.0) thick smears, the primary method for diagnosing soil-transmitted helminth (STH) infections, has limited sensitivity and is error-prone. Artificial intelligence-based digital pathology (AI-DP) may overcome the constraints of traditional microscopy-based diagnostics. This study in Ucayali, a remote Amazonian region of Peru, compares the performance of AI-DP-based Kato-Katz (KK2.0) method to KK1.0 at diagnosing STH infections in school-aged children (SAC).MethodsIn this prospective, non-interventional study, 510 stool samples from SAC (aged 5-14 years) were analyzed using KK1.0, KK2.0, and tube spontaneous sedimentation technique (TSET). KK1.0 and KK2.0 slides were evaluated at 30-minute and 24-hour timepoints for detection of Ascaris lumbricoides, Trichuris trichiura, and hookworms (at 30-minute only). Diagnostic performance was assessed by measuring STH eggs per gram of stool (EPG), sensitivity of methods, and agreement between the methods.ResultsKK2.0 detected more A. lumbricoides positive samples than KK1.0, with detection rates for T. trichiura and hookworms being comparable. At 30-minutes, 37.6%, 23.0%, and 2.6% of the samples tested positive based on KK1.0 for A. lumbricoides, T. trichiura, and hookworms, while this was 49.8%, 24.4%, and 1.9% for KK2.0. At 24-hours, 37.1% and 27.1% of the samples tested positive based on KK1.0 for A. lumbricoides and T. trichiura, while this was 45.8% and 24.1% for KK2.0. Mean EPG between KK2.0 and KK1.0 were not statistically different across STH species and timepoints, except for T. trichiura at 24-hours (higher mean EPG for KK1.0, p = 0.036). When considering infection intensity levels, KK2.0 identified 10% more of the total population as low-infection intensity samples of A. lumbricoides than KK1.0 (p ≤ 0.001, both timepoints) and similar to KK1.0 for T. trichiura and hookworms. Varying agreement existed between KK1.0 and KK2.0 in detecting STH eggs (A. lumbricoides: moderate; T. trichiura: substantial; hookworms: slight). However, these findings should be interpreted carefully as there are certain limitations that may have impacted the results of this study.ConclusionsThis study demonstrates the potential of the AI-DP-based method for STH diagnosis. While similar to KK1.0, the AI-DP-based method outperforms it in certain aspects. These findings underscore the potential of advancing the AI-DP KK2.0 prototype for dependable STH diagnosis and furthering the development of automated digital microscopes in accordance with WHO guidelines for STH diagnosis.
| S-EPMC11488745 | biostudies-literature