Dataset Information

The Performance of Artificial Intelligence in Cervical Colposcopy: A Retrospective Data Analysis.

ABSTRACT:

Objective

We aimed to evaluate the performance of artificial intelligence (AI) system in detecting high-grade precancerous lesions.

Methods

A retrospective and diagnostic study was conducted in Chongqing Cancer Hospital. Anonymized medical records with cytology, HPV testing, colposcopy findings with images, and the histopathological results were selected. The sensitivity, specificity, and areas under the curve (AUC) in detecting CIN2+ and CIN3+ were evaluated for the AI system, the AI-assisted colposcopy, and the human colposcopists, respectively.

Results

Anonymized medical records from 346 women were obtained. The images captured under colposcopy of 194 women were found positive by the AI system; 245 women were found positive either by human colposcopists or the AI system. In detecting CIN2+, the AI-assisted colposcopy significantly increased the sensitivity (96.6% vs. 88.8%, p=0.016). The specificity was significantly lower for AI-assisted colposcopy (38.1%), compared with human colposcopists (59.5%, p < 0.001) or the AI system (57.6%, p < 0.001). The AUCs for the human colposcopists, AI system, and AI-assisted colposcopy were 0.741, 0.765, and 0.674, respectively. In detecting CIN3+, the sensitivities of the AI system and AI-assisted colposcopy were not significantly higher than human colposcopists (97.5% vs. 92.6%, p=0.13). The specificity was significantly lower for AI-assisted colposcopy (37.4%) compared with human colposcopists (59.2%, p < 0.001) or compared with the AI system (56.6%, p < 0.001). The AUCs for the human colposcopists, AI system, and AI-assisted colposcopy were 0.759, 0.674, and 0.771, respectively.

Conclusions

The AI system provided equally matched sensitivity to human colposcopists in detecting CIN2+ and CIN3+. The AI-assisted colposcopy significantly improved the sensitivity in detecting CIN2+.

SUBMITTER: Zhao Y

PROVIDER: S-EPMC8754610 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BACKGROUND:The World Health Organization (WHO) called for global action towards the elimination of cervical cancer. One of the main strategies is to screen 70% of women at the age between 35 and 45?years and 90% of women managed appropriately by 2030. So far, approximately 85% of cervical cancers occur in low- and middle-income countries (LMICs). The colposcopy-guided biopsy is crucial for detecting cervical intraepithelial neoplasia (CIN) and becomes the main bottleneck limiting screening performance. Unprecedented advances in artificial intelligence (AI) enable the synergy of deep learning and digital colposcopy, which offers opportunities for automatic image-based diagnosis. To this end, we discuss the main challenges of traditional colposcopy and the solutions applying AI-guided digital colposcopy as an auxiliary diagnostic tool in low- and middle- income countries (LMICs). MAIN BODY:Existing challenges for the application of colposcopy in LMICs include strong dependence on the subjective experience of operators, substantial inter- and intra-operator variabilities, shortage of experienced colposcopists, consummate colposcopy training courses, and uniform diagnostic standard and strict quality control that are hard to be followed by colposcopists with limited diagnostic ability, resulting in discrepant reporting and documentation of colposcopy impressions. Organized colposcopy training courses should be viewed as an effective way to enhance the diagnostic ability of colposcopists, but implementing these courses in practice may not always be feasible to improve the overall diagnostic performance in a short period of time. Fortunately, AI has the potential to address colposcopic bottleneck, which could assist colposcopists in colposcopy imaging judgment, detection of underlying CINs, and guidance of biopsy sites. The automated workflow of colposcopy examination could create a novel cervical cancer screening model, reduce potentially false negatives and false positives, and improve the accuracy of colposcopy diagnosis and cervical biopsy. CONCLUSION:We believe that a practical and accurate AI-guided digital colposcopy has the potential to strengthen the diagnostic ability in guiding cervical biopsy, thereby improves cervical cancer screening performance in LMICs and accelerates the process of global cervical cancer elimination eventually.

Project description:The rising global incidence of cervical cancer is estimated to have affected more than 600,000 women, and nearly 350,000 women are predicted to have died from the disease in 2020 alone. Novel advances in cancer prevention, screening, diagnosis and treatment have all but reduced the burden of cervical cancer in developed nations. Unfortunately, cervical cancer is still the number one gynecological cancer globally. A limiting factor in managing cervical cancer globally is access to healthcare systems and trained medical personnel. Any methodology or procedure that may simplify or assist cervical cancer screening is desirable. Herein, we assess the use of artificial intelligence (AI)-assisted colposcopy in a tertiary hospital cervical diagnostic pathology unit. The study group consisted of 48 women (mean age 34) who were referred to the clinic for a routine colposcopy by their gynecologist. Cervical images were taken by an EVA-Visualcheck TM colposcope and run through an AI algorithm that gave real-time binary results of the cervical images as being either normal or abnormal. The primary endpoint of the study assessed the AI algorithm's ability to correctly identify histopathology results of CIN2+ as being abnormal. A secondary endpoint was a comparison between the AI algorithm and the clinical assessment results. Overall, we saw lower sensitivity of AI (66.7%; 12/18) compared with the clinical assessment (100%; 18/18), and histopathology results as the gold standard. The positive predictive value (PPV) was comparable between AI (42.9%; 12/28) and the clinical assessment (41.8%; 18/43). The specificity, however, was higher in the AI algorithm (46.7%; 14/30) compared to the clinical assessment (16.7%; 5/30). Comparing the congruence between the AI algorithm and histopathology results showed agreement 54.2% of the time and disagreement 45.8% of the time. A trained colposcopist was in agreement 47.9% and disagreement 52.1% of the time. Assessing these results, there is currently no added benefit of using the AI algorithm as a tool of speeding up diagnosis. However, given the steady improvements in the AI field, we believe that AI-assisted colposcopy may be of use in the future.

Project description:BackgroundColorectal cancer (CRC) is a type of tumor caused by the uncontrolled growth of cells in the mucosa lining the last part of the intestine. Emerging evidence underscores an association between CRC and gut microbiome dysbiosis. The high mortality rate of this cancer has made it necessary to develop new early diagnostic methods. Machine learning (ML) techniques can represent a solution to evaluate the interaction between intestinal microbiota and host physiology. Through explained artificial intelligence (XAI) it is possible to evaluate the individual contributions of microbial taxonomic markers for each subject. Our work also implements the Shapley Method Additive Explanations (SHAP) algorithm to identify for each subject which parameters are important in the context of CRC.ResultsThe proposed study aimed to implement an explainable artificial intelligence framework using both gut microbiota data and demographic information from subjects to classify a cohort of control subjects from those with CRC. Our analysis revealed an association between gut microbiota and this disease. We compared three machine learning algorithms, and the Random Forest (RF) algorithm emerged as the best classifier, with a precision of 0.729 ± 0.038 and an area under the Precision-Recall curve of 0.668 ± 0.016. Additionally, SHAP analysis highlighted the most crucial variables in the model's decision-making, facilitating the identification of specific bacteria linked to CRC. Our results confirmed the role of certain bacteria, such as Fusobacterium, Peptostreptococcus, and Parvimonas, whose abundance appears notably associated with the disease, as well as bacteria whose presence is linked to a non-diseased state.DiscussionThese findings emphasizes the potential of leveraging gut microbiota data within an explainable AI framework for CRC classification. The significant association observed aligns with existing knowledge. The precision exhibited by the RF algorithm reinforces its suitability for such classification tasks. The SHAP analysis not only enhanced interpretability but identified specific bacteria crucial in CRC determination. This approach opens avenues for targeted interventions based on microbial signatures. Further exploration is warranted to deepen our understanding of the intricate interplay between microbiota and health, providing insights for refined diagnostic and therapeutic strategies.

Project description:BACKGROUND:Cervical-vaginal fluid (CVF) plays an important role in the prevention of gynecological infections, although little is known about the contribution of CVF proteins to the immunity of the lower female genital tract. In order to analyze the protein composition of human CVF, we used CVF samples that are routinely collected during colposcopy, but are usually discarded. Since these samples are available in large quantities we aimed to analyze their usefulness for proteomics experiments. The samples were analyzed using different prefractionation techniques (ultrafiltration and C4(RP)-LC protein separation) followed by C18(RP)-LC peptide separation and identification by MALDI-TOF-TOF mass spectrometry. To determine the reproducibility of this proteomics platform we analyzed three technical replicates. Using spectral counting, protein abundances were estimated in a semiquantitative way. We also compared the results obtained in this study with those from previous studies derived from patients with different physiological conditions in order to determine an overlapping protein set. RESULTS:In total, we were able to identify 339 proteins in human CVF of which 151 proteins were not identified in any other proteomics study on human CVF so far. Those included antimicrobial peptides, such as human beta-defensin 2 and cathelicidin, which were known to be present in CVF, and endometrial proteins such as glycodelin and ribonucleoprotein A. Comparison of our results with previously published data led to the identification of a common protein set of 136 proteins. This overlapping protein set shows increased fractions of immunological and extracellular proteins, confirming the extracellular immunological role of CVF. CONCLUSION:We demonstrated here that CVF colposcopy samples can be used in proteomics experiments and hence are applicable for biomarker discovery experiments. The delineation of an overlapping set of proteins that is identified in most proteomics studies on CVF may help in the description of a reference proteome when performing proteomics studies on human CVF.

Project description:PurposeThe current study aimed to construct a novel cancer artificial intelligence survival analysis system for predicting the individual mortality risk curves for cervical carcinoma patients receiving different treatments.MethodsStudy dataset (n = 14,946) was downloaded from Surveillance Epidemiology and End Results database. Accelerated failure time algorithm, multi-task logistic regression algorithm, and Cox proportional hazard regression algorithm were used to develop prognostic models for cancer specific survival of cervical carcinoma patients.ResultsMultivariate Cox regression identified stage, PM, chemotherapy, Age, PT, and radiation_surgery as independent influence factors for cervical carcinoma patients. The concordance indexes of Cox model were 0.860, 0.849, and 0.848 for 12-month, 36-month, and 60-month in model dataset, whereas it were 0.881, 0.845, and 0.841 in validation dataset. The concordance indexes of accelerated failure time model were 0.861, 0.852, and 0.851 for 12-month, 36-month, and 60-month in model dataset, whereas it were 0.882, 0.847, and 0.846 in validation dataset. The concordance indexes of multi-task logistic regression model were 0.860, 0.863, and 0.861 for 12-month, 36-month, and 60-month in model dataset, whereas it were 0.880, 0.860, and 0.861 in validation dataset. Brier score indicated that these three prognostic models have good diagnostic accuracy for cervical carcinoma patients. The current research lacked independent external validation study.ConclusionThe current study developed a novel cancer artificial intelligence survival analysis system to provide individual mortality risk predictive curves for cervical carcinoma patients based on three different artificial intelligence algorithms. Cancer artificial intelligence survival analysis system could provide mortality percentage at specific time points and explore the actual treatment benefits under different treatments in four stages, which could help patient determine the best individualized treatment. Cancer artificial intelligence survival analysis system was available at: https://zhangzhiqiao15.shinyapps.io/Tumor_Artificial_Intelligence_Survival_Analysis_System/ .

Project description:BACKGROUND: The ejection fraction (EF) provides critical information about heart failure (HF) and its management. Electrocardiography (ECG) is a noninvasive screening tool for cardiac electrophysiological activities that has been used to detect patients with low EF based on a deep learning model (DLM) trained via large amounts of data. However, no studies have widely investigated its clinical impacts. OBJECTIVE: This study developed a DLM to estimate EF via ECG (ECG-EF). We further investigated the relationship between ECG-EF and echo-based EF (ECHO-EF) and explored their contributions to future cardiovascular adverse events. METHODS: There were 57,206 ECGs with corresponding echocardiograms used to train our DLM. We compared a series of training strategies and selected the best DLM. The architecture of the DLM was based on ECG12Net, developed previously. Next, 10,762 ECGs were used for validation, and another 20,629 ECGs were employed to conduct the accuracy test. The changes between ECG-EF and ECHO-EF were evaluated. The primary follow-up adverse events included future ECHO-EF changes and major adverse cardiovascular events (MACEs). RESULTS: The sex-/age-matching strategy-trained DLM achieved the best area under the curve (AUC) of 0.9472 with a sensitivity of 86.9% and specificity of 89.6% in the follow-up cohort, with a correlation of 0.603 and a mean absolute error of 7.436. In patients with accurate prediction (initial difference < 10%), the change traces of ECG-EF and ECHO-EF were more consistent (R-square = 0.351) than in all patients (R-square = 0.115). Patients with lower ECG-EF (≤35%) exhibited a greater risk of cardiovascular (CV) complications, delayed ECHO-EF recovery, and earlier ECHO-EF deterioration than patients with normal ECG-EF (>50%). Importantly, ECG-EF demonstrated an independent impact on MACEs and all CV adverse outcomes, with better prediction of CV outcomes than ECHO-EF. CONCLUSIONS: The ECG-EF could be used to initially screen asymptomatic left ventricular dysfunction (LVD) and it could also independently contribute to the predictions of future CV adverse events. Although further large-scale studies are warranted, DLM-based ECG-EF could serve as a promising diagnostic supportive and management-guided tool for CV disease prediction and the care of patients with LVD.