Dataset Information

Explainable artificial intelligence to predict the risk of side-specific extraprostatic extension in pre-prostatectomy patients.

ABSTRACT:

Introduction

We aimed to develop an explainable machine learning (ML) model to predict side-specific extraprostatic extension (ssEPE) to identify patients who can safely undergo nerve-sparing radical prostatectomy using preoperative clinicopathological variables.

Methods

A retrospective sample of clinicopathological data from 900 prostatic lobes at our institution was used as the training cohort. Primary outcome was the presence of ssEPE. The baseline model for comparison had the highest performance out of current biopsy-derived predictive models for ssEPE. A separate logistic regression (LR) model was built using the same variables as the ML model. All models were externally validated using a testing cohort of 122 lobes from another institution. Models were assessed by area under receiver-operating-characteristic curve (AUROC), precision-recall curve (AUPRC), calibration, and decision curve analysis. Model predictions were explained using SHapley Additive exPlanations. This tool was deployed as a publicly available web application.

Results

Incidence of ssEPE in the training and testing cohorts were 30.7 and 41.8%, respectively. The ML model achieved AUROC 0.81 (LR 0.78, baseline 0.74) and AUPRC 0.69 (LR 0.64, baseline 0.59) on the training cohort. On the testing cohort, the ML model achieved AUROC 0.81 (LR 0.76, baseline 0.75) and AUPRC 0.78 (LR 0.75, baseline 0.70). The ML model was explainable, well-calibrated, and achieved the highest net benefit for clinically relevant cutoffs of 10-30%.

Conclusions

We developed a user-friendly application that enables physicians without prior ML experience to assess ssEPE risk and understand factors driving these predictions to aid surgical planning and patient counselling (https://share.streamlit.io/jcckwong/ssepe/main/ssEPE_V2.py).

SUBMITTER: Kwong JCC

PROVIDER: S-EPMC9245956 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:PurposeTo validate the MRI grading system proposed by Mehralivand et al in 2019 (the "extraprostatic extension [EPE] grade") in an independent cohort and to compare the Mehralivand EPE grading system with EPE interpretation on the basis of a five-point Likert score ("EPE Likert").Materials and methodsA total of 310 consecutive patients underwent multiparametric MRI according to a standardized institutional protocol before radical prostatectomy was performed by using the same 1.5-T MRI unit at a single institution between 2010 and 2012. Two radiologists blinded to clinical information assessed EPE according to standardized criteria. On the basis of the readings performed until 2017, the diagnostic performance of EPE Likert and Mehralivand EPE score were compared using receiver operating characteristics (ROC) and decision curve methodology against histologic EPE as standard of reference. Prediction of biochemical recurrence-free survival (BRFS) was assessed by Kaplan-Meier analysis and log rank test.ResultsOf the 310 patients, 80 patients (26%) had EPE, including 33 with radial distance 1.1 mm or greater. Interrater reliability was fair (weighted κ 0.47 and 0.45) for both EPE grade and EPE Likert. Sensitivity for identifying EPE using EPE grade versus EPE Likert was 0.83 versus 0.86 and 0.86 versus 0.91 for radiologist 1 and 2, respectively. Specificity was 0.48 versus 0.58 and 0.39 versus 0.70 (P < .05 for radiologist 2). There were no significant differences in the ROC area under the curve or on decision curve analysis. Both EPE grade and EPE Likert were significant predictors of BRFS.ConclusionMehralivand EPE grade and EPE Likert have equivalent diagnostic performance for predicting EPE and BRFS with a similar degree of observer dependence.© RSNA, 2020Keywords: MR-Imaging, Neoplasms-Primary, Observer Performance, Outcomes Analysis, Prostate, StagingSupplemental material is available for this article.See also the commentary by Choyke in this issue.

Project description:Electromyography (EMG) proves invaluable myoelectric manifestation in identifying neuromuscular alterations resulting from ischemic strokes, serving as a potential marker for diagnostics of gait impairments caused by ischemia. This study aims to develop an interpretable machine learning (ML) framework capable of distinguishing between the myoelectric patterns of stroke patients and those of healthy individuals through Explainable Artificial Intelligence (XAI) techniques. The research included 48 stroke patients (average age 70.6 years, 65% male) undergoing treatment at a rehabilitation center, alongside 75 healthy adults (average age 76.3 years, 32% male) as the control group. EMG signals were recorded from wearable devices positioned on the bicep femoris and lateral gastrocnemius muscles of both lower limbs during indoor ground walking in a gait laboratory. Boosting ML techniques were deployed to identify stroke-related gait impairments using EMG gait features. Furthermore, we employed XAI techniques, such as Shapley Additive Explanations (SHAP), Local Interpretable Model-Agnostic Explanations (LIME), and Anchors to interpret the role of EMG variables in the stroke-prediction models. Among the ML models assessed, the GBoost model demonstrated the highest classification performance (AUROC: 0.94) during cross-validation with the training dataset, and it also overperformed (AUROC: 0.92, accuracy: 85.26%) when evaluated using the testing EMG dataset. Through SHAP and LIME analyses, the study identified that EMG spectral features contributing to distinguishing the stroke group from the control group were associated with the right bicep femoris and lateral gastrocnemius muscles. This interpretable EMG-based stroke prediction model holds promise as an objective tool for predicting post-stroke gait impairments. Its potential application could greatly assist in managing post-stroke rehabilitation by providing reliable EMG biomarkers and address potential gait impairment in individuals recovering from ischemic stroke.