Dataset Information

Development and Validation of Machine Learning Models to Predict Readmission After Colorectal Surgery.

ABSTRACT:

Background

Readmission after colorectal surgery is common and often implies complications for patients and costs for hospitals. Previous works have created predictive models using logistic regression for this outcome but have shown limited accuracy. Machine learning has shown promise in improving predictions by identifying non-linear patterns in data. We sought to create a more accurate predictive model for readmission after colorectal surgery using machine learning.

Methods

Patients who underwent colorectal surgery were identified in the National Quality Improvement Program (NSQIP) database including years 2012-2019 and split into training, validation, and test sets. The primary outcome was readmission within 30 days of surgery. Three types of machine learning models were created, including random forest (RF), gradient boosting (XGB), and neural network (NN). A logistic regression (LR) model was also created for comparison. Model performance was evaluated using area under the receiver operating characteristic curve (AUROC).

Results

The dataset included 213,827 patients after application of exclusion criteria. A total of 23,083 (10.8%) of patients experienced readmission. NN obtained an AUROC of 0.751 (95% CI 0.743-0.759), compared with 0.684 (95% CI 0.676-0.693) for LR. RF and XGB performed similarly with AUROCs of 0.749 (95% CI 0.741-0.757) and 0.745 (95% CI 0.737-0.753) respectively. Ileus, index admission length of stay, organ-space surgical site infection present at time of surgery, and ostomy placement were identified as the most contributory variables.

Conclusions

Machine learning approaches outperformed traditional statistical methods in the prediction of readmission after colorectal surgery. After external validation, this improved prediction model could be used to target interventions to reduce readmission rate.

SUBMITTER: Chen KA

PROVIDER: S-EPMC10081888 | biostudies-literature | 2022 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Validation of Machine Learning Models to Predict Readmission After Colorectal Surgery.

Chen Kevin A KA Joisa Chinmaya U CU Stitzenberg Karyn B KB Stem Jonathan J Guillem Jose G JG Gomez Shawn M SM Kapadia Muneera R MR

Journal of gastrointestinal surgery : official journal of the Society for Surgery of the Alimentary Tract 20220907 11

<h4>Background</h4>Readmission after colorectal surgery is common and often implies complications for patients and costs for hospitals. Previous works have created predictive models using logistic regression for this outcome but have shown limited accuracy. Machine learning has shown promise in improving predictions by identifying non-linear patterns in data. We sought to create a more accurate predictive model for readmission after colorectal surgery using machine learning.<h4>Methods</h4>Patie ...[more]

PMID: 36070116

Similar Datasets

Project description:BackgroundEchocardiography (echo) based machine learning (ML) models may be useful in identifying patients at high-risk of all-cause mortality.MethodsWe developed ML models (ResNet deep learning using echo videos and CatBoost gradient boosting using echo measurements) to predict 1-year, 3-year, and 5-year mortality. Models were trained on the Mackay dataset, Taiwan (6083 echos, 3626 patients) and validated in the Alberta HEART dataset, Canada (997 echos, 595 patients). We examined the performance of the models overall, and in subgroups (healthy controls, at risk of heart failure (HF), HF with reduced ejection fraction (HFrEF) and HF with preserved ejection fraction (HFpEF)). We compared the models' performance to the MAGGIC risk score, and examined the correlation between the models' predicted probability of death and baseline quality of life as measured by the Kansas City Cardiomyopathy Questionnaire (KCCQ).FindingsMortality rates at 1-, 3- and 5-years were 14.9%, 28.6%, and 42.5% in the Mackay cohort, and 3.0%, 10.3%, and 18.7%, in the Alberta HEART cohort. The ResNet and CatBoost models achieved area under the receiver-operating curve (AUROC) between 85% and 92% in internal validation. In external validation, the AUROCs for the ResNet (82%, 82%, and 78%) were significantly better than CatBoost (78%, 73%, and 75%), for 1-, 3- and 5-year mortality prediction respectively, with better or comparable performance to the MAGGIC score. ResNet models predicted higher probability of death in the HFpEF and HFrEF (30%-50%) subgroups than in controls and at risk patients (5%-20%). The predicted probabilities of death correlated with KCCQ scores (all p < 0.05).InterpretationEcho-based ML models to predict mortality had good internal and external validity, were generalizable, correlated with patients' quality of life, and are comparable to an established HF risk score. These models can be leveraged for automated risk stratification at point-of-care.FundingFunding for Alberta HEART was provided by an Alberta Innovates - Health Solutions Interdisciplinary Team Grant no. AHFMRITG 200801018. P.K. holds a Canadian Institutes of Health Research (CIHR) Sex and Gender Science Chair and a Heart & Stroke Foundation Chair in Cardiovascular Research. A.V. and V.S. received funding from the Mitacs Globalink Research Internship.

Project description:ImportanceEarly recognition of adverse events after cardiac surgery is vital for treatment. However, the widely used Society of Thoracic Surgery (STS) risk model has modest performance in predicting adverse events and only applies <80% of cardiac surgeries.ObjectiveTo develop and validate machine learning (ML) models for predicting outcomes after cardiac surgery.Design setting and participantsML models, referred as Roux-MMC model, were developed and validated using a retrospective cohort extracted from the STS Adult Cardiac Surgery Database (ACSD) at Maine Medical Center (MMC) between January 2012 to December 2021. It was further validated on a prospective cohort of MMC between January 2022 to February 2024. The performance of Roux-MMC model is compared with the STS model.Exposure cardiac surgery.Main outcomes and measuresPostoperative outcomes: mortality, stroke, renal failure, reoperation, prolonged ventilation, major morbidity or mortality, prolonged length of stay (PLOS) and short length of stay (SLOS). Primary measure: area under the receiver-operating curve (AUROC).ResultsA retrospective cohort of 9,841 patients (median [IQR] age, 67 [59-74] years; 7,127 [72%] males) and a prospective cohort of 2,305 patients (median [IQR] age, 67 [59-73] years; 1,707 [74%] males) were included. In the prospective cohort, the Roux-MMC model achieves performance for prolonged ventilation (AUROC 0.911 [95% CI, 0.887-0.935]), PLOS (AUROC 0.875 [95% CI, 0.848-0.898]), renal failure (AUROC 0.878 [95% CI, 0.829-0.921]), mortality (AUROC 0.882 [95% CI, 0.837-0.920]), reoperation (AUROC 0.824 [95% CI, 0.787-0.860]), SLOS (AUROC 0.818 [95% CI, 0.801-0.835]) and major morbidity or mortality (AUROC 0.859 [95% CI, 0.832-0.884]). The Roux-MMC model outperforms the STS model for all 8 outcomes, achieving 0.020-0.167 greater AUROC. The Roux-MMC model covers all cardiac surgery patients, while the STS model applies to only 65% in the retrospective and 77% in the prospective cohorts.Conclusion and relevanceWe developed ML models to predict 8 postoperative outcomes on all cardiac surgery patients using preoperative and intraoperative variables. The Roux-MMC model outperforms the STS model in the prospective cohort. The Roux-MMC model is built on STS ACSD, a data system used in ~1000 US hospitals, thus, it has the potential to easily applied in other hospitals.

Project description:ObjectiveTo compare the performance of three machine learning algorithms with the tumor, node, and metastasis (TNM) staging system in survival prediction and validate the individual adjuvant treatment recommendations plan based on the optimal model.MethodsIn this study, we trained three machine learning madel and validated 3 machine learning survival models-deep learning neural network, random forest and cox proportional hazard model- using the data of patients with stage-al3 NSCLC patients who received resection surgery from the National Cancer Institute Surveillance, Epidemiology, and End Results (SEER) database from 2012 to 2017,the performance of survival predication from all machine learning models were assessed using a concordance index (c-index) and the averaged c-index is utilized for cross-validation. The optimal model was externally validated in an independent cohort from Shaanxi Provincial People's Hospital. Then we compare the performance of the optimal model and TNM staging system. Finally, we developed a Cloud-based recommendation system for adjuvant therapy to visualize survival curve of each treatment plan and deployed on the internet.ResultsA total of 4617 patients were included in this study. The deep learning network performed more stably and accurately in predicting stage-iii NSCLC resected patients survival than the random survival forest and Cox proportional hazard model on the internal test dataset (C-index=0.834 vs. 0.678 vs. 0.640) and better than TNM staging system (C-index=0.820 vs. 0.650) in the external validation. The individual patient who follow the reference from recommendation system had superior survival compared to those who did not. The predicted 5-year-survival curve for each adjuvant treatment plan could be accessed in the recommender system via the browser.ConclusionDeep learning model has several advantages over linear model and random forest model in prognostic predication and treatment recommendations. This novel analytical approach may provide accurate predication on individual survival and treatment recommendations for resected Stage-iii NSCLC patients.

Project description:BackgroundPostoperative gastrointestinal leak and venous thromboembolism (VTE) are devastating complications of bariatric surgery. The performance of currently available predictive models for these complications remains wanting, while machine learning has shown promise to improve on traditional modeling approaches. The purpose of this study was to compare the ability of two machine learning strategies, artificial neural networks (ANNs), and gradient boosting machines (XGBs) to conventional models using logistic regression (LR) in predicting leak and VTE after bariatric surgery.MethodsANN, XGB, and LR prediction models for leak and VTE among adults undergoing initial elective weight loss surgery were trained and validated using preoperative data from 2015 to 2017 from Metabolic and Bariatric Surgery Accreditation and Quality Improvement Program database. Data were randomly split into training, validation, and testing populations. Model performance was measured by the area under the receiver operating characteristic curve (AUC) on the testing data for each model.ResultsThe study cohort contained 436,807 patients. The incidences of leak and VTE were 0.70% and 0.46%. ANN (AUC 0.75, 95% CI 0.73-0.78) was the best-performing model for predicting leak, followed by XGB (AUC 0.70, 95% CI 0.68-0.72) and then LR (AUC 0.63, 95% CI 0.61-0.65, p < 0.001 for all comparisons). In detecting VTE, ANN, and XGB, LR achieved similar AUCs of 0.65 (95% CI 0.63-0.68), 0.67 (95% CI 0.64-0.70), and 0.64 (95% CI 0.61-0.66), respectively; the performance difference between XGB and LR was statistically significant (p = 0.001).ConclusionsANN and XGB outperformed traditional LR in predicting leak. These results suggest that ML has the potential to improve risk stratification for bariatric surgery, especially as techniques to extract more granular data from medical records improve. Further studies investigating the merits of machine learning to improve patient selection and risk management in bariatric surgery are warranted.

Project description:BackgroundIntensive care unit (ICU) readmission is a crucial indicator of patient safety. However, discharge decisions often rely on subjective assessment due to a lack of standardized guidelines. We aimed to develop a machine-learning model to predict ICU readmission within 48 h and compare its performance to traditional scoring systems.MethodsWe developed an ensemble model, iREAD, that generates a probability score at ICU discharge, representing the likelihood of the patient being readmitted to the ICU within 48 h, using data from Seoul National University Hospital (SNUH) and validated it using the MIMIC-III and eICU-CRD datasets. From September 2007 to August 2021, a total of 70,842 patients were included from SNUH. The MIMIC-III datasets comprised 43,237 patients admitted to ICUs between 2001 and 2012 at Beth Israel Deaconess Medical Center, and the eICU-CRD datasets included 90,271 ICU admissions across 208 hospitals between 2014 and 2015. Patients younger than 18, those who died in ICUs, or who refused life-sustaining treatment were excluded from the final analysis. The model's performance was evaluated using the area under the receiver operating characteristic curve (AUROC) and compared to the traditional scores and conventional machine learning models. Kaplan-Meier analysis was performed to compare the outcome between the high-risk and low-risk groups.FindingsWe developed the iREAD, that utilized 30 input features, encompassing demographics, length of stay, vital signs, GCS, and laboratory values. iREAD demonstrated superior performance compared with other models across all cohorts (all P < 0.001). In the internal validation, iREAD achieved AUROCs of 0.771 (95% CI 0.743-0.798), 0.834 (0.821-0.846), and 0.820 (0.808-0.832) for early (≤48 h), late (>48 h), and overall ICU readmissions, respectively. External validations with MIMIC-III and eICU-CRD also showed modest performance with AUROCs of 0.768 (0.748-0.787) and 0.725 (0.712-0.739) for overall readmission in MIMIC-III and eICU-CRD respectively, demonstrating superior performance compared to other models (All P < 0.001; higher than other models). Kaplan-Meier analysis revealed that over 40% of high-risk patients predicted by iREAD were readmitted within 48 h, representing a more than four-fold increase in predictive performance compared to the traditional scores.InterpretationiREAD demonstrates superior performance in predicting ICU readmission within 48 h after discharge compared to traditional scoring systems or conventional machine learning models in both internal and external validations. While the performance degradation observed in the external validations suggests the need for further prospective validation on diverse patient populations, the robust performance and ability to identify high-risk patients have the potential to guide clinical decision-making.FundingThis work was supported by the Korea Health Technology Research & Development Project through the Korea Health Industry Development Institute, funded by the Ministry of Health and Welfare, Republic of Korea (grant number RS-2021-KH114109).

Project description:ObjectiveInfertility remains a significant global burden over the years. Reproductive surgery is an effective strategy for infertile women. Early prediction of spontaneous pregnancy after reproductive surgery is of high interest for the patients seeking the infertility treatment. However, there are no high-quality models and clinical applicable tools to predict the probability of natural conception after reproductive surgery.MethodsThe eligible data involving 1013 patients who operated for infertility between June 2016 and June 2021 in Yantai Yuhuangding Hospital in China, were randomly divided into training and internal testing cohorts. 195 subjects from the Linyi People's Hospital in China were considered for external validation. Both univariate combining with multivariate logistic regression and the least absolute shrinkage and selection operator (LASSO) algorithm were performed to identify independent predictors. Multiple common machine learning algorithms, namely logistic regression, decision tree, random forest, support vector machine, k-nearest neighbor, and extreme gradient boosting, were employed to construct the predictive models. The optimal model was verified by evaluating the model performance in both the internal and external validation datasets.ResultsSix clinical indicators, including female age, infertility type, duration of infertility, intraoperative diagnosis, ovulation monitoring, and anti-Müllerian hormone (AMH) level, were screened out. Based on the logistic regression model's superior clinical predictive value, as indicated by the area under the receiver operating characteristic curve (AUC) in both the internal (0.870) and external (0.880) validation sets, we ultimately selected it as the optimal model. Consequently, we utilized it to generate a web-based nomogram for predicting the probability of spontaneous pregnancy after reproductive surgery. Furthermore, the calibration curve, Hosmer-Lemeshow (H-L) test, the decision curve analysis (DCA) and clinical impact curve analysis (CIC) demonstrated that the model has superior calibration degree, clinical net benefit and generalization ability, which were confirmed by both internal and external validations.ConclusionOverall, our developed first nomogram with online operation provides an early and accurate prediction for the probability of natural conception after reproductive surgery, which helps clinicians and infertile couples make sensible decision of choosing the mode of subsequent conception, natural or IVF, to further improve the clinical practices of infertility treatment.

Dataset Information

Development and Validation of Machine Learning Models to Predict Readmission After Colorectal Surgery.

Background

Methods

Results

Conclusions

Publications

Development and Validation of Machine Learning Models to Predict Readmission After Colorectal Surgery.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets