Development and performance assessment of novel machine learning models to predict pneumonia after liver transplantation.
Ontology highlight
ABSTRACT: Background
Pneumonia is the most frequently encountered postoperative pulmonary complications (PPC) after orthotopic liver transplantation (OLT), which cause high morbidity and mortality rates. We aimed to develop a model to predict postoperative pneumonia in OLT patients using machine learning (ML) methods.Methods
Data of 786 adult patients underwent OLT at the Third Affiliated Hospital of Sun Yat-sen University from January 2015 to September 2019 was retrospectively extracted from electronic medical records and randomly subdivided into a training set and a testing set. With the training set, six ML models including logistic regression (LR), support vector machine (SVM), random forest (RF), adaptive boosting (AdaBoost), extreme gradient boosting (XGBoost) and gradient boosting machine (GBM) were developed. These models were assessed by the area under curve (AUC) of receiver operating characteristic on the testing set. The related risk factors and outcomes of pneumonia were also probed based on the chosen model.Results
591 OLT patients were eventually included and 253 (42.81%) were diagnosed with postoperative pneumonia, which was associated with increased postoperative hospitalization and mortality (P < 0.05). Among the six ML models, XGBoost model performed best. The AUC of XGBoost model on the testing set was 0.734 (sensitivity: 52.6%; specificity: 77.5%). Pneumonia was notably associated with 14 items features: INR, HCT, PLT, ALB, ALT, FIB, WBC, PT, serum Na+, TBIL, anesthesia time, preoperative length of stay, total fluid transfusion and operation time.Conclusion
Our study firstly demonstrated that the XGBoost model with 14 common variables might predict postoperative pneumonia in OLT patients.
SUBMITTER: Chen C
PROVIDER: S-EPMC8011203 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundPostoperative sepsis is one of the main causes of mortality after liver transplantation (LT). Our study aimed to develop and validate a predictive model for postoperative sepsis within 7 d in LT recipients using machine learning (ML) technology.MethodsData of 786 patients received LT from January 2015 to January 2020 was retrospectively extracted from the big data platform of Third Affiliated Hospital of Sun Yat-sen University. Seven ML models were developed to predict postoperative sepsis. The area under the receiver-operating curve (AUC), sensitivity, specificity, accuracy, and f1-score were evaluated as the model performances. The model with the best performance was validated in an independent dataset involving 118 adult LT cases from February 2020 to April 2021. The postoperative sepsis-associated outcomes were also explored in the study.ResultsAfter excluding 109 patients according to the exclusion criteria, 677 patients underwent LT were finally included in the analysis. Among them, 216 (31.9%) were diagnosed with sepsis after LT, which were related to more perioperative complications, increased postoperative hospital stay and mortality after LT (all p < .05). Our results revealed that a larger volume of red blood cell infusion, ascitic removal, blood loss and gastric drainage, less volume of crystalloid infusion and urine, longer anesthesia time, higher level of preoperative TBIL were the top 8 important variables contributing to the prediction of post-LT sepsis. The Random Forest Classifier (RF) model showed the best overall performance to predict sepsis after LT among the seven ML models developed in the study, with an AUC of 0.731, an accuracy of 71.6%, the sensitivity of 62.1%, and specificity of 76.1% in the internal validation set, and a comparable AUC of 0.755 in the external validation set.ConclusionsOur study enrolled eight pre- and intra-operative variables to develop an RF-based predictive model of post-LT sepsis to assist clinical decision-making procedure.
| S-EPMC9937004 | biostudies-literature
Project description:BackgroundAlthough multiple prediction models have been developed to predict hospital admission to emergency departments (EDs) to address overcrowding and patient safety, only a few studies have examined prediction models for prehospital use. Development of institution-specific prediction models is feasible in this age of data science, provided that predictor-related information is readily collectable.ObjectiveWe aimed to develop a hospital admission prediction model based on patient information that is commonly available during ambulance transport before hospitalization.MethodsPatients transported by ambulance to our ED from April 2018 through March 2019 were enrolled. Candidate predictors were age, sex, chief complaint, vital signs, and patient medical history, all of which were recorded by emergency medical teams during ambulance transport. Patients were divided into two cohorts for derivation (3601/5145, 70.0%) and validation (1544/5145, 30.0%). For statistical models, logistic regression, logistic lasso, random forest, and gradient boosting machine were used. Prediction models were developed in the derivation cohort. Model performance was assessed by area under the receiver operating characteristic curve (AUROC) and association measures in the validation cohort.ResultsOf 5145 patients transported by ambulance, including deaths in the ED and hospital transfers, 2699 (52.5%) required hospital admission. Prediction performance was higher with the addition of predictive factors, attaining the best performance with an AUROC of 0.818 (95% CI 0.792-0.839) with a machine learning model and predictive factors of age, sex, chief complaint, and vital signs. Sensitivity and specificity of this model were 0.744 (95% CI 0.716-0.773) and 0.745 (95% CI 0.709-0.776), respectively.ConclusionsFor patients transferred to EDs, we developed a well-performing hospital admission prediction model based on routinely collected prehospital information including chief complaints.
| S-EPMC7655472 | biostudies-literature
Project description:BackgroundPredicting survival of recipients after liver transplantation is regarded as one of the most important challenges in contemporary medicine. Hence, improving on current prediction models is of great interest.Nowadays, there is a strong discussion in the medical field about machine learning (ML) and whether it has greater potential than traditional regression models when dealing with complex data. Criticism to ML is related to unsuitable performance measures and lack of interpretability which is important for clinicians.MethodsIn this paper, ML techniques such as random forests and neural networks are applied to large data of 62294 patients from the United States with 97 predictors selected on clinical/statistical grounds, over more than 600, to predict survival from transplantation. Of particular interest is also the identification of potential risk factors. A comparison is performed between 3 different Cox models (with all variables, backward selection and LASSO) and 3 machine learning techniques: a random survival forest and 2 partial logistic artificial neural networks (PLANNs). For PLANNs, novel extensions to their original specification are tested. Emphasis is given on the advantages and pitfalls of each method and on the interpretability of the ML techniques.ResultsWell-established predictive measures are employed from the survival field (C-index, Brier score and Integrated Brier Score) and the strongest prognostic factors are identified for each model. Clinical endpoint is overall graft-survival defined as the time between transplantation and the date of graft-failure or death. The random survival forest shows slightly better predictive performance than Cox models based on the C-index. Neural networks show better performance than both Cox models and random survival forest based on the Integrated Brier Score at 10 years.ConclusionIn this work, it is shown that machine learning techniques can be a useful tool for both prediction and interpretation in the survival context. From the ML techniques examined here, PLANN with 1 hidden layer predicts survival probabilities the most accurately, being as calibrated as the Cox model with all variables.Trial registrationRetrospective data were provided by the Scientific Registry of Transplant Recipients under Data Use Agreement number 9477 for analysis of risk factors after liver transplantation.
| S-EPMC7667810 | biostudies-literature
Project description:BackgroundEchocardiography (echo) based machine learning (ML) models may be useful in identifying patients at high-risk of all-cause mortality.MethodsWe developed ML models (ResNet deep learning using echo videos and CatBoost gradient boosting using echo measurements) to predict 1-year, 3-year, and 5-year mortality. Models were trained on the Mackay dataset, Taiwan (6083 echos, 3626 patients) and validated in the Alberta HEART dataset, Canada (997 echos, 595 patients). We examined the performance of the models overall, and in subgroups (healthy controls, at risk of heart failure (HF), HF with reduced ejection fraction (HFrEF) and HF with preserved ejection fraction (HFpEF)). We compared the models' performance to the MAGGIC risk score, and examined the correlation between the models' predicted probability of death and baseline quality of life as measured by the Kansas City Cardiomyopathy Questionnaire (KCCQ).FindingsMortality rates at 1-, 3- and 5-years were 14.9%, 28.6%, and 42.5% in the Mackay cohort, and 3.0%, 10.3%, and 18.7%, in the Alberta HEART cohort. The ResNet and CatBoost models achieved area under the receiver-operating curve (AUROC) between 85% and 92% in internal validation. In external validation, the AUROCs for the ResNet (82%, 82%, and 78%) were significantly better than CatBoost (78%, 73%, and 75%), for 1-, 3- and 5-year mortality prediction respectively, with better or comparable performance to the MAGGIC score. ResNet models predicted higher probability of death in the HFpEF and HFrEF (30%-50%) subgroups than in controls and at risk patients (5%-20%). The predicted probabilities of death correlated with KCCQ scores (all p < 0.05).InterpretationEcho-based ML models to predict mortality had good internal and external validity, were generalizable, correlated with patients' quality of life, and are comparable to an established HF risk score. These models can be leveraged for automated risk stratification at point-of-care.FundingFunding for Alberta HEART was provided by an Alberta Innovates - Health Solutions Interdisciplinary Team Grant no. AHFMRITG 200801018. P.K. holds a Canadian Institutes of Health Research (CIHR) Sex and Gender Science Chair and a Heart & Stroke Foundation Chair in Cardiovascular Research. A.V. and V.S. received funding from the Mitacs Globalink Research Internship.
| S-EPMC10006431 | biostudies-literature
Project description:BackgroundReadmission after colorectal surgery is common and often implies complications for patients and costs for hospitals. Previous works have created predictive models using logistic regression for this outcome but have shown limited accuracy. Machine learning has shown promise in improving predictions by identifying non-linear patterns in data. We sought to create a more accurate predictive model for readmission after colorectal surgery using machine learning.MethodsPatients who underwent colorectal surgery were identified in the National Quality Improvement Program (NSQIP) database including years 2012-2019 and split into training, validation, and test sets. The primary outcome was readmission within 30 days of surgery. Three types of machine learning models were created, including random forest (RF), gradient boosting (XGB), and neural network (NN). A logistic regression (LR) model was also created for comparison. Model performance was evaluated using area under the receiver operating characteristic curve (AUROC).ResultsThe dataset included 213,827 patients after application of exclusion criteria. A total of 23,083 (10.8%) of patients experienced readmission. NN obtained an AUROC of 0.751 (95% CI 0.743-0.759), compared with 0.684 (95% CI 0.676-0.693) for LR. RF and XGB performed similarly with AUROCs of 0.749 (95% CI 0.741-0.757) and 0.745 (95% CI 0.737-0.753) respectively. Ileus, index admission length of stay, organ-space surgical site infection present at time of surgery, and ostomy placement were identified as the most contributory variables.ConclusionsMachine learning approaches outperformed traditional statistical methods in the prediction of readmission after colorectal surgery. After external validation, this improved prediction model could be used to target interventions to reduce readmission rate.
| S-EPMC10081888 | biostudies-literature
Project description:The early detection of graft failure in pediatric liver transplantation is crucial for appropriate intervention. Graft failure is associated with numerous perioperative risk factors. This study aimed to develop an individualized predictive model for 90-days graft failure in pediatric liver transplantation using machine learning methods. We conducted a single-center retrospective cohort study. A total of 87 liver transplantation cases performed in patients aged < 12 years at the Severance Hospital between January 2010 and September 2020 were included as data samples. Preoperative conditions of recipients and donors, intraoperative care, postoperative serial laboratory parameters, and events observed within seven days of surgery were collected as features. A least absolute shrinkage and selection operator (LASSO) -based method was used for feature selection to overcome the high dimensionality and collinearity of variables. Among 146 features, four variables were selected as the resultant features, namely, preoperative hepatic encephalopathy, sodium level at the end of surgery, hepatic artery thrombosis, and total bilirubin level on postoperative day 7. These features were selected from different times and represent distinct clinical aspects. The model with logistic regression demonstrated the best prediction performance among various machine learning methods tested (area under the receiver operating characteristic curve (AUROC) = 0.898 and area under the precision-recall curve (AUPR) = 0.882). The risk scoring system developed based on the logistic regression model showed an AUROC of 0.910 and an AUPR of 0.830. Together, the prediction of graft failure in pediatric liver transplantation using the proposed machine learning model exhibited superior discrimination power and, therefore, can provide valuable information to clinicians for their decision making during the postoperative management of the patients.
| S-EPMC9794703 | biostudies-literature
Project description:Solubility is a key metric for therapeutic compounds. Conversely, insoluble compounds cloud the accuracy of assays at all stages of chemical biology and drug discovery. Herein, we disclose naïve Bayesian classifier models to predict aqueous solubility. Publicly accessible aqueous solubility data were used to create two full, or nonpruned, training sets. These two sets were also combined to create a full fused set, and a training set comprised of a literature collation of solubility data was also considered as a reference. We tested different extents of data pruning on the training sets and constructed machine learning models that were evaluated with two independent, external test sets that contained compounds that were different from the training sets. The best pruned and fused model was significantly more accurate, in comparison to either the full model or the full fused model, with the prediction of these external test sets. By carefully removing data from the training set, less information can be used to create more accurate machine learning models for aqueous solubility. This knowledge and the curated training sets should prove useful to future machine learning approaches.
| S-EPMC7364544 | biostudies-literature
Project description:Postoperative nausea and vomiting (PONV) can lead to various postoperative complications. The risk assessment model of PONV is helpful in guiding treatment and reducing the incidence of PONV, whereas the published models of PONV do not have a high accuracy rate. This study aimed to collect data from patients in Sichuan Provincial People's Hospital to develop models for predicting PONV based on machine learning algorithms, and to evaluate the predictive performance of the models using the area under the receiver characteristic curve (AUC), accuracy, precision, recall rate, F1 value and area under the precision-recall curve (AUPRC). The AUC (0.947) of our best machine learning model was significantly higher than that of the past models. The best of these models was used for external validation on patients from Chengdu First People's Hospital, and the AUC was 0.821. The contributions of variables were also interpreted using SHapley Additive ExPlanation (SHAP). A history of motion sickness and/or PONV, sex, weight, history of surgery, infusion volume, intraoperative urine volume, age, BMI, height, and PCA_3.0 were the top ten most important variables for the model. The machine learning models of PONV provided a good preoperative prediction of PONV for intravenous patient-controlled analgesia.
| S-EPMC10119140 | biostudies-literature
Project description:The incidence of major hemorrhage and transfusion during liver transplantation has decreased significantly over the past decade, but major bleeding remains a common expectation. Massive intraoperative hemorrhage during liver transplantation can lead to mortality or reoperation. This study aimed to develop machine learning models for the prediction of massive hemorrhage and a scoring system which is applicable to new patients. Data were retrospectively collected from patients aged >18 years who had undergone liver transplantation. These data included emergency information, donor information, demographic data, preoperative laboratory data, the etiology of hepatic failure, the Model for End-stage Liver Disease (MELD) score, surgical history, antiplatelet therapy, continuous renal replacement therapy (CRRT), the preoperative dose of vasopressor, and the estimated blood loss (EBL) during surgery. The logistic regression model was one of the best-performing machine learning models. The most important factors for the prediction of massive hemorrhage were the disease etiology, activated partial thromboplastin time (aPTT), operation duration, body temperature, MELD score, mean arterial pressure, serum creatinine, and pulse pressure. The risk-scoring system was developed using the odds ratios of these factors from the logistic model. The risk-scoring system showed good prediction performance and calibration (AUROC: 0.775, AUPR: 0.753).
| S-EPMC9320884 | biostudies-literature
Project description:BackgroundHospital-acquired pneumonia (HAP) is the most common hospital-acquired infection in China with substantial morbidity and mortality. But no specific risk assessment model has been well validated in patients with HAP. The aim of this study was to investigate the published risk assessment models that could potentially be used to predict 30-day mortality in HAP patients in non-surgical departments.MethodsThis study was a single-center, retrospective study. In total, 223 patients diagnosed with HAP from 2012 to 2017 were included in this study. Clinical and laboratory data during the initial 24 hours after HAP diagnosis were collected to calculate the pneumonia severity index (PSI); consciousness, urea nitrogen, respiratory rate, blood pressure, and age ≥65 years (CURB-65); Acute Physiology and Chronic Health Evaluation II (APACHE II); Sequential Organ Failure Assessment (SOFA); and Quick Sequential Organ Failure Assessment (qSOFA) scores. The discriminatory power was tested by constructing receiver operating characteristic (ROC) curves, and the areas under the curve (AUCs) were calculated.ResultsThe all-cause 30-day mortality rate was 18.4% (41/223). The PSI, CURB-65, SOFA, APACHE II, and qSOFA scores were significantly higher in non-survivors than in survivors (all P < 0.001). The discriminatory abilities of the APACHE II and SOFA scores were better than those of the CURB-65 and qSOFA scores (ROC AUC: APACHE II vs. CURB-65, 0.863 vs. 0.744, Z = 3.055, P = 0.002; APACHE II vs. qSOFA, 0.863 vs. 0.767, Z = 3.017, P = 0.003; SOFA vs. CURB-65, 0.856 vs. 0.744, Z = 2.589, P = 0.010; SOFA vs. qSOFA, 0.856 vs. 0.767, Z = 2.170, P = 0.030). The cut-off values we defined for the SOFA, APACHE II, and qSOFA scores were 4, 14, and 1.ConclusionsThese results suggest that the APACHE II and SOFA scores determined during the initial 24 h after HAP diagnosis may be useful for the prediction of 30-day mortality in HAP patients in non-surgical departments. The qSOFA score may be a simple tool that can be used to quickly identify severe infections.
| S-EPMC7752693 | biostudies-literature