Dataset Information

Improved ICU mortality prediction based on SOFA scores and gastrointestinal parameters.

ABSTRACT: BACKGROUND:The Sequential Organ Failure Assessment (SOFA) score is commonly used in ICUs around the world, designed to assess the severity of the patient's clinical state based on function/dysfunction of six major organ systems. The goal of this work is to build a computational model to predict mortality based on a series of SOFA scores. In addition, we examined the possibility of improving the prediction by incorporating a new component designed to measure the performance of the gastrointestinal system, added to the other six components. METHODS:In this retrospective study, we used patients' three latest SOFA scores recorded during an individual ICU stay as input to different machine learning models and ensemble learning models. We added three validated parameters representing gastrointestinal failure. Among others, we used classification models such as Support Vector Machines (SVMs), Neural Networks, Logistic Regression and a penalty function used to increase model robustness in regard to certain extreme cases, which may be found in ICU population. We used the Area under Curve (AUC) performance metric to examine performance. RESULTS:We found an ensemble model of linear and logistic regression achieves a higher AUC compared related works in past years. After incorporating the gastrointestinal failure score along with the penalty function, our best performing ensemble model resulted in an additional improvement in terms of AUC metrics. We implemented and compared 36 different models that were built using both the information from the SOFA score as well as that of the gastrointestinal system. All compared models have approximately similar and relatively large AUC (between 0.8645 and 0.9146) with the best results are achieved by incorporating the gastrointestinal parameters into the prediction models. CONCLUSIONS:Our findings indicate that gastrointestinal parameters carry significant information as a mortality predictor in addition to the conventional SOFA score. This information improves the predictive power of machine learning models by extending the SOFA to include information related to gastrointestinal organ system. The described method improves mortality prediction by considering the dynamics of the extended SOFA score. Although tested on a limited data set, the results' stability across different models suggests robustness in real-time use.

SUBMITTER: Aperstein Y

PROVIDER: S-EPMC6768479 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Improved ICU mortality prediction based on SOFA scores and gastrointestinal parameters.

Aperstein Yehudit Y Cohen Lidor L Bendavid Itai I Cohen Jonathan J Grozovsky Elad E Rotem Tammy T Singer Pierre P

PloS one 20190930 9

<h4>Background</h4>The Sequential Organ Failure Assessment (SOFA) score is commonly used in ICUs around the world, designed to assess the severity of the patient's clinical state based on function/dysfunction of six major organ systems. The goal of this work is to build a computational model to predict mortality based on a series of SOFA scores. In addition, we examined the possibility of improving the prediction by incorporating a new component designed to measure the performance of the gastroi ...[more]

PMID: 31568512

Similar Datasets

Project description:INTRODUCTION: To systematically review studies evaluating the performance of Sequential Organ Failure Assessment (SOFA)-based models for predicting mortality in patients in the intensive care unit (ICU). METHODS: Medline, EMBASE and other databases were searched for English-language articles with the major objective of evaluating the prognostic performance of SOFA-based models in predicting mortality in surgical and/or medical ICU admissions. The quality of each study was assessed based on a quality framework for prognostic models. RESULTS: Eighteen articles met all inclusion criteria. The studies differed widely in the SOFA derivatives used and in their methods of evaluation. Ten studies reported about developing a probabilistic prognostic model, only five of which used an independent validation data set. The other studies used the SOFA-based score directly to discriminate between survivors and non-survivors without fitting a probabilistic model. In five of the six studies, admission-based models (Acute Physiology and Chronic Health Evaluation (APACHE) II/III) were reported to have a slightly better discrimination ability than SOFA-based models at admission (the receiver operating characteristic curve (AUC) of SOFA-based models ranged between 0.61 and 0.88), and in one study a SOFA model had higher AUC than the Simplified Acute Physiology Score (SAPS) II model. Four of these studies used the Hosmer-Lemeshow tests for calibration, none of which reported a lack of fit for the SOFA models. Models based on sequential SOFA scores were described in 11 studies including maximum SOFA scores and maximum sum of individual components of the SOFA score (AUC range: 0.69 to 0.92) and delta SOFA (AUC range: 0.51 to 0.83). Studies comparing SOFA with other organ failure scores did not consistently show superiority of one scoring system to another. Four studies combined SOFA-based derivatives with admission severity of illness scores, and they all reported on improved predictions for the combination. Quality of studies ranged from 11.5 to 19.5 points on a 20-point scale. CONCLUSIONS: Models based on SOFA scores at admission had only slightly worse performance than APACHE II/III and were competitive with SAPS II models in predicting mortality in patients in the general medical and/or surgical ICU. Models with sequential SOFA scores seem to have a comparable performance with other organ failure scores. The combination of sequential SOFA derivatives with APACHE II/III and SAPS II models clearly improved prognostic performance of either model alone. Due to the heterogeneity of the studies, it is impossible to draw general conclusions on the optimal mathematical model and optimal derivatives of SOFA scores. Future studies should use a standard evaluation methodology with a standard set of outcome measures covering discrimination, calibration and accuracy.

Project description:BackgroundOutcomes in well-resourced, intensive care units (ICUs) in Kenya are thought to be comparable to those in high-income countries (HICs) but risk-adjusted mortality data is unavailable. We undertook an evaluation of the Aga Khan University Hospital, Nairobi ICU to analyze patient clinical-demographic characteristics, compare the performance of Sequential Organ Failure Assessment (SOFA), delta-SOFA at 48 hours and Mortality Prediction Model-III (MPM-III) mortality prediction systems, and identify factors associated with increased risk of mortality.MethodsA retrospective cohort study was conducted of adult patients admitted to the ICU between January 2015 and September 2017. SOFA and MPM-III scores were determined at admission and SOFA repeated at 48 hours.ResultsApproximately 33% of patients did not meet ICU admission criteria. Mortality among the population of critically ill patients in the ICU was 31.7%, most of whom were male (61.4%) with a median age of 53.4 years. High adjusted odds of mortality were found among critically ill patients with leukemia (aOR 6.32, p<0.01), tuberculosis (aOR 3.96, p<0.01), post-cardiac arrest (aOR 3.57, p<0.01), admissions from the step-down unit (aOR 3.13, p<0.001), acute kidney injury (aOR 2.97, p<0.001) and metastatic cancer (aOR 2.45, p = 0.04). The area under the receiver-operating characteristic (ROC) curve of admission SOFA was 0.77 (95% CI, 0.73-0.81), MPM-III 0.74 (95% CI, 0.69-0.79), delta-SOFA 0.69 (95% CI, 0.63-0.75) and 48-hour SOFA 0.83 (95% CI, 0.79-0.87). The difference between SOFA at 48 hours and admission SOFA, MPM-III and delta-SOFA was statistically significant (chi2 = 17.1, 24.2 and 26.5 respectively; p<0.001). Admission SOFA, MPM-III and 48-hour SOFA were well calibrated (p >0.05) while delta-SOFA was borderline (p = 0.05).ConclusionMortality among the critically ill was higher than expected in this well-resourced ICU. 48-hour SOFA performed better than admission SOFA, MPM-III and delta-SOFA in our cohort. While a large proportion of patients did not meet admission criteria but were boarded in the ICU, critically ill patients stepped-up from the step-down unit were unlikely to survive. Patients admitted following a cardiac arrest, and those with advanced disease such as leukemia, stage-4 HIV and metastatic cancer, had particularly poor outcomes. Policies for fair allocation of beds, protocol-driven admission criteria and appropriate case selection could contribute to lowering the risk of mortality among the critically ill to a level on par with HICs.

Project description:BackgroundMechanical ventilation (MV) is vital for critically ill ICU patients but carries significant mortality risks. This study aims to develop a predictive model to estimate hospital mortality among MV patients, utilizing comprehensive health data to assist ICU physicians with early-stage alerts.MethodsWe developed a Machine Learning (ML) framework to predict hospital mortality in ICU patients receiving MV. Using the MIMIC-III database, we identified 25,202 eligible patients through ICD-9 codes. We employed backward elimination and the Lasso method, selecting 32 features based on clinical insights and literature. Data preprocessing included eliminating columns with over 90% missing data and using mean imputation for the remaining missing values. To address class imbalance, we used the Synthetic Minority Over-sampling Technique (SMOTE). We evaluated several ML models, including CatBoost, XGBoost, Decision Tree, Random Forest, Support Vector Machine (SVM), K-Nearest Neighbors (KNN), and Logistic Regression, using a 70/30 train-test split. The CatBoost model was chosen for its superior performance in terms of accuracy, precision, recall, F1-score, AUROC metrics, and calibration plots.ResultsThe study involved a cohort of 25,202 patients on MV. The CatBoost model attained an AUROC of 0.862, an increase from an initial AUROC of 0.821, which was the best reported in the literature. It also demonstrated an accuracy of 0.789, an F1-score of 0.747, and better calibration, outperforming other models. These improvements are due to systematic feature selection and the robust gradient boosting architecture of CatBoost.ConclusionThe preprocessing methodology significantly reduced the number of relevant features, simplifying computational processes, and identified critical features previously overlooked. Integrating these features and tuning the parameters, our model demonstrated strong generalization to unseen data. This highlights the potential of ML as a crucial tool in ICUs, enhancing resource allocation and providing more personalized interventions for MV patients.

Dataset Information

Improved ICU mortality prediction based on SOFA scores and gastrointestinal parameters.

Publications

Improved ICU mortality prediction based on SOFA scores and gastrointestinal parameters.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets