Dataset Information

Using a machine learning model to predict the development of acute kidney injury in patients with heart failure.

ABSTRACT:

Background

Heart failure (HF) is a life-threatening complication of cardiovascular disease. HF patients are more likely to progress to acute kidney injury (AKI) with a poor prognosis. However, it is difficult for doctors to distinguish which patients will develop AKI accurately. This study aimed to construct a machine learning (ML) model to predict AKI occurrence in HF patients.

Materials and methods

The data of HF patients from the Medical Information Mart for Intensive Care-IV (MIMIC-IV) database was retrospectively analyzed. A ML model was established to predict AKI development using decision tree, random forest (RF), support vector machine (SVM), K-nearest neighbor (KNN), and logistic regression (LR) algorithms. Thirty-nine demographic, clinical, and treatment features were used for model establishment. Accuracy, sensitivity, specificity, and the area under the receiver operating characteristic curve (AUROC) were used to evaluate the performance of the ML algorithms.

Results

A total of 2,678 HF patients were engaged in this study, of whom 919 developed AKI. Among 5 ML algorithms, the RF algorithm exhibited the highest performance with the AUROC of 0.96. In addition, the Gini index showed that the sequential organ function assessment (SOFA) score, partial pressure of oxygen (PaO₂), and estimated glomerular filtration rate (eGFR) were highly relevant to AKI development. Finally, to facilitate clinical application, a simple model was constructed using the 10 features screened by the Gini index. The RF algorithm also exhibited the highest performance with the AUROC of 0.95.

Conclusion

Using the ML model could accurately predict the development of AKI in HF patients.

SUBMITTER: Liu WT

PROVIDER: S-EPMC9512707 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Using a machine learning model to predict the development of acute kidney injury in patients with heart failure.

Liu Wen Tao WT Liu Xiao Qi XQ Jiang Ting Ting TT Wang Meng Ying MY Huang Yang Y Huang Yu Lin YL Jin Feng Yong FY Zhao Qing Q Wu Qin Yi QY Liu Bi Cheng BC Ruan Xiong Zhong XZ Ma Kun Ling KL

Frontiers in cardiovascular medicine 20220907

<h4>Background</h4>Heart failure (HF) is a life-threatening complication of cardiovascular disease. HF patients are more likely to progress to acute kidney injury (AKI) with a poor prognosis. However, it is difficult for doctors to distinguish which patients will develop AKI accurately. This study aimed to construct a machine learning (ML) model to predict AKI occurrence in HF patients.<h4>Materials and methods</h4>The data of HF patients from the Medical Information Mart for Intensive Care-IV ( ...[more]

PMID: 36176988

Similar Datasets

Project description:BackgroundMachine learning (ML) has been used to build high performance prediction model. Patients with congestive heart failure (CHF) are vulnerable to acute kidney injury (AKI) which makes treatment difficult. We aimed to establish an ML-based prediction model for the early identification of AKI in patients with CHF.MethodsPatients data were extracted from the Medical Information Mart for Intensive Care III (MIMIC-III) database, and patients with CHF were selected. Comparisons between several common ML classifiers were conducted to select the best prediction model. Recursive feature elimination (RFE) was used to select important prediction features. The model was improved using hyperparameters optimization (HPO). The final model was validated using an external validation set from the eICU Collaborative Research Database. The area under the receiver operating characteristic curve (AUROC), accuracy, calibration curve and decision curve analysis were used to evaluate prediction performance. Additionally, the final model was used to predict renal replacement therapy (RRT) requirement and to assess the short-term prognosis of patients with CHF. Finally, a software program was developed based on the selected features, which could intuitively report the probability of AKI.ResultsA total of 8,580 patients with CHF were included, among whom 2,364 were diagnosed with AKI. The LightGBM model showed the best prediction performance (AUROC = 0.803) among the 13 ML-based models. After RFE and HPO, the final model was established with 18 features including serum creatinine (SCr), blood urea nitrogen (BUN) and urine output (UO). The prediction performance of LightGBM was better than that of measuring SCr, UO or SCr combined with UO (AUROCs: 0.809, 0.703, 0.560 and 0.714, respectively). Additionally, the final model could accurately predict RRT requirement in patients with (AUROC = 0.954). Moreover, the participants were divided into high- and low-risk groups for AKI, and the 90-day mortality in the high-risk group was significantly higher than that in the low-risk group (log-rank p < 0.001). Finally, external validation using the eICU database comprising 9,749 patients with CHF revealed satisfactory prediction outcomes (AUROC = 0.816).ConclusionA prediction model for AKI in patients with CHF was established based on LightGBM, and the prediction performance of this model was better than that of other models. This model may help in predicting RRT requirement and in identifying the population with poor prognosis among patients with CHF.

Project description:AimsIn recent years, there has been remarkable development in machine learning (ML) models, showing a trend towards high prediction performance. ML models with high prediction performance often become structurally complex and are frequently perceived as black boxes, hindering intuitive interpretation of the prediction results. We aimed to develop ML models with high prediction performance, interpretability, and superior risk stratification to predict in-hospital mortality and worsening heart failure (WHF) in patients with acute heart failure (AHF).Methods and resultsBased on the Kyoto Congestive Heart Failure registry, which enrolled 4056 patients with AHF, we developed prediction models for in-hospital mortality and WHF using information obtained on the first day of admission (demographics, physical examination, blood test results, etc.). After excluding 16 patients who died on the first or second day of admission, the original dataset (n = 4040) was split 4:1 into training (n = 3232) and test datasets (n = 808). Based on the training dataset, we developed three types of prediction models: (i) the classification and regression trees (CART) model; (ii) the random forest (RF) model; and (iii) the extreme gradient boosting (XGBoost) model. The performance of each model was evaluated using the test dataset, based on metrics including sensitivity, specificity, area under the receiver operating characteristic curve (AUC), Brier score, and calibration slope. For the complex structure of the XGBoost model, we performed SHapley Additive exPlanations (SHAP) analysis, classifying patients into interpretable clusters. In the original dataset, the proportion of females was 44.8% (1809/4040), and the average age was 77.9 ± 12.0. The in-hospital mortality rate was 6.3% (255/4040) and the WHF rate was 22.3% (900/4040) in the total study population. In the in-hospital mortality prediction, the AUC for the XGBoost model was 0.816 [95% confidence interval (CI): 0.815-0.818], surpassing the AUC values for the CART model (0.683, 95% CI: 0.680-0.685) and the RF model (0.755, 95% CI: 0.753-0.757). Similarly, in the WHF prediction, the AUC for the XGBoost model was 0.766 (95% CI: 0.765-0.768), outperforming the AUC values for the CART model (0.688, 95% CI: 0.686-0.689) and the RF model (0.713, 95% CI: 0.711-0.714). In the XGBoost model, interpretable clusters were formed, and the rates of in-hospital mortality and WHF were similar among each cluster in both the training and test datasets.ConclusionsThe XGBoost models with SHAP analysis provide high prediction performance, interpretability, and reproducible risk stratification for in-hospital mortality and WHF for patients with AHF.

Project description:BackgroundStudies have shown that more than half of patients with heart failure (HF) with acute kidney injury (AKI) have newonset AKI, and renal function evaluation markers such as estimated glomerular filtration rate are usually not repeatedly tested during the hospitalization. As an independent risk factor, delayed AKI recognition has been shown to be associated with the adverse events of patients with HF, such as chronic kidney disease and death.ObjectiveThe aim of this study is to develop and assess of an unsupervised machine learning model that identifies patients with HF and normal renal function but who are susceptible to de novo AKI.MethodsWe analyzed an electronic health record data set that included 5075 patients admitted for HF with normal renal function, from which 2 phenogroups were categorized using an unsupervised machine learning algorithm called K-means clustering. We then determined whether the inferred phenogroup index had the potential to be an essential risk indicator by conducting survival analysis, AKI prediction, and the hazard ratio test.ResultsThe AKI incidence rate in the generated phenogroup 2 was significantly higher than that in phenogroup 1 (group 1: 106/2823, 3.75%; group 2: 259/2252, 11.50%; P<.001). The survival rate of phenogroup 2 was consistently lower than that of phenogroup 1 (P<.005). According to logistic regression, the univariate model using the phenogroup index achieved promising performance in AKI prediction (sensitivity 0.710). The generated phenogroup index was also significant in serving as a risk indicator for AKI (hazard ratio 3.20, 95% CI 2.55-4.01). Consistent results were yielded by applying the proposed model on an external validation data set extracted from Medical Information Mart for Intensive Care (MIMIC) III pertaining to 1006 patients with HF and normal renal function.ConclusionsAccording to a machine learning analysis on electronic health record data, patients with HF who had normal renal function were clustered into separate phenogroups associated with different risk levels of de novo AKI. Our investigation suggests that using machine learning can facilitate patient phengrouping and stratification in clinical settings where the identification of high-risk patients has been challenging.

Project description:ObjectiveWe aimed to develop and validate a predictive machine learning (ML) model for cardiac surgery associated with acute kidney injury (CSA-AKI) based on a multicenter randomized control trial (RCT) and a Medical Information Mart for Intensive Care-IV (MIMIC-IV) dataset.MethodsThis was a subanalysis from a completed RCT approved by the Ethics Committee of Fuwai Hospital in Beijing, China (NCT03782350). Data from Fuwai Hospital were randomly assigned, with 80% for the training dataset and 20% for the testing dataset. The data from three other centers were used for the external validation dataset. Furthermore, the MIMIC-IV dataset was also utilized to validate the performance of the predictive model. The area under the receiver operating characteristic curve (ROC-AUC), the precision-recall curve (PR-AUC), and the calibration brier score were applied to evaluate the performance of the traditional logistic regression (LR) and eleven ML algorithms. Additionally, the Shapley Additive Explanations (SHAP) interpreter was used to explain the potential risk factors for CSA-AKI.ResultA total of 6495 eligible patients undergoing cardiopulmonary bypass (CPB) were eventually included in this study, 2416 of whom were from Fuwai Hospital (Beijing), for model development, 562 from three other cardiac centers in China, and 3517 from the MIMICIV dataset, were used, respectively, for external validation. The CatBoostClassifier algorithms outperformed other models, with excellent discrimination and calibration performance for the development, as well as the MIMIC-IV, datasets. In addition, the CatBoostClassifier achieved ROC-AUCs of 0.85, 0.67, and 0.77 and brier scores of 0.14, 0.19, and 0.16 in the testing, external, and MIMIC-IV datasets, respectively. Moreover, the utmost important risk factor, the N-terminal brain sodium peptide (NT-proBNP), was confirmed by the LASSO method in the feature section process. Notably, the SHAP explainer identified that the preoperative blood urea nitrogen level, prothrombin time, serum creatinine level, total bilirubin level, and age were positively correlated with CSA-AKI; preoperative platelets level, systolic and diastolic blood pressure, albumin level, and body weight were negatively associated with CSA-AKI.ConclusionsThe CatBoostClassifier algorithms outperformed other ML models in the discrimination and calibration of CSA-AKI prediction cardiac surgery with CPB, based on a multicenter RCT and MIMIC-IV dataset. Moreover, the preoperative NT-proBNP level was confirmed to be strongly related to CSA-AKI.

Dataset Information

Using a machine learning model to predict the development of acute kidney injury in patients with heart failure.

Background

Materials and methods

Results

Conclusion

Publications

Using a machine learning model to predict the development of acute kidney injury in patients with heart failure.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets