Dataset Information

Neural networks versus Logistic regression for 30?days all-cause readmission prediction.

ABSTRACT: Heart failure (HF) is one of the leading causes of hospital admissions in the US. Readmission within 30 days after a HF hospitalization is both a recognized indicator for disease progression and a source of considerable financial burden to the healthcare system. Consequently, the identification of patients at risk for readmission is a key step in improving disease management and patient outcome. In this work, we used a large administrative claims dataset to (1) explore the systematic application of neural network-based models versus logistic regression for predicting 30 days all-cause readmission after discharge from a HF admission, and (2) to examine the additive value of patients' hospitalization timelines on prediction performance. Based on data from 272,778 (49% female) patients with a mean (SD) age of 73 years (14) and 343,328 HF admissions (67% of total admissions), we trained and tested our predictive readmission models following a stratified 5-fold cross-validation scheme. Among the deep learning approaches, a recurrent neural network (RNN) combined with conditional random fields (CRF) model (RNNCRF) achieved the best performance in readmission prediction with 0.642 AUC (95% CI, 0.640-0.645). Other models, such as those based on RNN, convolutional neural networks and CRF alone had lower performance, with a non-timeline based model (MLP) performing worst. A competitive model based on logistic regression with LASSO achieved a performance of 0.643 AUC (95% CI, 0.640-0.646). We conclude that data from patient timelines improve 30 day readmission prediction, that a logistic regression with LASSO has equal performance to the best neural network model and that the use of administrative data result in competitive performance compared to published approaches based on richer clinical datasets.

SUBMITTER: Allam A

PROVIDER: S-EPMC6595068 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Neural networks versus Logistic regression for 30 days all-cause readmission prediction.

Allam Ahmed A Nagy Mate M Thoma George G Krauthammer Michael M

Scientific reports 20190626 1

Heart failure (HF) is one of the leading causes of hospital admissions in the US. Readmission within 30 days after a HF hospitalization is both a recognized indicator for disease progression and a source of considerable financial burden to the healthcare system. Consequently, the identification of patients at risk for readmission is a key step in improving disease management and patient outcome. In this work, we used a large administrative claims dataset to (1) explore the systematic application ...[more]

PMID: 31243311

Similar Datasets

Project description:BackgroundGeneralized regression neural network (GRNN) and logistic regression (LR) are extensively used in the medical field; however, the better model for predicting stroke outcome has not been established. The primary goal of this study was to compare the accuracies of GRNN and LR models to identify the most optimal model for the prediction of acute stroke outcome, as well as explore useful biomarkers for predicting the prognosis of acute stroke patients.MethodIn a single-center study, 216 (80% for the training set and 20% for the test set) acute stroke patients admitted to the Shenzhen Second People's Hospital between December 2019 to June 2021 were retrospectively recruited. The functional outcomes of the patients were measured using Barthel Index (BI) on discharge. A training set was used to optimize the GRNN and LR models. The test set was utilized to validate and compare the performances of GRNN and LR in predicting acute stroke outcome based on the area under the receiver operating characteristic curve (AUROC), accuracy, sensitivity, and the Kappa value.ResultThe LR analysis showed that age, the National Institute Health Stroke Scale score, BI index, hemoglobin, and albumin were independently associated with stroke outcome. After validating in test set using these variables, we found that the GRNN model showed a better performance based on AUROC (0.931 vs 0.702), sensitivity (0.933 vs 0.700), specificity (0.889 vs 0.722), accuracy (0.896 vs 0.729), and the Kappa value (0.775 vs 0.416) than the LR model.ConclusionOverall, the GRNN model demonstrated superior performance to the LR model in predicting the prognosis of acute stroke patients. In addition to its advantage in not affected by implicit interactions and complex relationship in the data. Thus, we suggested that GRNN could be served as the optimal statistical model for acute stroke outcome prediction. Simultaneously, prospective validation based on more variables of the GRNN model for the prediction is required in future studies.

Project description:It is expected but unknown whether machine-learning models can outperform regression models, such as a logistic regression (LR) model, especially when the number and types of predictor variables increase in electronic health records (EHRs). We aimed to compare the predictive performance of gradient-boosted decision tree (GBDT), random forest (RF), deep neural network (DNN), and LR with the least absolute shrinkage and selection operator (LR-LASSO) for unplanned readmission. We used EHRs of patients discharged alive from 38 hospitals in 2015-2017 for derivation and in 2018 for validation, including basic characteristics, diagnosis, surgery, procedure, and drug codes, and blood-test results. The outcome was 30-day unplanned readmission. We created six patterns of data tables having different numbers of binary variables (that ≥5% or ≥1% of patients or ≥10 patients had) with and without blood-test results. For each pattern of data tables, we used the derivation data to establish the machine-learning and LR models, and used the validation data to evaluate the performance of each model. The incidence of outcome was 6.8% (23,108/339,513 discharges) and 6.4% (7,507/118,074 discharges) in the derivation and validation datasets, respectively. For the first data table with the smallest number of variables (102 variables that ≥5% of patients had, without blood-test results), the c-statistic was highest for GBDT (0.740), followed by RF (0.734), LR-LASSO (0.720), and DNN (0.664). For the last data table with the largest number of variables (1543 variables that ≥10 patients had, including blood-test results), the c-statistic was highest for GBDT (0.764), followed by LR-LASSO (0.755), RF (0.751), and DNN (0.720), suggesting that the difference between GBDT and LR-LASSO was small and their 95% confidence intervals overlapped. In conclusion, GBDT generally outperformed LR-LASSO to predict unplanned readmission, but the difference of c-statistic became smaller as the number of variables was increased and blood-test results were used.

Dataset Information

Neural networks versus Logistic regression for 30?days all-cause readmission prediction.

Publications

Neural networks versus Logistic regression for 30 days all-cause readmission prediction.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets