Prediction of long-term hospitalisation and all-cause mortality in patients with chronic heart failure on Dutch claims data: a machine learning approach
Ontology highlight
ABSTRACT: Background
Accurately predicting which patients with chronic heart failure (CHF) are particularly vulnerable for adverse outcomes is of crucial importance to support clinical decision making. The goal of the current study was to examine the predictive value on long term heart failure (HF) hospitalisation and all-cause mortality in CHF patients, by exploring and exploiting machine learning (ML) and traditional statistical techniques on a Dutch health insurance claims database. Methods
Our study population consisted of 25,776 patients with a CHF diagnosis code between 2012 and 2014 and one year and three years follow-up HF hospitalisation (1446 and 3220 patients respectively) and all-cause mortality (2434 and 7882 patients respectively) were measured from 2015 to 2018. The area under the receiver operating characteristic (ROC) curve (AUC) was calculated after modelling the data using Logistic Regression, Random Forest, Elastic Net regression and Neural Networks. Results
AUC rates ranged from 0.710 to 0.732 for 1-year HF hospitalisation, 0.705–0.733 for 3-years HF hospitalisation, 0.765–0.787 for 1-year mortality and 0.764–0.791 for 3-years mortality. Elastic Net performed best for all endpoints. Differences between techniques were small and only statistically significant between Elastic Net and Logistic Regression compared with Random Forest for 3-years HF hospitalisation. Conclusion
In this study based on a health insurance claims database we found clear predictive value for predicting long-term HF hospitalisation and mortality of CHF patients by using ML techniques compared to traditional statistics. Supplementary Information
The online version contains supplementary material available at 10.1186/s12911-021-01657-w.
SUBMITTER: van der Galien O
PROVIDER: S-EPMC8561992 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:AimsModels predicting mortality in heart failure (HF) patients are often limited with regard to performance and applicability. The aim of this study was to develop a reliable algorithm to compute expected in-hospital mortality rates in HF cohorts on a population level based on administrative data comparing regression analysis with different machine learning (ML) models.Methods and resultsInpatient cases with primary International Statistical Classification of Diseases and Related Health Problems (ICD-10) encoded discharge diagnosis of HF non-electively admitted to 86 German Helios hospitals between 1 January 2016 and 31 December 2018 were identified. The dataset was randomly split 75%/25% for model development and testing. Highly unbalanced variables were removed. Four ML algorithms were applied, and all algorithms were tuned using a grid search with multiple repetitions. Model performance was evaluated by computing receiver operating characteristic areas under the curve. In total, 59 125 cases (69.8% aged 75 years or older, 51.9% female) were investigated, and in-hospital mortality was 6.20%. Areas under the curve of all ML algorithms outperformed regression analysis in the testing dataset with values of 0.829 [95% confidence interval (CI) 0.814-0.843] for logistic regression, 0.875 (95% CI 0.863-0.886) for random forest, 0.882 (95% CI 0.871-0.893) for gradient boosting machine, 0.866 (95% CI 0.854-0.878) for single-layer neural networks, and 0.882 (95% CI 0.872-0.893) for extreme gradient boosting. Brier scores demonstrated a good calibration especially of the latter three models.ConclusionsWe introduced reliable models to calculate expected in-hospital mortality based only on administrative routine data using ML algorithms. A broad application could supplement quality measurement programs and therefore improve future HF patient care.
| S-EPMC8318394 | biostudies-literature
Project description:BackgroundExisting risk assessment tools for heart failure (HF) outcomes use structured databases with static, single-timepoint clinical data and have limited accuracy.ObjectiveThe purpose of this study was to develop a comprehensive approach for accurate prediction of 30-day unplanned readmission and all-cause mortality (ACM) that integrates clinical and physiological data available in the electronic health record system.MethodsThree predictive models for 30-day unplanned readmissions or ACM were created using an extreme gradient boosting approach: (1) index admission model; (2) index discharge model; and (3) feature-aggregated model. Performance was assessed by the area under the curve (AUC) metric and compared with that of the HOSPITAL score, a widely used predictive model for hospital readmission.ResultsA total of 3774 patients with a primary billing diagnosis of HF were included (614 experienced the primary outcome), with 796 variables used in the admission and discharge models, and 2032 in the feature-aggregated model. The index admission model had AUC = 0.723, the index discharge model had AUC = 0.754, and the feature-aggregated model had AUC = 0.756 for prediction of 30-day unplanned readmission or ACM. For comparison, the HOSPITAL score had AUC = 0.666 (admission model: P = .093; discharge model: P = .022; feature aggregated: P = .012).ConclusionThese models predict risk of HF hospitalizations and ACM in patients admitted with HF and emphasize the importance of incorporating large numbers of variables in machine learning models to identify predictors for future investigation.
| S-EPMC8890080 | biostudies-literature
Project description:Background Unlike linear models which are traditionally used to study all-cause mortality, complex machine learning models can capture non-linear interrelations and provide opportunities to identify unexplored risk factors. Explainable artificial intelligence can improve prediction accuracy over linear models and reveal great insights into outcomes like mortality. This paper comprehensively analyzes all-cause mortality by explaining complex machine learning models. Methods We propose the IMPACT framework that uses XAI technique to explain a state-of-the-art tree ensemble mortality prediction model. We apply IMPACT to understand all-cause mortality for 1-, 3-, 5-, and 10-year follow-up times within the NHANES dataset, which contains 47,261 samples and 151 features. Results We show that IMPACT models achieve higher accuracy than linear models and neural networks. Using IMPACT, we identify several overlooked risk factors and interaction effects. Furthermore, we identify relationships between laboratory features and mortality that may suggest adjusting established reference intervals. Finally, we develop highly accurate, efficient and interpretable mortality risk scores that can be used by medical professionals and individuals without medical expertise. We ensure generalizability by performing temporal validation of the mortality risk scores and external validation of important findings with the UK Biobank dataset. Conclusions IMPACT’s unique strength is the explainable prediction, which provides insights into the complex, non-linear relationships between mortality and features, while maintaining high accuracy. Our explainable risk scores could help individuals improve self-awareness of their health status and help clinicians identify patients with high risk. IMPACT takes a consequential step towards bringing contemporary developments in XAI to epidemiology. Qui et al. present a new approach, IMPACT, that uses explainable artificial intelligence to analyze all-cause mortality. IMPACT provides insights into the individualized mortality risk scores, while maintaining high model accuracy and the expressive power to capture complex, non-linear relationships between mortality and individuals’ features.
| S-EPMC9530124 | biostudies-literature
Project description:Background Machine-learning-based prediction models (MLBPMs) have shown satisfactory performance in predicting clinical outcomes in patients with heart failure with reduced and preserved ejection fraction. However, their usefulness has yet to be fully elucidated in patients with heart failure with mildly reduced ejection fraction. This pilot study aims to evaluate the prediction performance of MLBPMs in a heart failure with mildly reduced ejection fraction cohort with long-term follow-up data. Methods and Results A total of 424 patients with heart failure with mildly reduced ejection fraction were enrolled in our study. The primary outcome was all-cause mortality. Two feature selection strategies were introduced for MLBPM development. The "All-in" (67 features) strategy was based on feature correlation, multicollinearity, and clinical significance. The other strategy was the CoxBoost algorithm with 10-fold cross-validation (17 features), which was based on the selection result of the "All-in" strategy. Six MLBPMs with 5-fold cross-validation based on the "All-in" and the CoxBoost algorithm with 10-fold cross-validation strategy were developed by the eXtreme Gradient Boosting, random forest, and support vector machine algorithms. The logistic regression model with 14 benchmark predictors was used as a reference model. During a median follow-up of 1008 (750, 1937) days, 121 patients met the primary outcome. Overall, MLBPMs outperformed the logistic model. The "All-in" eXtreme Gradient Boosting model had the best performance, with an accuracy of 85.4% and a precision of 70.3%. The area under the receiver-operating characteristic curve was 0.916 (95% CI, 0.887-0.945). The Brier score was 0.12. Conclusions The MLBPMs could significantly improve outcome prediction in patients with heart failure with mildly reduced ejection fraction, which would further optimize the management of these patients.
| S-EPMC10356044 | biostudies-literature
Project description:We assessed differences in long-term all-cause and cardiovascular (CV) mortality in heart failure (HF) outpatients based on the etiology of HF. Consecutive patients admitted to the HF Clinic from August 2001 to September 2019 (N = 2587) were considered for inclusion. HF etiology was divided into ischemic heart disease (IHD), dilated cardiomyopathy (DCM), hypertensive heart disease, alcoholic cardiomyopathy, drug-induced cardiomyopathy (DICM), valvular heart disease, and hypertrophic cardiomyopathy. All-cause death and CV death were the primary end points. Among 2387 patients included in the analysis (mean age 66.5 ± 12.5 years, 71.3% men), 1317 deaths were recorded (731 from CV cause) over a maximum follow-up of 18 years (median 4.1 years, interquartile range (IQR) 2-7.8). Considering IHD as the reference, only DCM had a lower risk of all-cause death (adjusted hazard ratio (aHR) 0.68, 95% confidence interval (CI) 0.56-0.83, p < 0.001), and only DICM had a higher risk of all-cause death (aHR 1.47, 95% CI 1.02-2.11, p = 0.04). However, almost all etiologies had a significantly lower risk of CV death than IHD. Among the studied HF etiologies, DCM and DICM have the lowest and highest risk of all-cause death, respectively, whereas IHD has the highest adjusted risk of CV death.
| S-EPMC8837120 | biostudies-literature
Project description:ObjectiveThere is increasing attention to cardiovascular diseases in low-income countries. However, little is known about heart failure (HF) in rural areas, where most of the populations in low-income countries live. We studied HF epidemiology, care delivery and outcomes in rural Haiti.MethodsAmong adults admitted with HF to a rural Haitian tertiary care hospital during a 12-month period (2013-2014), we studied the clinical characteristics and short-term outcomes including length of stay, inhospital death and outpatient follow-up rates.ResultsHF accounted for 392/1049 (37%) admissions involving 311 individuals; over half (60%) were women. Mean age was 58.8 (SD 16.2) years for men and 48.3 (SD 18.8) years for women; 76 (41%) women were <40 years of age. Median length of stay was 10 days (first and second quartiles 7, 17), and inhospital mortality was 12% (n=37). Ninety nine (36%) of the 274 who survived their primary hospitalisation followed-up at the hospital's outpatient clinic, and 18 (6.6%) were readmitted to the same hospital within 30 days postdischarge. Decreased known follow-up (p<0.01) and readmissions (p=0.03) were associated with increased distance between patient residence and hospital. Among the one-quarter (81) patients with echocardiograms, causes of HF included: non-ischaemic cardiomyopathy (64%), right HF (12%), hypertensive heart disease (7%) and rheumatic heart disease (5%). One-half of the women with cardiomyopathy by echocardiogram had peripartum cardiomyopathy.ConclusionsHF is a common cause of hospitalisation in rural Haiti. Among diagnosed patients, HF is overwhelming due to non-atherosclerotic heart disease and particularly affects young adults. Implementing effective systems to improve HF diagnosis and linkage to essential outpatient care is needed to reduce long-term morbidity and mortality.
| S-EPMC4854668 | biostudies-literature
Project description:BackgroundCOPD is a leading cause of mortality.Research questionWe hypothesized that applying machine learning to clinical and quantitative CT imaging features would improve mortality prediction in COPD.Study design and methodsWe selected 30 clinical, spirometric, and imaging features as inputs for a random survival forest. We used top features in a Cox regression to create a machine learning mortality prediction (MLMP) in COPD model and also assessed the performance of other statistical and machine learning models. We trained the models in subjects with moderate to severe COPD from a subset of subjects in Genetic Epidemiology of COPD (COPDGene) and tested prediction performance in the remainder of individuals with moderate to severe COPD in COPDGene and Evaluation of COPD Longitudinally to Identify Predictive Surrogate Endpoints (ECLIPSE). We compared our model with the BMI, airflow obstruction, dyspnea, exercise capacity (BODE) index; BODE modifications; and the age, dyspnea, and airflow obstruction index.ResultsWe included 2,632 participants from COPDGene and 1,268 participants from ECLIPSE. The top predictors of mortality were 6-min walk distance, FEV1 % predicted, and age. The top imaging predictor was pulmonary artery-to-aorta ratio. The MLMP-COPD model resulted in a C index ≥ 0.7 in both COPDGene and ECLIPSE (6.4- and 7.2-year median follow-ups, respectively), significantly better than all tested mortality indexes (P < .05). The MLMP-COPD model had fewer predictors but similar performance to that of other models. The group with the highest BODE scores (7-10) had 64% mortality, whereas the highest mortality group defined by the MLMP-COPD model had 77% mortality (P = .012).InterpretationAn MLMP-COPD model outperformed four existing models for predicting all-cause mortality across two COPD cohorts. Performance of machine learning was similar to that of traditional statistical methods. The model is available online at: https://cdnm.shinyapps.io/cgmortalityapp/.
| S-EPMC7478228 | biostudies-literature
Project description:BackgroundAcute heart failure (AHF) is associated with significant morbidity and mortality. Effective patient risk stratification is essential to guiding hospitalization decisions and the clinical management of AHF. Clinical decision support systems can be used to improve predictions of mortality made in emergency care settings for the purpose of AHF risk stratification. In this study, several models for the prediction of seven-day mortality among AHF patients were developed by applying machine learning techniques to retrospective patient data from 236,275 total emergency department (ED) encounters, 1881 of which were considered positive for AHF and were used for model training and testing. The models used varying subsets of age, sex, vital signs, and laboratory values. Model performance was compared to the Emergency Heart Failure Mortality Risk Grade (EHMRG) model, a commonly used system for prediction of seven-day mortality in the ED with similar (or, in some cases, more extensive) inputs. Model performance was assessed in terms of area under the receiver operating characteristic curve (AUROC), sensitivity, and specificity.ResultsWhen trained and tested on a large academic dataset, the best-performing model and EHMRG demonstrated test set AUROCs of 0.84 and 0.78, respectively, for prediction of seven-day mortality. Given only measurements of respiratory rate, temperature, mean arterial pressure, and FiO2, one model produced a test set AUROC of 0.83. Neither a logistic regression comparator nor a simple decision tree outperformed EHMRG.ConclusionsA model using only the measurements of four clinical variables outperforms EHMRG in the prediction of seven-day mortality in AHF. With these inputs, the model could not be replaced by logistic regression or reduced to a simple decision tree without significant performance loss. In ED settings, this minimal-input risk stratification tool may assist clinicians in making critical decisions about patient disposition by providing early and accurate insights into individual patient's risk profiles.
| S-EPMC8010502 | biostudies-literature
Project description:Heart failure (HF) is the final stage of the various heart diseases developing. The mortality rates of prognosis HF patients are highly variable, ranging from 5% to 75%. Evaluating the all-cause mortality of HF patients is an important means to avoid death and positively affect the health of patients. But in fact, machine learning models are difficult to gain good results on missing values, high dimensions, and imbalances HF data. Therefore, a deep learning system is proposed. In this system, we propose an indicator vector to indicate whether the value is true or be padded, which fast solves the missing values and helps expand data dimensions. Then, we use a convolutional neural network with different kernel sizes to obtain the features information. And a multi-head self-attention mechanism is applied to gain whole channel information, which is essential for the system to improve performance. Besides, the focal loss function is introduced to deal with the imbalanced problem better. The experimental data of the system are from the public database MIMIC-III, containing valid data for 10311 patients. The proposed system effectively and fast predicts four death types: death within 30 days, death within 180 days, death within 365 days and death after 365 days. Our study uses Deep SHAP to interpret the deep learning model and obtains the top 15 characteristics. These characteristics further confirm the effectiveness and rationality of the system and help provide a better medical service.
| S-EPMC9956019 | biostudies-literature
Project description:Heart failure is a devastating disease that has high mortality rates and a negative impact on quality of life. Heart failure patients often experience emergency readmission after an initial episode, often due to inadequate management. A timely diagnosis and treatment of underlying issues can significantly reduce the risk of emergency readmissions. The purpose of this project was to predict emergency readmissions of discharged heart failure patients using classical machine learning (ML) models based on Electronic Health Record (EHR) data. The dataset used for this study consisted of 166 clinical biomarkers from 2008 patient records. Three feature selection techniques were studied along with 13 classical ML models using five-fold cross-validation. A stacking ML model was trained using the predictions of the three best-performing models for final classification. The stacking ML model provided an accuracy, precision, recall, specificity, F1-score, and area under the curve (AUC) of 89.41%, 90.10%, 89.41%, 87.83%, 89.28%, and 0.881, respectively. This indicates the effectiveness of the proposed model in predicting emergency readmissions. The healthcare providers can intervene pro-actively to reduce emergency hospital readmission risk and improve patient outcomes and decrease healthcare costs using the proposed model.
| S-EPMC10252957 | biostudies-literature