Dataset Information

Development of Electronic Health Record-Based Prediction Models for 30-Day Readmission Risk Among Patients Hospitalized for Acute Myocardial Infarction.

ABSTRACT:

Importance

In the US, more than 600?000 adults will experience an acute myocardial infarction (AMI) each year, and up to 20% of the patients will be rehospitalized within 30 days. This study highlights the need for consideration of calibration in these risk models.

Objective

To compare multiple machine learning risk prediction models using an electronic health record (EHR)-derived data set standardized to a common data model.

Design, setting, and participants

This was a retrospective cohort study that developed risk prediction models for 30-day readmission among all inpatients discharged from Vanderbilt University Medical Center between January 1, 2007, and December 31, 2016, with a primary diagnosis of AMI who were not transferred from another facility. The model was externally validated at Dartmouth-Hitchcock Medical Center from April 2, 2011, to December 31, 2016. Data analysis occurred between January 4, 2019, and November 15, 2020.

Exposures

Acute myocardial infarction that required hospital admission.

Main outcomes and measures

The main outcome was thirty-day hospital readmission. A total of 141 candidate variables were considered from administrative codes, medication orders, and laboratory tests. Multiple risk prediction models were developed using parametric models (elastic net, least absolute shrinkage and selection operator, and ridge regression) and nonparametric models (random forest and gradient boosting). The models were assessed using holdout data with area under the receiver operating characteristic curve (AUROC), percentage of calibration, and calibration curve belts.

Results

The final Vanderbilt University Medical Center cohort included 6163 unique patients, among whom the mean (SD) age was 67 (13) years, 4137 were male (67.1%), 1019 (16.5%) were Black or other race, and 933 (15.1%) were rehospitalized within 30 days. The final Dartmouth-Hitchcock Medical Center cohort included 4024 unique patients, with mean (SD) age of 68 (12) years; 2584 (64.2%) were male, 412 (10.2%) were rehospitalized within 30 days, and most of the cohort were non-Hispanic and White. The final test set AUROC performance was between 0.686 to 0.695 for the parametric models and 0.686 to 0.704 for the nonparametric models. In the validation cohort, AUROC performance was between 0.558 to 0.655 for parametric models and 0.606 to 0.608 for nonparametric models.

Conclusions and relevance

In this study, 5 machine learning models were developed and externally validated to predict 30-day readmission AMI hospitalization. These models can be deployed within an EHR using routinely collected data.

SUBMITTER: Matheny ME

PROVIDER: S-EPMC7846941 | biostudies-literature | 2021 Jan

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of Electronic Health Record-Based Prediction Models for 30-Day Readmission Risk Among Patients Hospitalized for Acute Myocardial Infarction.

Matheny Michael E ME Ricket Iben I Goodrich Christine A CA Shah Rashmee U RU Stabler Meagan E ME Perkins Amy M AM Dorn Chad C Denton Jason J Bray Bruce E BE Gouripeddi Ram R Higgins John J Chapman Wendy W WW MacKenzie Todd A TA Brown Jeremiah R JR

JAMA network open 20210104 1

<h4>Importance</h4>In the US, more than 600 000 adults will experience an acute myocardial infarction (AMI) each year, and up to 20% of the patients will be rehospitalized within 30 days. This study highlights the need for consideration of calibration in these risk models.<h4>Objective</h4>To compare multiple machine learning risk prediction models using an electronic health record (EHR)-derived data set standardized to a common data model.<h4>Design, setting, and participants</h4>This was a ret ...[more]

PMID: 33512518

Similar Datasets

Project description:BackgroundEarly readmissions among older adults hospitalized for acute myocardial infarction (AMI) are costly and difficult to predict. Aging-related functional impairments may inform risk prediction but are unavailable in most studies. Our objective was to, therefore, develop and validate an AMI readmission risk model for older patients who considered functional impairments and was suitable for use before hospital discharge.Methods and resultsSILVER-AMI (Comprehensive Evaluation of Risk in Older Adults with AMI) is a prospective cohort study of 3006 patients of age ≥75 years hospitalized with AMI at 94 US hospitals. Participants underwent in-hospital assessment of functional impairments including cognition, vision, hearing, and mobility. Other variables plausibly associated with readmissions were also collected. The outcome was all-cause readmission at 30 days. We used backward selection and Bayesian model averaging to derive (N=2004) a risk model that was subsequently validated (N=1002). Mean age was 81.5 years, 44.4% were women, and 10.5% were nonwhite. Within 30 days, 547 participants (18.2%) were readmitted. Readmitted participants were older, had more comorbidities, and had a higher prevalence of functional impairments, including activities of daily living disability (17.0% versus 13.0%; P=0.013) and impaired functional mobility (72.5% versus 53.6%; P<0.001). The final risk model included 8 variables: functional mobility, ejection fraction, chronic obstructive pulmonary disease, arrhythmia, acute kidney injury, first diastolic blood pressure, P2Y12 inhibitor use, and general health status. Functional mobility was the only functional impairment variable retained but was the strongest predictor. The model was well calibrated (Hosmer-Lemeshow P value >0.05) with moderate discrimination (C statistics: 0.65 derivation cohort and 0.63 validation cohort). Functional mobility significantly improved performance of the risk model (net reclassification improvement index =20%; P<0.001).ConclusionsIn our final risk model, functional mobility, previously not included in readmission risk models, was the strongest predictor of 30-day readmission among older adults after AMI. The modest discrimination indicates that much of the variability in readmission risk among this population remains unexplained by patient-level factors.Clinical trial registrationURL: https://www.clinicaltrials.gov. Unique identifier: NCT01755052.

Project description:BackgroundHospitals are subject to federal financial penalties for excessive 30-day hospital readmissions for acute myocardial infarction (AMI). Prospectively identifying patients hospitalized with AMI at high risk for readmission could help prevent 30-day readmissions by enabling targeted interventions. However, the performance of AMI-specific readmission risk prediction models is unknown.Methods and resultsWe systematically searched the published literature through March 2017 for studies of risk prediction models for 30-day hospital readmission among adults with AMI. We identified 11 studies of 18 unique risk prediction models across diverse settings primarily in the United States, of which 16 models were specific to AMI. The median overall observed all-cause 30-day readmission rate across studies was 16.3% (range, 10.6%-21.0%). Six models were based on administrative data; 4 on electronic health record data; 3 on clinical hospital data; and 5 on cardiac registry data. Models included 7 to 37 predictors, of which demographics, comorbidities, and utilization metrics were the most frequently included domains. Most models, including the Centers for Medicare and Medicaid Services AMI administrative model, had modest discrimination (median C statistic, 0.65; range, 0.53-0.79). Of the 16 reported AMI-specific models, only 8 models were assessed in a validation cohort, limiting generalizability. Observed risk-stratified readmission rates ranged from 3.0% among the lowest-risk individuals to 43.0% among the highest-risk individuals, suggesting good risk stratification across all models.ConclusionsCurrent AMI-specific readmission risk prediction models have modest predictive ability and uncertain generalizability given methodological limitations. No existing models provide actionable information in real time to enable early identification and risk-stratification of patients with AMI before hospital discharge, a functionality needed to optimize the potential effectiveness of readmission reduction interventions.

Project description:Readmissions for pulmonary hypertension are poorly understood and understudied. We sought to determine national estimates and risk factors for 30-day readmission after pulmonary hypertension-related hospitalizations. We utilized the Healthcare Cost and Utilization Project Nationwide Readmission Database, which has weighted estimates of roughly 35 million discharges in the US. Adult patients with primary International Classification of Disease, Ninth Revision, Clinical Modification diagnosis codes of 416.0 and 416.8 for primary and secondary pulmonary hypertension with an index admission between 2012 and 2014 and any readmission within 30 days of the index event were identified. Predictors of 30-day readmission were identified using multivariable logistic regression with adjustment for covariates. Results showed that the national estimate for Primary Pulmonary Hypertension vs Secondary Pulmonary Hypertension-related index events between 2012 and 2014 with 30-day readmission was 247 vs 2550 corresponding to a national readmission risk estimate of 17% vs 18.3%, respectively. The presence of fluid and electrolyte disorders, renal failure, and alcohol abuse were associated with increased risk of readmission in Primary Pulmonary Hypertension, while factors associated with Secondary Pulmonary Hypertension readmissions included anemia, congestive heart failure, lung disease, fluid and electrolyte disorders, renal failure, diabetes, and liver disease. The median cost of Primary Pulmonary Hypertension admissions and readmissions were $46,132 (IQR: $25,384-$85,647) and $41,604.50 (IQR: $22,481.50-$84,420.50), respectively. The median costs of Secondary Pulmonary Hypertension admissions and readmissions were $34,893 (IQR: $19,670-$66,143) and $36,279 (IQR: $19,059-$74,679), respectively. In conclusion, approximately 19% of Primary Pulmonary Hypertension and Secondary Pulmonary Hypertension hospitalizations result in 30-day readmission, with significant costs accrued during the index hospitalization and readmission. With evolving clinical terminology and diagnostic codes, future study will need to better clarify underlying factors associated with readmissions amongst pulmonary hypertension sub-types, and identify methods and procedures to minimize readmission risk.

Project description:RESEARCH OBJECTIVE:Pharmacists are an expensive and limited resource in the hospital and outpatient setting. A pharmacist can spend up to 25% of their day planning. Time spent planning is time not spent delivering an intervention. A readmission risk adjustment model has potential to be used as a universal outcome-based prioritization tool to help pharmacists plan their interventions more efficiently. Pharmacy-specific predictors have not been used in the constructs of current readmission risk models. We assessed the impact of adding pharmacy-specific predictors on performance of readmission risk prediction models. STUDY DESIGN:We used an observational retrospective cohort study design to assess whether pharmacy-specific predictors such as an aggregate pharmacy score and drug classes would improve the prediction of 30-day readmission. A model of age, sex, length of stay, and admission category predictors was used as the reference model. We added predictor variables in sequential models to evaluate the incremental effect of additional predictors on the performance of the reference. We used logistic regression to regress the outcomes on predictors in our derivation dataset. We derived and internally validated our models through a 50:50 split validation of our dataset. POPULATION STUDIED:Our study population (n=350,810) was of adult admissions at hospitals in a large integrated health care delivery system. PRINCIPAL FINDINGS:Individually, the aggregate pharmacy score and drug classes caused a nearly identical but moderate increase in model performance over the reference. As a single predictor, the comorbidity burden score caused the greatest increase in model performance when added to the reference. Adding the severity of illness score, comorbidity burden score and the aggregate pharmacy score to the reference caused a cumulative increase in model performance with good discrimination (c statistic, 0.712; Nagelkerke R, 0.112). The best performing model included all predictors: severity of illness score, comorbidity burden score, aggregate pharmacy score, diagnosis groupings, and drug subgroups. CONCLUSIONS:Adding the aggregate pharmacy score to the reference model significantly increased the c statistic but was out-performed by the comorbidity burden score model in predicting readmission. The need for a universal prioritization tool for pharmacists may therefore be potentially met with the comorbidity burden score model. However, the aggregate pharmacy score and drug class models still out-performed current Medicare readmission risk adjustment models. IMPLICATIONS FOR POLICY OR PRACTICE:Pharmacists have a great role in preventing readmission, and therefore can potentially use one of our models: comorbidity burden score model, aggregate pharmacy score model, drug class model or complex model (a combination of all 5 major predictors) to prioritize their interventions while exceeding Medicare performance measures on readmission. The choice of model to use should be based on the availability of these predictors in the health care system.

Project description:BACKGROUND:Readmissions after hospitalization for pneumonia are common, but the few risk-prediction models have poor to modest predictive ability. Data routinely collected in the electronic health record (EHR) may improve prediction. OBJECTIVE:To develop pneumonia-specific readmission risk-prediction models using EHR data from the first day and from the entire hospital stay ("full stay"). DESIGN:Observational cohort study using stepwise-backward selection and cross-validation. SUBJECTS:Consecutive pneumonia hospitalizations from 6 diverse hospitals in north Texas from 2009-2010. MEASURES:All-cause nonelective 30-day readmissions, ascertained from 75 regional hospitals. RESULTS:Of 1463 patients, 13.6% were readmitted. The first-day pneumonia-specific model included sociodemographic factors, prior hospitalizations, thrombocytosis, and a modified pneumonia severity index; the full-stay model included disposition status, vital sign instabilities on discharge, and an updated pneumonia severity index calculated using values from the day of discharge as additional predictors. The full-stay pneumonia-specific model outperformed the first-day model (C statistic 0.731 vs 0.695; P = 0.02; net reclassification index = 0.08). Compared to a validated multi-condition readmission model, the Centers for Medicare and Medicaid Services pneumonia model, and 2 commonly used pneumonia severity of illness scores, the full-stay pneumonia-specific model had better discrimination (C statistic range 0.604-0.681; P < 0.01 for all comparisons), predicted a broader range of risk, and better reclassified individuals by their true risk (net reclassification index range, 0.09-0.18). CONCLUSIONS:EHR data collected from the entire hospitalization can accurately predict readmission risk among patients hospitalized for pneumonia. This approach outperforms a first-day pneumonia-specific model, the Centers for Medicare and Medicaid Services pneumonia model, and 2 commonly used pneumonia severity of illness scores. Journal of Hospital Medicine 2017;12:209-216.

Project description:ImportanceThe association of the Hospital Readmission Reduction Program (HRRP) with reductions in racial disparities in 30-day outcomes for myocardial infarction (MI), is unknown, including whether this varies by HRRP hospital penalty status.ObjectiveTo assess temporal trends in 30-day readmission and mortality rates among black and nonblack patients discharged after hospitalization for acute MI at low-performing and high-performing hospitals, as defined by readmission penalty status after HRRP implementation.Design, setting, and participantsThis observational cohort analysis used data from the multicenter National Cardiovascular Data Registry Chest Pain-MI Registry centers that were subject to the first cycle of HRRP, between January 1, 2008, and November 30, 2016. All patients hospitalized with MI who were included in National Cardiovascular Data Registry Chest Pain-MI Registry were included in the analysis. Data were analyzed from April 2018 to September 2019.ExposuresHospital performance category and race (black compared with nonblack patients). Centers were classified as high performing or low performing based on the excess readmission ratio (predicted to expected 30-day risk adjusted readmission rate) for MI during the first HRRP cycle (in October 2012).Main outcomes and measuresThirty-day all-cause readmission and mortality rates.ResultsAmong 753 hospitals that treated 155 397 patients with acute MI (of whom 11 280 [7.3%] were black), 399 hospitals (53.0%) were high performing. Thirty-day readmission rates declined over time in both black and nonblack patients (annualized 30-day readmission rate: 17.9% vs 20.8%). Black (compared with nonblack) race was associated with higher unadjusted odds of 30-day readmission in both low-performing and high-performing centers (odds ratios: before HRRP: low-performing hospitals, 1.14 [95% CI, 1.03-1.26]; P = .01; high-performing hospitals, 1.17 [95% CI, 1.04-1.32]; P = .01; after HRRP: low-performing hospitals, 1.23 [95% CI, 1.13-1.34]; P < .001; high-performing hospitals, 1.25 [95% CI, 1.12-1.39]; P < .001). However, these racial differences were not significant after adjustment for patient characteristics. The 30-day mortality rates declined significantly over time in nonblack patients, with stable (nonsignificant) temporal trends among black patients. Adjusted associations between race and 30-day mortality showed that 30-day mortality rates were significantly lower among black (compared with nonblack) patients in the low-performing hospitals (odds ratios: pre-HRRP, 0.79 [95% CI, 0.63-0.97]; P = .03; post-HRRP, 0.80 [95% CI, 0.68-0.95]; P = .01) but not in high-performing hospitals. Finally, the association between race and 30-day outcomes did not vary after the HRRP period began in either high-performing or low-performing hospitals.Conclusions and relevanceIn this analysis, 30-day readmission rates among patients with MI declined over time for both black and nonblack patients. Differences in race-specific 30-day readmission rates persisted but appeared to be attributable to patient-level factors. The 30-day mortality rates have declined for nonblack patients and remained stable among black patients. Implementation of the HRRP was not associated with improvement or worsening of racial disparities in readmission and mortality rates.

Project description:Hospital readmission rates within 30 days after acute myocardial infarction are a national performance metric. Previous data suggest that early physician follow-up after heart failure hospitalizations can reduce readmissions; whether these results can be extended to acute myocardial infarction is unclear.We analyzed data from the Can Rapid Risk Stratification of Unstable Angina Patients Suppress Adverse Outcomes With Early Implementation of the ACC/AHA Guidelines (CRUSADE) Registry linked with Medicare claims from 2003 to 2006 for 25 872 non-ST-segment-elevation myocardial infarction patients ?65 years of age discharged home from 228 hospitals with >25 patients and full revascularization capabilities. After adjusting for patient, treatment, and hospital characteristics, we examined the relationship between hospital-level physician follow-up within 7 days of discharge and 30-day all-cause readmission using logistic regression. The median hospital-level percentage of patients receiving early physician follow-up was 23.3% (interquartile range, 17.1%-29.1%). Among 24 165 patients with Medicare fee-for-service eligibility 30 days after discharge, 18.5% of patients were readmitted within 30 days of index hospitalization. Unadjusted and adjusted rates of 30-day readmission did not differ among quartiles of hospital-level early physician follow-up. Similarly, each 5% increase in hospital early follow-up was associated with an insignificant change in risk for readmission (adjusted odds ratio, 0.99; 95% confidence interval, 0.97-1.02; P=0.60). Sensitivity analyses extended these null findings to 30-day cardiovascular readmissions, high-risk subgroups, and early cardiology follow-up.Although rates of early physician follow-up after acute myocardial infarction varied among US hospitals, hospitals with higher early follow-up rates did not have lower 30-day readmission rates. Targeting strategies other than early physician follow-up may be necessary to reduce readmissions in this population.

Dataset Information

Development of Electronic Health Record-Based Prediction Models for 30-Day Readmission Risk Among Patients Hospitalized for Acute Myocardial Infarction.

Importance

Objective

Design, setting, and participants

Exposures

Main outcomes and measures

Results

Conclusions and relevance

Publications

Development of Electronic Health Record-Based Prediction Models for 30-Day Readmission Risk Among Patients Hospitalized for Acute Myocardial Infarction.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets