Dataset Information

External validation of EPIC’s Risk of Unplanned Readmission model, the LACE+ index and SQLape as predictors of unplanned hospital readmissions: A monocentric, retrospective, diagnostic cohort study in Switzerland

ABSTRACT:

Introduction

Readmissions after an acute care hospitalization are relatively common, costly to the health care system, and are associated with significant burden for patients. As one way to reduce costs and simultaneously improve quality of care, hospital readmissions receive increasing interest from policy makers. It is only relatively recently that strategies were developed with the specific aim of reducing unplanned readmissions using prediction models to identify patients at risk. EPIC’s Risk of Unplanned Readmission model promises superior performance. However, it has only been validated for the US setting. Therefore, the main objective of this study is to externally validate the EPIC’s Risk of Unplanned Readmission model and to compare it to the internationally, widely used LACE+ index, and the SQLAPE® tool, a Swiss national quality of care indicator.

Methods

A monocentric, retrospective, diagnostic cohort study was conducted. The study included inpatients, who were discharged between the 1st of January 2018 and the 31st of December 2019 from the Lucerne Cantonal Hospital, a tertiary-care provider in Central Switzerland. The study endpoint was an unplanned 30-day readmission. Models were replicated using the original intercept and beta coefficients as reported. Otherwise, score generator provided by the developers were used. For external validation, discrimination of the scores under investigation were assessed by calculating the area under the receiver operating characteristics curves (AUC). Calibration was assessed with the Hosmer-Lemeshow X2 goodness-of-fit test This report adheres to the TRIPOD statement for reporting of prediction models.

Results

At least 23,116 records were included. For discrimination, the EPIC´s prediction model, the LACE+ index and the SQLape® had AUCs of 0.692 (95% CI 0.676–0.708), 0.703 (95% CI 0.687–0.719) and 0.705 (95% CI 0.690–0.720). The Hosmer-Lemeshow X2 tests had values of p<0.001.

Conclusion

In summary, the EPIC´s model showed less favorable performance than its comparators. It may be assumed with caution that the EPIC´s model complexity has hampered its wide generalizability—model updating is warranted.

SUBMITTER: Hwang A

PROVIDER: S-EPMC8589185 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionHospital readmissions are common, expensive, and a key target of the Medicare Value Based Purchasing (VBP) program. Validated risk assessment tools such as the HOSPITAL score and LACE index have been developed to identify patients at high risk of hospital readmission so they can be targeted for interventions aimed at reducing the rate of readmission. This study aims to evaluate the utility of HOSPITAL score and LACE index for predicting hospital readmission within 30 days in a moderate-sized university affiliated hospital in the midwestern United States.Materials and methodsAll adult medical patients who underwent one or more ICD-10 defined procedures discharged from the SIU-SOM Hospitalist service from Memorial Medical Center (MMC) from October 15, 2015 to March 16, 2016, were studied retrospectively to determine if the HOSPITAL score and LACE index were a significant predictors of hospital readmission within 30 days.ResultsDuring the study period, 463 discharges were recorded for the hospitalist service. The analysis includes data for the 432 discharges. Patients who died during the hospital stay, were transferred to another hospital, or left against medical advice were excluded. Of these patients, 35 (8%) were readmitted to the same hospital within 30 days. A receiver operating characteristic evaluation of the HOSPITAL score for this patient population shows a C statistic of 0.75 (95% CI [0.67-0.83]), indicating good discrimination for hospital readmission. The Brier score for the HOSPITAL score in this setting was 0.069, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a χ2 value of 3.71 with a p value of 0.59. A receiver operating characteristic evaluation of the LACE index for this patient population shows a C statistic of 0.58 (95% CI [0.48-0.68]), indicating poor discrimination for hospital readmission. The Brier score for the LACE index in this setting was 0.082, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a χ2 value of 4.97 with a p value of 0.66.DiscussionThis single center retrospective study indicates that the HOSPITAL score has superior discriminatory ability when compared to the LACE index as a predictor of hospital readmission within 30 days at a medium-sized university-affiliated teaching hospital.ConclusionsThe internationally validated HOSPITAL score may be superior to the LACE index in moderate-sized community hospitals to identify patients at high risk of hospital readmission within 30 days.

Project description:PurposeThe all-cause readmission rate within 30 days of index admissions for chronic obstructive pulmonary disease (COPD) was approximately 21% in the United States in 2008. This study aimed to examine patient and clinical characteristics predicting 30-day unplanned readmissions for an initial COPD hospitalization and to determine those predictors' importance.Patients and methodsA retrospective study was conducted in patients with COPD-related hospitalizations using commercial claims data from 2010 to 2012. The primary outcome was all-cause unplanned readmission, with secondary outcomes being COPD as primary diagnosis and COPD as any diagnosis unplanned readmissions. Factors predicting unplanned readmissions encompassed demographic, pharmacy, and medical variables identified at baseline and during the index hospitalization. Dominance analysis was conducted to rank the predictors in terms of importance, defined as the contribution to change in model fit of a predictor by itself and in combination with other predictors.ResultsAfter applying the inclusion and exclusion criteria, 18,282 patients with index COPD-related admissions were identified. Among them, the rates of unplanned readmissions with COPD as primary diagnosis, COPD as any diagnosis, and all-cause were 2.6%, 5.6%, and 7.3%, respectively. For each outcome, the readmission group was slightly older, had a greater COPD severity score, and required a longer length of stay. Moreover, the readmission group had larger proportions of patients with comorbidities, dyspnea/shortness of breath, intensive care unit stay, or ventilator use, compared to the non-readmission group. Dominance analysis revealed that the three most important predictors - heart failure/heart disease, anemia, and COPD severity score - accounted for 56% of the predicted variance in all-cause unplanned readmissions.ConclusionOverall, COPD severity score and heart failure/heart disease emerged as important factors in predicting 30-day unplanned readmissions across all three outcomes. Results from dominance analysis suggest looking beyond COPD-specific complications and focusing on comorbid conditions highly associated with COPD in order to lower all-cause unplanned readmissions.

Project description:The LACE index has been shown to predict hospital readmissions and death with variable accuracy. A LACE index ≥ 10 is considered as high risk in the existing literature. We aimed to derive age-specific LACE index thresholds in the prediction of mortality and frequent readmissions. Analysis of prospectively collected data of consecutive alive-discharge episodes between 01/04/2017 and 31/03/2019 to a single hospital was conducted. The derivation of LACE index thresholds for predicting all-cause mortality within 6 months of hospital discharge or frequent readmissions (≥ 2 times within 28 days) was examined by receiver operating characteristics (ROC) in 32270 patients (14878 men, 17392 women) aged 18-107 year (mean = 64.0 years, SD = 20.5). For all patients with a LACE index ≥ 10, the area under the curve (AUC) for predicting mortality was 80.5% (95% CI 79.7-81.3) and for frequent readmissions was 84.0% (83.0-85.1). Two-graph ROC plots showed that the LACE index threshold where sensitivity equates specificity was 9.5 (95% intermediate range = 5.6-13.5) for predicting mortality and 10.3 (95% intermediate range = 6.6-13.6) for frequent readmissions. These thresholds were lowest among youngest individuals and rose progressively with age for mortality prediction: 18-49 years = 5.0, 50-59 years = 6.5, 60-69 years = 8.0, 70-79 years = 9.8 and ≥ 80 years = 11.6, and similarly for frequent readmissions: 18-49 years = 5.1, 50-59 years = 7.5, 60-69 years = 9.1, 70-79 years = 10.6 and ≥ 80 years = 12.0. Positive and negative likelihood ratios (LRs) ranged 1.5-3.3 and 0.4-0.6 for predicting mortality, and 2.5-4.4 and 0.3-0.6 for frequent readmissions, respectively, with stronger evidence in younger than in older individuals (LRs further from unity). In conclusion, the LACE index predicts mortality and frequent readmissions at lower thresholds and stronger in younger than in older individuals. Age should be taken into account when using the LACE index for identifying patients at high risk.

Project description:Readmission to hospital is a common occurrence due to adverse post-operative events. The primary objective of the present study was to examine the possible risk predictors for 30-day unplanned readmissions after the surgical treatment of gastric cancer. The secondary aim was to determine the clinical characteristics that are associated with readmission. Studies that reported the risk factors and clinical characteristics of patients with gastric cancer who had an unplanned 30-day post-operative readmission were identified systematically from PubMed, Cochrane Central Register of Controlled Trials, Web of Science and Embase databases, with a final search date of March 30, 2024. A systematic review and meta-analysis were then performed to estimate the risk predictors and relevant clinical characteristics for readmission. A total of 16,154 patients from 12 studies were included in the present study, with 1,736 patients who were readmitted and 14,418 patients who were not readmitted. A higher proportion of patients with an age ≥70 years, cardiovascular comorbidity, Nutritional Risk Screening (NRS) 2002 score ≥3, respiratory diseases, male sex, American Society of Anesthesiologists score ≥3, combined multi-organ resection, greater depth of invasion (T3-4/T1-2), discharge to home with provision of care services, neoadjuvant therapy, post-operative complications or a blood transfusion were found in the readmission group compared with that in the non-readmission group. A meta-analysis was also performed to calculate risk predictors using the results of multivariate regression analyses from the original literature. This identified cardiovascular comorbidity, NRS 2002 score ≥3, pancreatectomy and post-operative complications as risk predictors for 30-day unplanned readmission following surgery for gastric cancer. Therefore, it is recommended that extra attention and support should be given to patients with these high-risk predictors during the perioperative period.