Dataset Information

Implementation Experience with a 30-Day Hospital Readmission Risk Score in a Large, Integrated Health System: A Retrospective Study.

ABSTRACT:

Background

Driven by quality outcomes and economic incentives, predicting 30-day hospital readmissions remains important for healthcare systems. The Cleveland Clinic Health System (CCHS) implemented an internally validated readmission risk score in the electronic medical record (EMR).

Objective

We evaluated the predictive accuracy of the readmission risk score across CCHS hospitals, across primary discharge diagnosis categories, between surgical/medical specialties, and by race and ethnicity.

Design

Retrospective cohort study.

Participants

Adult patients discharged from a CCHS hospital April 2017-September 2020.

Main measures

Data was obtained from the CCHS EMR and billing databases. All patients discharged from a CCHS hospital were included except those from Oncology and Labor/Delivery, patients with hospice orders, or patients who died during admission. Discharges were categorized as surgical if from a surgical department or surgery was performed. Primary discharge diagnoses were classified per Agency for Healthcare Research and Quality Clinical Classifications Software Level 1 categories. Discrimination performance predicting 30-day readmission is reported using the c-statistic.

Results

The final cohort included 600,872 discharges from 11 Northeast Ohio and Florida CCHS hospitals. The readmission risk score for the cohort had a c-statistic of 0.6875 with consistent yearly performance. The c-statistic for hospital sites ranged from 0.6762, CI [0.6634, 0.6876], to 0.7023, CI [0.6903, 0.7132]. Medical and surgical discharges showed consistent performance with c-statistics of 0.6923, CI [0.6807, 0.7045], and 0.6802, CI [0.6681, 0.6925], respectively. Primary discharge diagnosis showed variation, with lower performance for congenital anomalies and neoplasms. COVID-19 had a c-statistic of 0.6387. Subgroup analyses showed c-statistics of > 0.65 across race and ethnicity categories.

Conclusions

The CCHS readmission risk score showed good performance across diverse hospitals, across diagnosis categories, between surgical/medical specialties, and by patient race and ethnicity categories for 3 years after implementation, including during COVID-19. Evaluating clinical decision-making tools post-implementation is crucial to determine their continued relevance, identify opportunities to improve performance, and guide their appropriate use.

SUBMITTER: Misra-Hebert AD

PROVIDER: S-EPMC8821785 | biostudies-literature | 2022 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implementation Experience with a 30-Day Hospital Readmission Risk Score in a Large, Integrated Health System: A Retrospective Study.

Misra-Hebert Anita D AD Felix Christina C Milinovich Alex A Kattan Michael W MW Willner Marc A MA Chagin Kevin K Bauman Janine J Hamilton Aaron C AC Alberts Jay J

Journal of general internal medicine 20220207 12

<h4>Background</h4>Driven by quality outcomes and economic incentives, predicting 30-day hospital readmissions remains important for healthcare systems. The Cleveland Clinic Health System (CCHS) implemented an internally validated readmission risk score in the electronic medical record (EMR).<h4>Objective</h4>We evaluated the predictive accuracy of the readmission risk score across CCHS hospitals, across primary discharge diagnosis categories, between surgical/medical specialties, and by race an ...[more]

PMID: 35132549

Similar Datasets

Project description:IntroductionHospital readmissions are common, expensive, and a key target of the Medicare Value Based Purchasing (VBP) program. Risk assessment tools have been developed to identify patients at high risk of hospital readmission so they can be targeted for interventions aimed at reducing the rate of readmission. One such tool is the HOSPITAL score that uses seven readily available clinical variables to predict the risk of readmission within 30 days of discharge. The HOSPITAL score has been internationally validated in large academic medical centers. This study aims to determine if the HOSPITAL score is similarly useful in a moderate sized university affiliated hospital in the midwestern United States.Materials and methodsAll adult medical patients discharged from the SIU-SOM Hospitalist service from Memorial Medical Center (MMC) from October 15, 2015 to March 16, 2016, were studied retrospectively to determine if the HOSPITAL score was a significant predictor of hospital readmission within 30 days.ResultsDuring the study period, 998 discharges were recorded for the hospitalist service. The analysis includes data for the 931 discharges. Patients who died during the hospital stay, were transferred to another hospital, or left against medical advice were excluded. Of these patients, 109 (12%) were readmitted to the same hospital within 30 days. The patients who were readmitted were more likely to have a length of stay greater than or equal to 5 days (55% vs. 41%, p = 0.005) and were more likely to have been admitted more than once to the hospital within the last year (100% vs. 49%, p < 0.001). A receiver operating characteristic evaluation of the HOSPITAL score for this patient population shows a C statistic of 0.77 (95% CI [0.73-0.81]), indicating good discrimination for hospital readmission. The Brier score for the HOSPITAL score in this setting was 0.10, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a ? (2) value of 1.63 with a p value of 0.20.DiscussionThis single center retrospective study indicates that the HOSPITAL score has good discriminatory ability to predict hospital readmissions within 30 days for a medical hospitalist service at a university-affiliated hospital. This data for all causes of hospital readmission is comparable to the discriminatory ability of the HOSPITAL score in the international validation study (C statistics of 0.72 vs. 0.77) conducted at considerably larger hospitals (975 average beds vs. 507 at MMC) for potentially avoidable hospital readmissions.ConclusionsThe internationally validated HOSPITAL score may be a useful tool in moderate sized community hospitals to identify patients at high risk of hospital readmission within 30 days. This easy to use scoring system using readily available data can be used as part of interventional strategies to reduce the rate of hospital readmission.

Project description:IntroductionHospital readmissions are common, expensive, and a key target of the Medicare Value Based Purchasing (VBP) program. Validated risk assessment tools such as the HOSPITAL score and LACE index have been developed to identify patients at high risk of hospital readmission so they can be targeted for interventions aimed at reducing the rate of readmission. This study aims to evaluate the utility of HOSPITAL score and LACE index for predicting hospital readmission within 30 days in a moderate-sized university affiliated hospital in the midwestern United States.Materials and methodsAll adult medical patients who underwent one or more ICD-10 defined procedures discharged from the SIU-SOM Hospitalist service from Memorial Medical Center (MMC) from October 15, 2015 to March 16, 2016, were studied retrospectively to determine if the HOSPITAL score and LACE index were a significant predictors of hospital readmission within 30 days.ResultsDuring the study period, 463 discharges were recorded for the hospitalist service. The analysis includes data for the 432 discharges. Patients who died during the hospital stay, were transferred to another hospital, or left against medical advice were excluded. Of these patients, 35 (8%) were readmitted to the same hospital within 30 days. A receiver operating characteristic evaluation of the HOSPITAL score for this patient population shows a C statistic of 0.75 (95% CI [0.67-0.83]), indicating good discrimination for hospital readmission. The Brier score for the HOSPITAL score in this setting was 0.069, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a χ2 value of 3.71 with a p value of 0.59. A receiver operating characteristic evaluation of the LACE index for this patient population shows a C statistic of 0.58 (95% CI [0.48-0.68]), indicating poor discrimination for hospital readmission. The Brier score for the LACE index in this setting was 0.082, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a χ2 value of 4.97 with a p value of 0.66.DiscussionThis single center retrospective study indicates that the HOSPITAL score has superior discriminatory ability when compared to the LACE index as a predictor of hospital readmission within 30 days at a medium-sized university-affiliated teaching hospital.ConclusionsThe internationally validated HOSPITAL score may be superior to the LACE index in moderate-sized community hospitals to identify patients at high risk of hospital readmission within 30 days.

Project description:BackgroundLowering hospital readmission rates has become a primary target for the Centers for Medicare & Medicaid Services, but studies of the relationship between adherence to the recommended hospital care processes and readmission rates have provided inconsistent and inconclusive results.ObjectiveTo examine the association between hospital performance on Medicare's Hospital Compare process quality measures and 30-day readmission rates for patients with acute myocardial infarction (AMI), heart failure and pneumonia, and for those undergoing major surgery.Design, setting and participantsWe assessed hospital performance on process measures using the 2007 Hospital Inpatient Quality Reporting Program. The process measures for each condition were aggregated in two separate measures: Overall Measure (OM) and Appropriate Care Measure (ACM) scores. Readmission rates were calculated using Medicare claims.Main outcome measureRisk-standardized 30-day all-cause readmission rate was calculated as the ratio of predicted to expected rate standardized by the overall mean readmission rate. We calculated predicted readmission rate using hierarchical generalized linear models and adjusting for patient-level factors.ResultsAmong patients aged ≥ 66 years, the median OM score ranged from 79.4 % for abdominal surgery to 95.7 % for AMI, and the median ACM scores ranged from 45.8 % for abdominal surgery to 87.9 % for AMI. We observed a statistically significant, but weak, correlation between performance scores and readmission rates for pneumonia (correlation coefficient R = 0.07), AMI (R = 0.10), and orthopedic surgery (R = 0.06). The difference in the mean readmission rate between hospitals in the 1st and 4th quartiles of process measure performance was statistically significant only for AMI (0.25 percentage points) and pneumonia (0.31 percentage points). Performance on process measures explained less than 1 % of hospital-level variation in readmission rates.ConclusionsHospitals with greater adherence to recommended care processes did not achieve meaningfully better 30-day hospital readmission rates compared to those with lower levels of performance.

Project description:BackgroundExisting readmission reduction solutions tend to focus on complementing inpatient care with enhanced care transition and postdischarge interventions. These solutions are initiated near or after discharge, when clinicians' impact on inpatient care is ending. Preventive intervention during hospitalization is an underexplored area that holds potential for reducing readmission risk. However, it is challenging to predict readmission risk at the early stage of hospitalization because few data are available.ObjectiveThe objective of this study was to build an early prediction model of unplanned 30-day hospital readmission using a large and diverse sample. We were also interested in identifying novel readmission risk factors and protective factors.MethodsWe extracted the medical records of 96,550 patients in 205 participating Cerner client hospitals across four US census regions in 2016 from the Health Facts database. The model was built with index admission data that can become available within 24 hours and data from previous encounters up to 1 year before the index admission. The candidate models were evaluated for performance, timeliness, and generalizability. Multivariate logistic regression analysis was used to identify readmission risk factors and protective factors.ResultsWe developed six candidate readmission models with different machine learning algorithms. The best performing model of extreme gradient boosting (XGBoost) achieved an area under the receiver operating characteristic curve of 0.753 on the development data set and 0.742 on the validation data set. By multivariate logistic regression analysis, we identified 14 risk factors and 2 protective factors of readmission that have never been reported.ConclusionsThe performance of our model is better than that of the most widely used models in US health care settings. This model can help clinicians identify readmission risk at the early stage of hospitalization so that they can pay extra attention during the care process of high-risk patients. The 14 novel risk factors and 2 novel protective factors can aid understanding of the factors associated with readmission.

Dataset Information

Implementation Experience with a 30-Day Hospital Readmission Risk Score in a Large, Integrated Health System: A Retrospective Study.

Background

Objective

Design

Participants

Main measures

Results

Conclusions

Publications

Implementation Experience with a 30-Day Hospital Readmission Risk Score in a Large, Integrated Health System: A Retrospective Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets