Predicting hospital readmission risk: A prospective observational study to compare primary care providers' assessments with the LACE readmission risk index.
Ontology highlight
ABSTRACT: Purpose
This study aims to determine if the primary care provider (PCP) assessment of readmission risk is comparable to the validated LACE tool at predicting readmission to hospital.Methods
A prospective observational study of recently discharged adult patients clustered by PCPs in the primary care setting. Physician readmission risk assessment was determined via a questionnaire after the PCP reviewed the hospital discharge summary. LACE scores were calculated using administrative data and the discharge summary. The sensitivity and specificity of the physician assessment and the LACE tool in predicting readmission risk, agreement between the 2 assessments and the area under receiver operating characteristic (AUROC) curves were calculated.Results
217 patient readmission encounters were included in this study from September 2017 till June 2018. The rate of readmission within 30 days was 14.7%, and 217 discharge summaries were used for analysis. The weighted kappa coefficient was 0.41 (95% CI: 0.30-0.51) demonstrating a moderate level of agreement. Sensitivity of physician assessment was 0.31 (95% CI: 0.22-0.40) and specificity was 0.80 (95% CI: 0.77-0.83). The sensitivity of the LACE assessment was 0.42 (95% CI: 0.25-0.59) and specificity was 0.79 (95% CI: 0.73-0.85). The AUROC for the LACE readmission risk was 0.65 (95% C.I. 0.55-0.76) demonstrating modest predictive power and was 0.57 (95% C.I. 0.46-0.68) for physician assessment, demonstrating low predictive power.Conclusion
The LACE index shows moderate discriminatory power in identifying high-risk patients for readmission when compared to the PCP's assessment. If this score can be provided to the PCP, it may help identify patients who requires more intensive follow-up after discharge.
SUBMITTER: Walji S
PROVIDER: S-EPMC8673665 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:This study evaluated the utility and performance of the LACE index and HOSPITAL score with consideration of the type of diagnoses and assessed the accuracy of these models for predicting readmission risks in patient cohorts from 2 large academic medical centers. Admissions to 2 hospitals from 2011 to 2015, derived from the Vizient Clinical Data Base and regional health information exchange, were included in this study (291 886 encounters). Models were assessed using Bayesian information criterion and area under the receiver operating characteristic curve. They were compared in CMS diagnosis-based cohorts and in 2 non-CMS cancer diagnosis-based cohorts. Overall, both models for readmission risk performed well, with LACE performing slightly better (area under the receiver operating characteristic curve 0.73 versus 0.69; P ≤ 0.001). HOSPITAL consistently outperformed LACE among 4 CMS target diagnoses, lung cancer, and colon cancer. Both LACE and HOSPITAL predict readmission risks well in the overall population, but performance varies by salient, diagnosis-based risk factors.
| S-EPMC9241658 | biostudies-literature
Project description:BackgroundThe LACE index (length of stay, acuity of admission, comorbidity index, and emergency room visit in the past 6 months) has been used to predict the risk of 30-day readmission after hospital discharge in both medical and surgical patients. This study aimed to utilize the LACE index to predict the risk of 30-day readmission in hospitalized patients with acute myocardial infraction (AMI).MethodsThis was a retrospective study. Data were extracted from the hospital's electronic medical records of patients admitted with AMI between 2015 and 2019. LACE index was built on admission patient demographic data, and clinical and laboratory findings during the index of admission. The multivariate logistic regression was performed to determine the association and the risk prediction ability of the LACE index, and 30-day readmission were analyzed by receiver operator characteristic curves with C-statistic.ResultsOf the 3,607 patients included in the study, 5.7% (205) were readmitted within 30 days of discharge from the hospital. The adjusted odds ratio based on logistic regression of all baseline variables showed a statistically significant association with the LACE score and revealed an increased risk of readmission within 30 days of hospital discharge. However, patients with high LACE scores (≥10) had a significantly higher rate of emergency revisits within 30 days from the index discharge than those with low LACE scores. Despite this, analysis of the receiver operating characteristic curve indicated that the LACE index had favorable discrimination ability C-statistic 0.78 (95%CI; 0.75-0.81). The Hosmer-Lemeshow goodness- of-fit test P value was p = 0.920, indicating that the model was well-calibrated to predict risk of the 30-day readmission.ConclusionThe LACE index demonstrated the good discrimination power to predict the risk of 30-day readmissions for hospitalized patients with AMI. These results can help clinicians to predict the risk of 30-day readmission at the early stage of hospitalization and pay attention during the care of high-risk patients. Future work is to be focused on additional factors to predict the risk of 30-day readmissions; they should be considered to improve the model performance of the LACE index with other acute conditions by using administrative data.
| S-EPMC9309494 | biostudies-literature
Project description:IntroductionHospital readmissions are common, expensive, and a key target of the Medicare Value Based Purchasing (VBP) program. Validated risk assessment tools such as the HOSPITAL score and LACE index have been developed to identify patients at high risk of hospital readmission so they can be targeted for interventions aimed at reducing the rate of readmission. This study aims to evaluate the utility of HOSPITAL score and LACE index for predicting hospital readmission within 30 days in a moderate-sized university affiliated hospital in the midwestern United States.Materials and methodsAll adult medical patients who underwent one or more ICD-10 defined procedures discharged from the SIU-SOM Hospitalist service from Memorial Medical Center (MMC) from October 15, 2015 to March 16, 2016, were studied retrospectively to determine if the HOSPITAL score and LACE index were a significant predictors of hospital readmission within 30 days.ResultsDuring the study period, 463 discharges were recorded for the hospitalist service. The analysis includes data for the 432 discharges. Patients who died during the hospital stay, were transferred to another hospital, or left against medical advice were excluded. Of these patients, 35 (8%) were readmitted to the same hospital within 30 days. A receiver operating characteristic evaluation of the HOSPITAL score for this patient population shows a C statistic of 0.75 (95% CI [0.67-0.83]), indicating good discrimination for hospital readmission. The Brier score for the HOSPITAL score in this setting was 0.069, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a χ2 value of 3.71 with a p value of 0.59. A receiver operating characteristic evaluation of the LACE index for this patient population shows a C statistic of 0.58 (95% CI [0.48-0.68]), indicating poor discrimination for hospital readmission. The Brier score for the LACE index in this setting was 0.082, indicating good overall performance. The Hosmer-Lemeshow goodness of fit test shows a χ2 value of 4.97 with a p value of 0.66.DiscussionThis single center retrospective study indicates that the HOSPITAL score has superior discriminatory ability when compared to the LACE index as a predictor of hospital readmission within 30 days at a medium-sized university-affiliated teaching hospital.ConclusionsThe internationally validated HOSPITAL score may be superior to the LACE index in moderate-sized community hospitals to identify patients at high risk of hospital readmission within 30 days.
| S-EPMC5374974 | biostudies-literature
Project description:OBJECTIVE:To assess how well the LACE index and its constituent elements predict 30-day hospital readmission, and to determine whether other combinations of clinical or sociodemographic variables may enhance prognostic capability. DESIGN:Retrospective cohort study with split sample design for model validation. SETTING:One large hospital Trust in the West Midlands. PARTICIPANTS:All alive-discharge adult inpatient episodes between 1 January 2013 and 31 December 2014. DATA SOURCES:Anonymised data for each inpatient episode were obtained from the hospital information system. These included age at index admission, gender, ethnicity, admission/discharge date, length of stay, treatment specialty, admission type and source, discharge destination, comorbidities, number of accident and emergency (A&E) visits in the 6?months before the index admission and whether a patient was readmitted within 30 days of index discharge. OUTCOME MEASURES:Clinical and patient characteristics of readmission versus non-readmission episodes, proportion of readmission episodes at each LACE score, regression modelling of variables associated with readmission to assess the effectiveness of LACE and other variable combinations to predict 30-day readmission. RESULTS:The training cohort included data on 91?922 patient episodes. Increasing LACE score and each of its individual components were independent predictors of readmission (area under the receiver operating characteristic curve (AUC) 0.773; 95%?CI 0.768 to 0.779 for LACE; AUC 0.806; 95%?CI 0.801 to 0.812 for the four LACE components). A LACE score of 11 was most effective at distinguishing between higher and lower risk patients. However, only 25% of readmission episodes occurred in the higher scoring group. A model combining A&E visits and hospital episodes per patient in the previous year was more effective at predicting readmission (AUC 0.815; 95%?CI 0.810 to 0.819). CONCLUSIONS:Although LACE shows good discriminatory power in statistical terms, it may have little added value over and above clinical judgement in predicting a patient's risk of hospital readmission.
| S-EPMC5726103 | biostudies-literature
Project description:Avoidable hospital readmissions not only contribute to the high costs of healthcare in the US, but also have an impact on the quality of care for patients. Large scale adoption of Electronic Health Records (EHR) has created the opportunity to proactively identify patients with high risk of hospital readmission, and apply effective interventions to mitigate that risk. To that end, in the past, numerous machine-learning models have been employed to predict the risk of 30-day hospital readmission. However, the need for an accurate and real-time predictive model, suitable for hospital setting applications still exists. Here, using data from more than 300,000 hospital stays in California from Sutter Health's EHR system, we built and tested an artificial neural network (NN) model based on Google's TensorFlow library. Through comparison with other traditional and non-traditional models, we demonstrated that neural networks are great candidates to capture the complexity and interdependency of various data fields in EHRs. LACE, the current industry standard, showed a precision (PPV) of 0.20 in identifying high-risk patients in our database. In contrast, our NN model yielded a PPV of 0.24, which is a 20% improvement over LACE. Additionally, we discussed the predictive power of Social Determinants of Health (SDoH) data, and presented a simple cost analysis to assist hospitalists in implementing helpful and cost-effective post-discharge interventions.
| S-EPMC5510858 | biostudies-other
Project description:IntroductionReadmissions after an acute care hospitalization are relatively common, costly to the health care system, and are associated with significant burden for patients. As one way to reduce costs and simultaneously improve quality of care, hospital readmissions receive increasing interest from policy makers. It is only relatively recently that strategies were developed with the specific aim of reducing unplanned readmissions using prediction models to identify patients at risk. EPIC's Risk of Unplanned Readmission model promises superior performance. However, it has only been validated for the US setting. Therefore, the main objective of this study is to externally validate the EPIC's Risk of Unplanned Readmission model and to compare it to the internationally, widely used LACE+ index, and the SQLAPE® tool, a Swiss national quality of care indicator.MethodsA monocentric, retrospective, diagnostic cohort study was conducted. The study included inpatients, who were discharged between the 1st of January 2018 and the 31st of December 2019 from the Lucerne Cantonal Hospital, a tertiary-care provider in Central Switzerland. The study endpoint was an unplanned 30-day readmission. Models were replicated using the original intercept and beta coefficients as reported. Otherwise, score generator provided by the developers were used. For external validation, discrimination of the scores under investigation were assessed by calculating the area under the receiver operating characteristics curves (AUC). Calibration was assessed with the Hosmer-Lemeshow X2 goodness-of-fit test This report adheres to the TRIPOD statement for reporting of prediction models.ResultsAt least 23,116 records were included. For discrimination, the EPIC´s prediction model, the LACE+ index and the SQLape® had AUCs of 0.692 (95% CI 0.676-0.708), 0.703 (95% CI 0.687-0.719) and 0.705 (95% CI 0.690-0.720). The Hosmer-Lemeshow X2 tests had values of p<0.001.ConclusionIn summary, the EPIC´s model showed less favorable performance than its comparators. It may be assumed with caution that the EPIC´s model complexity has hampered its wide generalizability-model updating is warranted.
| S-EPMC8589185 | biostudies-literature
Project description:BackgroundPredictive models based on electronic health records (EHRs) are used to identify patients at high risk for 30-day hospital readmission. However, these models' ability to accurately detect who could benefit from inclusion in prevention interventions, also termed "perceived impactibility", has yet to be realized.ObjectiveWe aimed to explore healthcare providers' perspectives of patient characteristics associated with decisions about which patients should be referred to readmission prevention programs (RPPs) beyond the EHR preadmission readmission detection model (PREADM).DesignThis cross-sectional study employed a multi-source mixed-method design, combining EHR data with nurses' and physicians' self-reported surveys from 15 internal medicine units in three general hospitals in Israel between May 2016 and June 2017, using a mini-Delphi approach.ParticipantsNurses and physicians were asked to provide information about patients 65 years or older who were hospitalized at least one night.Main measuresWe performed a decision-tree analysis to identify characteristics for consideration when deciding whether a patient should be included in an RPP.Key resultsWe collected 817 questionnaires on 435 patients. PREADM score and RPP inclusion were congruent in 65% of patients, whereas 19% had a high PREADM score but were not referred to an RPP, and 16% had a low-medium PREADM score but were referred to an RPP. The decision-tree analysis identified five patient characteristics that were statistically associated with RPP referral: high PREADM score, eligibility for a nursing home, having a condition not under control, need for social-services support, and need for special equipment at home.ConclusionsOur study provides empirical evidence for the partial congruence between classifications of a high PREADM score and perceived impactibility. Findings emphasize the need for additional research to understand the extent to which combining EHR data with provider insights leads to better selection of patients for RPP inclusion.
| S-EPMC7210355 | biostudies-literature
Project description:BackgroundEarly hospital readmission for patients with cirrhosis continues to challenge the healthcare system. Risk stratification may help tailor resources, but existing models were designed using small, single-institution cohorts or had modest performance.AimsWe leveraged a large clinical database from the Department of Veterans Affairs (VA) to design a readmission risk model for patients hospitalized with cirrhosis. Additionally, we analyzed potentially modifiable or unexplored readmission risk factors.MethodsA national VA retrospective cohort of patients with a history of cirrhosis hospitalized for any reason from January 1, 2006, to November 30, 2013, was developed from 123 centers. Using 174 candidate variables within demographics, laboratory results, vital signs, medications, diagnoses and procedures, and healthcare utilization, we built a 47-variable penalized logistic regression model with the outcome of all-cause 30-day readmission. We excluded patients who left against medical advice, transferred to a non-VA facility, or if the hospital length of stay was greater than 30 days. We evaluated calibration and discrimination across variable volume and compared the performance to recalibrated preexisting risk models for readmission.ResultsWe analyzed 67,749 patients and 179,298 index hospitalizations. The 30-day readmission rate was 23%. Ascites was the most common cirrhosis-related cause of index hospitalization and readmission. The AUC of the model was 0.670 compared to existing models (0.649, 0.566, 0.577). The Brier score of 0.165 showed good calibration.ConclusionOur model achieved better discrimination and calibration compared to existing models, even after local recalibration. Assessment of calibration by variable parsimony revealed performance improvements for increasing variable inclusion well beyond those detectable for discrimination.
| S-EPMC7073276 | biostudies-literature
Project description:To isolate hospital effects on risk-standardized hospital-readmission rates, we examined readmission outcomes among patients who had multiple admissions for a similar diagnosis at more than one hospital within a given year.We divided the Centers for Medicare and Medicaid Services hospital-wide readmission measure cohort from July 2014 through June 2015 into two random samples. All the patients in the cohort were Medicare recipients who were at least 65 years of age. We used the first sample to calculate the risk-standardized readmission rate within 30 days for each hospital, and we classified hospitals into performance quartiles, with a lower readmission rate indicating better performance (performance-classification sample). The study sample (identified from the second sample) included patients who had two admissions for similar diagnoses at different hospitals that occurred more than 1 month and less than 1 year apart, and we compared the observed readmission rates among patients who had been admitted to hospitals in different performance quartiles.In the performance-classification sample, the median risk-standardized readmission rate was 15.5% (interquartile range, 15.3 to 15.8). The study sample included 37,508 patients who had two admissions for similar diagnoses at a total of 4272 different hospitals. The observed readmission rate was consistently higher among patients admitted to hospitals in a worse-performing quartile than among those admitted to hospitals in a better-performing quartile, but the only significant difference was observed when the patients were admitted to hospitals in which one was in the best-performing quartile and the other was in the worst-performing quartile (absolute difference in readmission rate, 2.0 percentage points; 95% confidence interval, 0.4 to 3.5; P=0.001).When the same patients were admitted with similar diagnoses to hospitals in the best-performing quartile as compared with the worst-performing quartile of hospital readmission performance, there was a significant difference in rates of readmission within 30 days. The findings suggest that hospital quality contributes in part to readmission rates independent of factors involving patients. (Funded by Yale-New Haven Hospital Center for Outcomes Research and Evaluation and others.).
| S-EPMC5671772 | biostudies-literature
Project description:Safety-net and teaching hospitals are somewhat more likely to be penalized for excess readmissions, but the association of other hospital characteristics with readmission rates is uncertain and may have relevance for hospital-centered interventions.To examine the independent association of 8 hospital characteristics with hospital-wide 30-day risk-standardized readmission rate (RSRR).This is a retrospective cross-sectional multivariable analysis.US hospitals.Centers for Medicare and Medicaid Services specification of hospital-wide RSRR from July 1, 2013 through June 30, 2014 with race and Medicaid dual-eligibility added.We included 6,789,839 admissions to 4474 hospitals of Medicare fee-for-service beneficiaries aged over 64 years. In multivariable analyses, there was regional variation: hospitals in the mid-Atlantic region had the highest RSRRs [0.98 percentage points higher than hospitals in the Mountain region; 95% confidence interval (CI), 0.84-1.12]. For-profit hospitals had an average RSRR 0.38 percentage points (95% CI, 0.24-0.53) higher than public hospitals. Both urban and rural hospitals had higher RSRRs than those in medium metropolitan areas. Hospitals without advanced cardiac surgery capability had an average RSRR 0.27 percentage points (95% CI, 0.18-0.36) higher than those with. The ratio of registered nurses per hospital bed was not associated with RSRR. Variability in RSRRs among hospitals of similar type was much larger than aggregate differences between types of hospitals.Overall, larger, urban, academic facilities had modestly higher RSRRs than smaller, suburban, community hospitals, although there was a wide range of performance. The strong regional effect suggests that local practice patterns are an important influence. Disproportionately high readmission rates at for-profit hospitals may highlight the role of financial incentives favoring utilization.
| S-EPMC5426655 | biostudies-literature