Dataset Information

An administrative model for benchmarking hospitals on their 30-day sepsis mortality.

ABSTRACT:

Background

Given the increased attention to sepsis at the population level there is a need to assess hospital performance in the care of sepsis patients using widely-available administrative data. The goal of this study was to develop an administrative risk-adjustment model suitable for profiling hospitals on their 30-day mortality rates for patients with sepsis.

Methods

We conducted a retrospective cohort study using hospital discharge data from general acute care hospitals in Pennsylvania in 2012 and 2013. We identified adult patients with sepsis as determined by validated diagnosis and procedure codes. We developed an administrative risk-adjustment model in 2012 data. We then validated this model in two ways: by examining the stability of performance assessments over time between 2012 and 2013, and by examining the stability of performance assessments in 2012 after the addition of laboratory variables measured on day one of hospital admission.

Results

In 2012 there were 115,213 sepsis encounters in 152 hospitals. The overall unadjusted mortality rate was 18.5%. The final risk-adjustment model had good discrimination (C-statistic?=?0.78) and calibration (slope and intercept of the calibration curve?=?0.960 and 0.007, respectively). Based on this model, hospital-specific risk-standardized mortality rates ranged from 12.2 to 24.5%. Comparing performance assessments between years, correlation in risk-adjusted mortality rates was good (Pearson's correlation?=?0.53) and only 19.7% of hospitals changed by more than one quintile in performance rankings. Comparing performance assessments after the addition of laboratory variables, correlation in risk-adjusted mortality rates was excellent (Pearson's correlation?=?0.93) and only 2.6% of hospitals changed by more than one quintile in performance rankings.

Conclusions

A novel claims-based risk-adjustment model demonstrated wide variation in risk-standardized 30-day sepsis mortality rates across hospitals. Individual hospitals' performance rankings were stable across years and after the addition of laboratory data. This model provides a robust way to rank hospitals on sepsis mortality while adjusting for patient risk.

SUBMITTER: Darby JL

PROVIDER: S-EPMC6458755 | biostudies-literature | 2019 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionA common quality indicator for monitoring and comparing hospitals is based on death within 30 days of admission. An important use is to determine whether a hospital has higher or lower mortality than other hospitals. Thus, the ability to identify such outliers correctly is essential. Two approaches for detection are: 1) calculating the ratio of observed to expected number of deaths (OE) per hospital and 2) including all hospitals in a logistic regression (LR) comparing each hospital to a form of average over all hospitals. The aim of this study was to compare OE and LR with respect to correctly identifying 30-day mortality outliers. Modifications of the methods, i.e., variance corrected approach of OE (OE-Faris), bias corrected LR (LR-Firth), and trimmed mean variants of LR and LR-Firth were also studied.Materials and methodsTo study the properties of OE and LR and their variants, we performed a simulation study by generating patient data from hospitals with known outlier status (low mortality, high mortality, non-outlier). Data from simulated scenarios with varying number of hospitals, hospital volume, and mortality outlier status, were analysed by the different methods and compared by level of significance (ability to falsely claim an outlier) and power (ability to reveal an outlier). Moreover, administrative data for patients with acute myocardial infarction (AMI), stroke, and hip fracture from Norwegian hospitals for 2012-2014 were analysed.ResultsNone of the methods achieved the nominal (test) level of significance for both low and high mortality outliers. For low mortality outliers, the levels of significance were increased four- to fivefold for OE and OE-Faris. For high mortality outliers, OE and OE-Faris, LR 25% trimmed and LR-Firth 10% and 25% trimmed maintained approximately the nominal level. The methods agreed with respect to outlier status for 94.1% of the AMI hospitals, 98.0% of the stroke, and 97.8% of the hip fracture hospitals.ConclusionWe recommend, on the balance, LR-Firth 10% or 25% trimmed for detection of both low and high mortality outliers.

Project description:IntroductionSepsis results from a dysregulated host response to an infection that is associated with an imbalance between pro- and anti-inflammatory cytokines. This imbalance is hypothesized to be a driver of patient mortality. Certain autoimmune diseases modulate the expression of cytokines involved in the pathophysiology of sepsis. However, the outcomes of patients with autoimmune disease who develop sepsis have not been studied in detail. The objective of this study is to determine whether patients with autoimmune diseases have different sepsis outcomes than patients without these comorbidities.MethodsUsing the Multiparameter Intelligent Monitoring in Intensive Care III database (v. 1.4) which contains retrospective clinical data for over 50,000 adult ICU stays, we compared 30-day mortality risk for sepsis patients with and without autoimmune disease. We used logistic regression models to control for known confounders, including demographics, disease severity, and immunomodulation medications. We used mediation analysis to evaluate how the chronic use of immunomodulation medications affects the relationship between autoimmune disease and 30-day mortality.ResultsOur study found a statistically significant 27.00% reduction in the 30-day mortality risk associated with autoimmune disease presence. This association was found to be the strongest (OR 0.71, 95% CI 0.54-0.93, P = 0.014) among patients with septic shock. The autoimmune disease-30-day mortality association was not mediated through the chronic use of immunomodulation medications (indirect effect OR 1.07, 95% CI 1.01-1.13, P = 0.020).ConclusionsWe demonstrated that autoimmune diseases are associated with a lower 30-day mortality risk in sepsis. Our findings suggest that autoimmune diseases affect 30-day mortality through a mechanism unrelated to the chronic use of immunomodulation medications. Since this study was conducted within a single study center, research using data from other medical centers will provide further validation.

Project description:ObjectiveAdministrative data are used for research, quality improvement, and health policy in severe sepsis. However, there is not a sepsis-specific tool applicable to administrative data with which to adjust for illness severity. Our objective was to develop, internally validate, and externally validate a severe sepsis mortality prediction model and associated mortality prediction score.DesignRetrospective cohort study using 2012 administrative data from five U.S. states. Three cohorts of patients with severe sepsis were created: 1) International Classification of Diseases, 9th Revision, Clinical Modification codes for severe sepsis/septic shock, 2) Martin approach, and 3) Angus approach. The model was developed and internally validated in International Classification of Diseases, 9th Revision, Clinical Modification, cohort and externally validated in other cohorts. Integer point values for each predictor variable were generated to create a sepsis severity score.SettingAcute care, nonfederal hospitals in New York, Maryland, Florida, Michigan, and Washington.SubjectsPatients in one of three severe sepsis cohorts: 1) explicitly coded (n = 108,448), 2) Martin cohort (n = 139,094), and 3) Angus cohort (n = 523,637) INTERVENTIONS: None.Measurements and main resultsMaximum likelihood estimation logistic regression to develop a predictive model for in-hospital mortality. Model calibration and discrimination assessed via Hosmer-Lemeshow goodness-of-fit and C-statistics, respectively. Primary cohort subset into risk deciles and observed versus predicted mortality plotted. Goodness-of-fit demonstrated p value of more than 0.05 for each cohort demonstrating sound calibration. C-statistic ranged from low of 0.709 (sepsis severity score) to high of 0.838 (Angus cohort), suggesting good to excellent model discrimination. Comparison of observed versus expected mortality was robust although accuracy decreased in highest risk decile.ConclusionsOur sepsis severity model and score is a tool that provides reliable risk adjustment for administrative data.