Dataset Information

Combined impact of Medicare’s hospital pay for performance programs on quality and safety outcomes is mixed

ABSTRACT:

Background

Three major hospital pay for performance (P4P) programs were introduced by the Affordable Care Act and intended to improve the quality, safety and efficiency of care provided to Medicare beneficiaries. The financial risk to hospitals associated with Medicare’s P4P programs is substantial. Evidence on the positive impact of these programs, however, has been mixed, and no study has assessed their combined impact. In this study, we examined the combined impact of Medicare’s P4P programs on clinical areas and populations targeted by the programs, as well as those outside their focus.

Methods

We used 2007–2016 Healthcare Cost and Utilization Project State Inpatient Databases for 14 states to identify hospital-level inpatient quality indicators (IQIs) and patient safety indicators (PSIs), by quarter and payer (Medicare vs. non-Medicare). IQIs and PSIs are standardized, evidence-based measures that can be used to track hospital quality of care and patient safety over time using hospital administrative data. The study period of 2007–2016 was selected to capture multiple years before and after introduction of program metrics. Interrupted time series was used to analyze the impact of the P4P programs on study outcomes targeted and not targeted by the programs. In sensitivity analyses, we examined the impact of these programs on care for non-Medicare patients.

Results

Medicare P4P programs were not associated with consistent improvements in targeted or non-targeted quality and safety measures. Moreover, mortality rates across targeted and untargeted conditions were generally getting worse after the introduction of Medicare’s P4P programs. Trends in PSIs were extremely mixed, with five outcomes trending in an expected (improving) direction, five trending in an unexpected (deteriorating) direction, and three with insignificant changes over time. Sensitivity analyses did not substantially alter these results.

Conclusions

Consistent with previous studies for individual programs, we detect minimal, if any, effect of Medicare’s hospital P4P programs on quality and safety. Given the growing evidence of limited impact, the administrative cost of monitoring and enforcing penalties, and potential increase in mortality, CMS should consider redesigning their P4P programs before continuing to expand them.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08348-w.

SUBMITTER: Waters T

PROVIDER: S-EPMC9330620 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectiveTo test whether receiving a financial bonus for quality in the Premier Hospital Quality Incentive Demonstration (HQID) stimulated subsequent quality improvement.DataHospital-level data on process-of-care quality from Hospital Compare for the treatment of acute myocardial infarction (AMI), heart failure, and pneumonia for 260 hospitals participating in the HQID from 2004 to 2006; receipt of quality bonuses in the first 3 years of HQID from the Premier Inc. website; and hospital characteristics from the 2005 American Hospital Association Annual Survey.Study designUnder the HQID, hospitals received a 1 percent bonus on Medicare payments for scoring between the 80th and 90th percentiles on a composite quality measure, and a 2 percent bonus for scoring at the 90th percentile or above. We used a regression discontinuity design to evaluate whether hospitals with quality scores just above these payment thresholds improved more in the subsequent year than hospitals with quality scores just below the thresholds. In alternative specifications, we examined samples of hospitals scoring within 3, 5, and 10 percentage point "bandwidths" of the thresholds. We used a Generalized Linear Model to estimate whether the relationship between quality and lagged quality was discontinuous at the lagged thresholds required for quality bonuses.Principal findingsThere were no statistically significant associations between receipt of a bonus and subsequent quality performance, with the exception of the 2 percent bonus for AMI in 2006 using the 5 percentage point bandwidth (0.8 percentage point increase, p<.01), and the 1 percent bonus for pneumonia in 2005 using all bandwidths (3.7 percentage point increase using the 3 percentage point bandwidth, p<.05).ConclusionsWe found little evidence that hospitals' receipt of quality bonuses was associated with subsequent improvement in performance. This raises questions about whether winning in pay-for-performance programs, such as Hospital Value-Based Purchasing, will lead to subsequent quality improvement.

Project description:ImportanceDespite billions spent in public investment, electronic health records (EHRs) have not delivered on the promise of large quality and safety improvement. Simultaneously, there is debate on whether public quality reporting is a useful tool to incentivize quality improvement.ObjectiveTo evaluate whether publicly reported feedback was associated with hospital improvement in an evaluation of medication-related clinical decision support (CDS) safety performance.Design, settings, and participantsThis nonrandomized controlled trial included US hospitals that participated in the Computerized Provider Order Entry (CPOE) Evaluation Tool in the Leapfrog Hospital Survey, a national quality reporting program that evaluates safety performance of hospital CDS using simulated orders and patients, in 2017 to 2018. A sharp regression discontinuity design was used to identify the association of receiving negative feedback with hospital performance improvement in the subsequent year. Data were analyzed from January through September 2020.ExposuresPublicly reported quality feedback.Main outcomes and measuresThe main outcome was improvement from 2017 to 2018 on the Leapfrog CPOE Evaluation Tool, using regression discontinuity model estimates of the association of receiving negative publicly reported feedback with quality improvement.ResultsA total of 1183 hospitals were included, with a mean (SD) CPOE score of 59.3% (16.3%) at baseline. Hospitals receiving negative feedback improved 8.44 (95% CI, 0.09 to 16.80) percentage points more in the subsequent year compared with hospitals that received positive feedback on the same evaluation. This change was driven by differences in improvement in basic CDS capabilities (β = 8.71 [95%CI, 1.67 to 18.73]) rather than advanced CDS (β = 6.15 [95% CI, -9.11 to 26.83]).Conclusions and relevanceIn this nonrandomized controlled trial, publicly reported feedback was associated with quality improvement, suggesting targeted measurement and reporting of process quality may be an effective policy lever to encourage improvement in specific areas. Clinical decision support represents an important tool in ensuring patient safety and decreasing adverse drug events, especially for complex patients and those with multiple chronic conditions who often receive several different drugs during an episode of care.