Dataset Information

Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units.

ABSTRACT: This paper examines the synthetic control method in contrast to commonly used difference-in-differences (DiD) estimation, in the context of a re-evaluation of a pay-for-performance (P4P) initiative, the Advancing Quality scheme. The synthetic control method aims to estimate treatment effects by constructing a weighted combination of control units, which represents what the treated group would have experienced in the absence of receiving the treatment. While DiD estimation assumes that the effects of unobserved confounders are constant over time, the synthetic control method allows for these effects to change over time, by re-weighting the control group so that it has similar pre-intervention characteristics to the treated group. We extend the synthetic control approach to a setting of evaluation of a health policy where there are multiple treated units. We re-analyse a recent study evaluating the effects of a hospital P4P scheme on risk-adjusted hospital mortality. In contrast to the original DiD analysis, the synthetic control method reports that, for the incentivised conditions, the P4P scheme did not significantly reduce mortality and that there is a statistically significant increase in mortality for non-incentivised conditions. This result was robust to alternative specifications of the synthetic control method. © 2015 The Authors. Health Economics published by John Wiley & Sons Ltd.

SUBMITTER: Kreif N

PROVIDER: S-EPMC5111584 | biostudies-literature | 2016 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units.

Kreif Noémi N Grieve Richard R Hangartner Dominik D Turner Alex James AJ Nikolova Silviya S Sutton Matt M

Health economics 20151007 12

This paper examines the synthetic control method in contrast to commonly used difference-in-differences (DiD) estimation, in the context of a re-evaluation of a pay-for-performance (P4P) initiative, the Advancing Quality scheme. The synthetic control method aims to estimate treatment effects by constructing a weighted combination of control units, which represents what the treated group would have experienced in the absence of receiving the treatment. While DiD estimation assumes that the effect ...[more]

PMID: 26443693

Similar Datasets

Project description:ObjectiveTo assess the relation between autocratisation-substantial decreases in democratic traits (free and fair elections, freedom of civil and political association, and freedom of expression)-and countries' population health outcomes and progress toward universal health coverage (UHC).DesignSynthetic control analysis.Setting and country selectionGlobal sample of countries for all years from 1989 to 2019, split into two categories: 17 treatment countries that started autocratising during 2000 to 2010, and 119 control countries that never autocratised from 1989 to 2019. The treatment countries comprised low and middle income nations and represent all world regions except North America and western Europe. A weighted combination of control countries was used to construct synthetic controls for each treatment country. This statistical method is especially well suited to population level studies when random assignment is infeasible and sufficiently similar comparators are not available. The method was originally developed in economics and political science to assess the impact of policies and events, and it is now increasingly used in epidemiology.Main outcome measuresHIV-free life expectancy at age 5 years, UHC effective coverage index (0-100 point scale), and out-of-pocket spending on health per capita. All outcome variables are for the period 1989 to 2019.ResultsAutocratising countries underperformed for all three outcome variables in the 10 years after the onset of autocratisation, despite some improvements in life expectancy, UHC effective coverage index, and out-of-pocket spending on health. On average, HIV-free life expectancy at age 5 years increased by 2.2% (from 64.7 to 66.1 years) during the 10 years after the onset of autocratisation. This study estimated that it would have increased by 3.5% (95% confidence interval 3.3% to 3.6%, P<0.001) (from 64.7 to 66.9 years) in the absence of autocratisation. On average, the UHC effective coverage index increased by 11.9% (from 42.5 to 47.6 points) during the 10 years after the onset of autocratisation. This study estimated that it would have increased by 20.2% (95% confidence interval 19.6% to 21.2%, P<0.001) (from 42.5 to 51.1 points) in the absence of autocratisation. Finally, on average, out-of-pocket spending on health per capita increased by 10.0% (from $4.00 (£3.1; €3.4) to $4.4, log transformed) during the 10 years after the onset of autocratisation. This study estimated that it would have increased by only 4.4% (95% confidence interval 3.9% to 4.6%, P<0.001) (from $4.0 to $4.2, log transformed) in the absence of autocratisation.ConclusionsAutocratising countries had worse than estimated life expectancy, effective health service coverage, and levels of out-of-pocket spending on health. These results suggest that the noticeable increase in the number of countries that are experiencing democratic erosion in recent years is hindering population health gains and progress toward UHC. Global health institutions will need to adjust their policy recommendations and activities to obtain the best possible results in those countries with a diminishing democratic incentive to provide quality healthcare to populations.

Dataset Information

Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units.

Publications

Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure