Dataset Information

Regression Discontinuity Designs in Health: A Systematic Review.

ABSTRACT:

Background

Regression discontinuity designs are non-randomized study designs that permit strong causal inference with relatively weak assumptions. Interest in these designs is growing but there is limited knowledge of the extent of their application in health. We aimed to conduct a comprehensive systematic review of the use of regression discontinuity designs in health research.

Methods

We included studies that used regression discontinuity designs to investigate the physical or mental health outcomes of any interventions or exposures in any populations. We searched 32 health, social science, and gray literature databases (1 January 1960 to 1 January 2019). We critically appraised studies using eight criteria adapted from the What Works Clearinghouse Standards for regression discontinuity designs. We conducted a narrative synthesis, analyzing the forcing variables and threshold rules used in each study.

Results

The literature search retrieved 7658 records, producing 325 studies that met the inclusion criteria. A broad range of health topics was represented. The forcing variables used to implement the design were age, socioeconomic measures, date or time of exposure or implementation, environmental measures such as air quality, geographic location, and clinical measures that act as a threshold for treatment. Twelve percent of the studies fully met the eight quality appraisal criteria. Fifteen percent of studies reported a prespecified primary outcome or study protocol.

Conclusions

This systematic review demonstrates that regression discontinuity designs have been widely applied in health research and could be used more widely still. Shortcomings in study quality and reporting suggest that the potential benefits of this method have not yet been fully realized.

SUBMITTER: Hilton Boon M

PROVIDER: S-EPMC7707156 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The regression discontinuity (RD) design is a quasi-experimental design that estimates the causal effects of a treatment by exploiting naturally occurring treatment rules. It can be applied in any context where a particular treatment or intervention is administered according to a pre-specified rule linked to a continuous variable. Such thresholds are common in primary care drug prescription where the RD design can be used to estimate the causal effect of medication in the general population. Such results can then be contrasted to those obtained from randomised controlled trials (RCTs) and inform prescription policy and guidelines based on a more realistic and less expensive context. In this paper, we focus on statins, a class of cholesterol-lowering drugs, however, the methodology can be applied to many other drugs provided these are prescribed in accordance to pre-determined guidelines. Current guidelines in the UK state that statins should be prescribed to patients with 10-year cardiovascular disease risk scores in excess of 20%. If we consider patients whose risk scores are close to the 20% risk score threshold, we find that there is an element of random variation in both the risk score itself and its measurement. We can therefore consider the threshold as a randomising device that assigns statin prescription to individuals just above the threshold and withholds it from those just below. Thus, we are effectively replicating the conditions of an RCT in the area around the threshold, removing or at least mitigating confounding. We frame the RD design in the language of conditional independence, which clarifies the assumptions necessary to apply an RD design to data, and which makes the links with instrumental variables clear. We also have context-specific knowledge about the expected sizes of the effects of statin prescription and are thus able to incorporate this into Bayesian models by formulating informative priors on our causal parameters.

Project description:BackgroundThe COVID-19 pandemic resulted in the unprecedented popularity of digital financial services for contactless payments and government cash transfer programs to mitigate the economic effects of the pandemic. The effect of the pandemic on the use of digital financial services for health in low- and middle-income countries, however, is poorly understood.ObjectiveThis study aimed to assess the effect of the first COVID-19 lockdown on the use of a mobile maternal health wallet, with a particular focus on delineating the age-dependent differential effects, and draw conclusions on the effect of lockdown measures on the use of digital health services.MethodsWe analyzed 819,840 person-days of health wallet use data from 3416 women who used health care at 25 public sector primary care facilities and 4 hospitals in Antananarivo, Madagascar, between January 1 and August 27, 2020. We collected data on savings, payments, and voucher use at the point of care. To estimate the effects of the first COVID-19 lockdown in Madagascar, we used regression discontinuity analysis around the starting day of the first COVID-19 lockdown on March 23, 2020. We determined the bandwidth using a data-driven method for unbiased bandwidth selection and used modified Poisson regression for binary variables to estimate risk ratios as lockdown effect sizes.ResultsWe recorded 3719 saving events, 1572 payment events, and 3144 use events of electronic vouchers. The first COVID-19 lockdown in Madagascar reduced mobile money savings by 58.5% (P<.001), payments by 45.8% (P<.001), and voucher use by 49.6% (P<.001). Voucher use recovered to the extrapolated prelockdown counterfactual after 214 days, while savings and payments did not cross the extrapolated prelockdown counterfactual. The recovery duration after the lockdown differed by age group. Women aged >30 years recovered substantially faster, returning to prelockdown rates after 34, 226, and 77 days for savings, payments, and voucher use, respectively. Younger women aged <25 years did not return to baseline values. The results remained robust in sensitivity analyses using ±20 days of the optimal bandwidth.ConclusionsThe COVID-19 lockdown greatly reduced the use of mobile money in the health sector, affecting savings, payments, and voucher use. Savings were the most significantly reduced, implying that the lockdown affected women's expectations of future health care use. Declines in payments and voucher use indicated decreased actual health care use caused by the lockdown. These effects are crucial since many maternal and child health care services cannot be delayed, as the potential benefits will be lost or diminished. To mitigate the adverse impacts of lockdowns on maternal health service use, digital health services could be leveraged to provide access to telemedicine and enhance user communication with clear information on available health care access options and adherence to safety protocols.