Dataset Information

Increasing the capacity of policy agencies to use research findings: a stepped-wedge trial.

ABSTRACT:

Background

This paper describes the trial of a novel intervention, Supporting Policy In health with evidence from Research: an Intervention Trial (SPIRIT). It examines (1) the feasibility of delivering this kind of programme in practice; (2) its acceptability to participants; (3) the impact of the programme on the capacity of policy agencies to engage with research; and (4) the engagement with and use of research by policy agencies.

Methods

SPIRIT was a multifaceted, highly tailored, stepped-wedge, cluster-randomised, trial involving six health policy agencies in Sydney, Australia. Agencies were randomly allocated to one of three start dates to receive the 1-year intervention programme. SPIRIT included audit, feedback and goal setting; a leadership programme; staff training; the opportunity to test systems to facilitate research use in policies; and exchange with researchers. Outcome measures were collected at each agency every 6?months for 30?months.

Results

Participation in SPIRIT was associated with significant increases in research use capacity at staff and agency levels. Staff reported increased confidence in research use skills, and agency leaders reported more extensive systems and structures in place to support research use. Self-report data suggested there was also an increase in tactical research use among agency staff. Given the relatively small numbers of participating agencies and the complexity of their contexts, findings suggest it is possible to effect change in the way policy agencies approach the use of research. This is supported by the responses on the other trial measures; while these were not statistically significant, on 18 of the 20 different measures used, the changes observed were consistent with the hypothesised intervention effect (that is, positive impacts).

Conclusions

As an early test of an innovative approach, SPIRIT has demonstrated that it is possible to increase research engagement and use in policy agencies. While more work is needed to establish the replicability and generalisability of these findings, this trial suggests that building staff skills and organisational structures may be effective in increasing evidence use.

SUBMITTER: Williamson A

PROVIDER: S-EPMC6366302 | biostudies-literature | 2019 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Increasing the capacity of policy agencies to use research findings: a stepped-wedge trial.

Williamson Anna A Barker Daniel D Green Sally S D'Este Catherine C Davies Huw T O HTO Jorm Louisa L Shakeshaft Anthony A Rudge Sian S Redman Sally S

Health research policy and systems 20190206 1

<h4>Background</h4>This paper describes the trial of a novel intervention, Supporting Policy In health with evidence from Research: an Intervention Trial (SPIRIT). It examines (1) the feasibility of delivering this kind of programme in practice; (2) its acceptability to participants; (3) the impact of the programme on the capacity of policy agencies to engage with research; and (4) the engagement with and use of research by policy agencies.<h4>Methods</h4>SPIRIT was a multifaceted, highly tailor ...[more]

PMID: 30728034

Similar Datasets

Project description:BackgroundStepped wedge randomised trial designs involve sequential roll-out of an intervention to participants (individuals or clusters) over a number of time periods. By the end of the study, all participants will have received the intervention, although the order in which participants receive the intervention is determined at random. The design is particularly relevant where it is predicted that the intervention will do more good than harm (making a parallel design, in which certain participants do not receive the intervention unethical) and/or where, for logistical, practical or financial reasons, it is impossible to deliver the intervention simultaneously to all participants. Stepped wedge designs offer a number of opportunities for data analysis, particularly for modelling the effect of time on the effectiveness of an intervention. This paper presents a review of 12 studies (or protocols) that use (or plan to use) a stepped wedge design. One aim of the review is to highlight the potential for the stepped wedge design, given its infrequent use to date.MethodsComprehensive literature review of studies or protocols using a stepped wedge design. Data were extracted from the studies in three categories for subsequent consideration: study information (epidemiology, intervention, number of participants), reasons for using a stepped wedge design and methods of data analysis.ResultsThe 12 studies included in this review describe evaluations of a wide range of interventions, across different diseases in different settings. However the stepped wedge design appears to have found a niche for evaluating interventions in developing countries, specifically those concerned with HIV. There were few consistent motivations for employing a stepped wedge design or methods of data analysis across studies. The methodological descriptions of stepped wedge studies, including methods of randomisation, sample size calculations and methods of analysis, are not always complete.ConclusionWhile the stepped wedge design offers a number of opportunities for use in future evaluations, a more consistent approach to reporting and data analysis is required.

Project description:BackgroundClinician utilization of practice guidelines can reduce inappropriate opioid prescribing and harm in chronic non-cancer pain; yet, implementation of "opioid guidelines" is subpar. We hypothesized that a multi-component quality improvement (QI) augmentation of "routine" system-level implementation efforts would increase clinician adherence to the opioid guideline-driven policy recommendations.MethodsOpioid policy was implemented system-wide in 26 primary care clinics. A convenience sample of 9 clinics received the QI augmentation (one-hour academic detailing; 2 online educational modules; 4-6 monthly one-hour practice facilitation sessions) in this non-randomized stepped-wedge QI project. The QI participants were volunteer clinic staff. The target patient population was adults with chronic non-cancer pain treated with long-term opioids. The outcomes included the clinic-level percentage of target patients with a current treatment agreement (primary outcome), rates of opioid-benzodiazepine co-prescribing, urine drug testing, depression and opioid misuse risk screening, and prescription drug monitoring database check; additional measures included daily morphine-equivalent dose (MED), and the percentages of all target patients and patients prescribed ≥90 mg/day MED. T-test, mixed-regression and stepped-wedge-based analyses evaluated the QI impact, with significance and effect size assessed with two-tailed p < 0.05, 95% confidence intervals and/or Cohen's d.ResultsTwo-hundred-fifteen QI participants, a subset of clinical staff, received at least one QI component; 1255 patients in the QI and 1632 patients in the 17 comparison clinics were prescribed long-term opioids. At baseline, more QI than comparison clinic patients were screened for depression (8.1% vs 1.1%, p = 0.019) and prescribed ≥90 mg/day MED (23.0% vs 15.5%, p = 0.038). The stepped-wedge analysis did not show statistically significant changes in outcomes in the QI clinics, when accounting for the comparison clinics' trends. The Cohen's d values favored the QI clinics in all outcomes except opioid-benzodiazepine co-prescribing. Subgroup analysis showed that patients prescribed ≥90 mg/day MED in the QI compared to comparison clinics improved urine drug screening rates (38.8% vs 19.1%, p = 0.02), but not other outcomes (p ≥ 0.05).ConclusionsAugmenting routine policy implementation with targeted QI intervention, delivered to volunteer clinic staff, did not additionally improve clinic-level, opioid guideline-concordant care metrics. However, the observed effect sizes suggested this approach may be effective, especially in higher-risk patients, if broadly implemented.Trial registrationNot applicable.

Project description:BackgroundWith the increase in the number of long-term survivors, interest is shifting from cancer survival to life and quality of life after cancer. These include consequences of long-term side effects of treatment, such as gonadotoxicity. Fertility preservation is becoming increasingly important in cancer management. International recommendations agree on the need to inform patients prior to treatments about the risk of fertility impairment and refer them to specialized centers to discuss fertility preservation. However, the literature reveals suboptimal access to fertility preservation on an international scale, and particularly in France, making information for patients and oncologists a potential lever for action. Our overall goal is to improve access to fertility preservation consultations for women with breast cancer through the development and evaluation of a combined intervention targeting the access and diffusion of information for these patients and brief training for oncologists.MethodsFirstly, we will improve existing information tools and create brief training content for oncologists using a qualitative, iterative, user-centred and participatory approach (objective 1). We will then use these tools in a combined intervention to conduct a stepped-wedge cluster randomized trial (objective 2) including 750 women aged 18 to 40 newly treated with chemotherapy for breast cancer at one of the 6 participating centers. As the primary outcome of the trial will be the access to fertility preservation counselling before and after using the combined intervention (brochures and brief training for oncologists), we will compare the rate of fertility preservation consultations between the usual care and intervention phases using linear regression models. Finally, we will analyse our approach using a context-sensitive implementation analysis and provide key elements for transferability to other contexts in France (objective 3).DiscussionWe expect to observe an increase in access to fertility preservation consultations as a result of the combined intervention. Particular attention will be paid to the effect of this intervention on socially disadvantaged women, who are known to be at greater risk of inappropriate treatment. The user-centred design principles and participatory approaches used to optimize the acceptability, usability and feasibility of the combined intervention will likely enhance its impact, diffusion and sustainability.Trial registrationRegistry: ClinicalTrials.gov.Trial registration numberNCT05989776. Date of registration: 7th September 2023. URL: https://classic.Clinicaltrialsgov/ct2/show/NCT05989776 .Protocol versionManuscript based on study protocol version 2.0, 21st may 2023.

Project description:BackgroundCalorie labelling may help to reduce energy consumption, but few well-controlled experimental studies have been conducted in real world settings. In a previous randomised controlled pilot trial we did not observe an effect of calorie labelling on energy purchased in worksite cafeterias. In the present study we sought to enhance the effect by making the labels more prominent, and to address the operational challenges reported previously by worksites.MethodsThree worksite cafeterias were randomised in a stepped wedge design to start the intervention at one of three fortnightly periods between March and July 2018. The intervention comprised introducing prominent calorie labelling for all cafeteria products for which calorie information was available (on average 87% of products offered across the three sites were labelled). Calorie content was displayed in bold capitalised Verdana typeface with a minimum font size of 14 e.g.120 CALORIES. Feasibility and acceptability were assessed using post-intervention surveys with cafeteria patrons and semi-structured interviews with managers. Effectiveness was assessed using total daily energy (kcal) purchased from intervention items across the three sites, analysed using semi-parametric GAMLSS models.ResultsRecruitment and retention of worksite cafeterias proved feasible: all three randomised sites successfully completed the study. Post-intervention feedback suggested high levels of intervention acceptability: 87% of responding patrons wanted calorie labelling to remain in place. No effect of the intervention on daily energy purchased was observed: -0.6% (95%CI -2.5 to 1.2, p = .487). By-site analyses showed similar null effects at each of the three sites, all ps > .110.ConclusionsThere was no evidence that prominent calorie labelling changed daily energy purchased across three English-based worksite cafeterias. The intervention was feasible to implement and acceptable to patrons and managers.

Project description:BackgroundFunding agencies constitute one essential pillar for policy makers, researchers and health service delivery institutions. Such agencies are increasingly providing support for science implementation. In this paper, we investigate health research funding agencies and how they support the integration of science into policy, and of science into practice, and vice versa.MethodsWe selected six countries: Australia, The Netherlands, France, Canada, England and the United States. For 13 funding agencies, we compared their intentions to support, their actions related to science integration into policy and practice, and the reported benefits of this integration. We did a qualitative content analysis of the reports and information provided on the funding agencies' websites.ResultsMost funding agencies emphasized the importance of science integration into policy and practice in their strategic orientation, and stated how this integration was structured. Their funding activities were embedded in the push, pull, or linkage/exchange knowledge transfer model. However, few program funding efforts were based on all three models. The agencies reported more often on the benefits of integration on practice, rather than on policy. External programs that were funded largely covered science integration into policy and practice at the end of grant stage, while overlooking the initial stages. Finally, external funding actions were more prominent than internally initiated bridging activities and training activities on such integration.ConclusionsThis paper contributes to research on science implementation because it goes beyond the two community model of researchers versus end users, to include funding agencies. Users of knowledge may be end users in health organizations like hospitals; civil servants assigned to decision making positions within funding agencies; civil servants outside of the Ministry of Health, such as the Ministry of the Environment; politicians deciding on health-related legislation; or even university researchers whose work builds on previous research. This heterogeneous sample of users may require different user-specific mechanisms for research initiation, development and dissemination. This paper builds the foundation for further discussion on science implementation from the perspective of funding agencies in the health field. In general, case studies can help in identifying best practices for evidence-informed decision making.

Project description:BACKGROUND:Rett syndrome is caused by a pathogenic mutation in the MECP2 gene with major consequences for motor and cognitive development. One of the effects of impaired MECP2 function is reduced production of Brain Derived Neurotrophic Factor (BDNF), a protein required for normal neuronal development. When housed in an enriched environment, MECP2 null mice improved motor abilities and increased levels of BDNF in the brain. We investigated the effects of environmental enrichment on gross motor skills and blood BDNF levels in girls with Rett syndrome. METHODS:A genetically variable group of 12 girls with a MECP2 mutation and younger than 6 years participated in a modified individually randomised stepped wedge design study. Assessments were conducted on five occasions, two during the baseline period and three during the intervention period. Gross motor function was assessed using the Rett Syndrome Gross Motor Scale (maximum score of 45) on five occasions, two during the baseline period and three during the intervention period. Blood levels of BDNF were measured at the two baseline assessments and at the end of the intervention period. The intervention comprised motor learning and exercise supplemented with social, cognitive and other sensory experiences over a six-month period. RESULTS:At the first assessment, the mean (SD) age of the children was 3 years (1 year 1 month) years ranging from 1 year 6 months to 5 years 2 months. Also at baseline, mean (SD) gross motor scores and blood BDNF levels were 22.7/45 (9.6) and 165.0 (28.8) ng/ml respectively. Adjusting for covariates, the enriched environment was associated with improved gross motor skills (coefficient 8.2, 95%CI 5.1, 11.2) and a 321.4 ng/ml (95%CI 272.0, 370.8) increase in blood BDNF levels after 6 months of treatment. Growth, sleep quality and mood were unaffected. CONCLUSIONS:Behavioural interventions such as environmental enrichment can reduce the functional deficit in Rett syndrome, contributing to the evidence-base for management and further understanding of epigenetic mechanisms. Environmental enrichment will be an important adjunct in the evaluation of new drug therapies that use BDNF pathways because of implications for the strengthening of synapses and improved functioning. TRIAL REGISTRATION:ACTRN12615001286538 .

Dataset Information

Increasing the capacity of policy agencies to use research findings: a stepped-wedge trial.

Background

Methods

Results

Conclusions

Publications

Increasing the capacity of policy agencies to use research findings: a stepped-wedge trial.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets