Dataset Information

Policymakers' experience of a capacity-building intervention designed to increase their use of research: a realist process evaluation.

ABSTRACT: An intervention's success depends on how participants interact with it in local settings. Process evaluation examines these interactions, indicating why an intervention was or was not effective, and how it (and similar interventions) can be improved for better contextual fit. This is particularly important for innovative trials like Supporting Policy In health with Research: an Intervention Trial (SPIRIT), where causal mechanisms are poorly understood. SPIRIT was testing a multi-component intervention designed to increase the capacity of health policymakers to use research.Our mixed-methods process evaluation sought to explain variation in observed process effects across the six agencies that participated in SPIRIT. Data collection included observations of intervention workshops (n = 59), purposively sampled interviews (n = 76) and participant feedback forms (n = 553). Using a realist approach, data was coded for context-mechanism-process effect configurations (retroductive analysis) by two authors.Intervention workshops were very well received. There was greater variation of views regarding other aspects of SPIRIT such as data collection, communication and the intervention's overall value. We identified nine inter-related mechanisms that were crucial for engaging participants in these policy settings: (1) Accepting the premise (agreeing with the study's assumptions); (2) Self-determination (participative choice); (3) The Value Proposition (seeing potential gain); (4) 'Getting good stuff' (identifying useful ideas, resources or connections); (5) Self-efficacy (believing 'we can do this!'); (6) Respect (feeling that SPIRIT understands and values one's work); (7) Confidence (believing in the study's integrity and validity); (8) Persuasive leadership (authentic and compelling advocacy from leaders); and (9) Strategic insider facilitation (local translation and mediation). These findings were used to develop tentative explanatory propositions and to revise the programme theory.This paper describes how SPIRIT functioned in six policy agencies, including why strategies that worked well in one site were less effective in others. Findings indicate a complex interaction between participants' perception of the intervention, shifting contextual factors, and the form that the intervention took in each site. Our propositions provide transferable lessons about contextualised areas of strength and weakness that may be useful in the development and implementation of similar studies.

SUBMITTER: Haynes A

PROVIDER: S-EPMC5701502 | biostudies-literature | 2017 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Policymakers' experience of a capacity-building intervention designed to increase their use of research: a realist process evaluation.

Haynes Abby A Brennan Sue S Redman Sally S Williamson Anna A Makkar Steve R SR Gallego Gisselle G Butow Phyllis P

Health research policy and systems 20171123 1

<h4>Background</h4>An intervention's success depends on how participants interact with it in local settings. Process evaluation examines these interactions, indicating why an intervention was or was not effective, and how it (and similar interventions) can be improved for better contextual fit. This is particularly important for innovative trials like Supporting Policy In health with Research: an Intervention Trial (SPIRIT), where causal mechanisms are poorly understood. SPIRIT was testing a mul ...[more]

PMID: 29169364

Similar Datasets

Project description:BackgroundWhile dissemination and implementation (D&I) science has grown rapidly, there is an ongoing need to understand how to build and sustain capacity in individuals and institutions conducting research. There are three inter-related domains for capacity building: people, settings, and activities. Since 2008, Washington University in St. Louis has dedicated significant attention and resources toward building D&I research capacity. This paper describes our process, challenges, and lessons with the goal of informing others who may have similar aims at their own institution.ActivitiesAn informal collaborative, the Washington University Network for Dissemination and Implementation Research (WUNDIR), began with a small group and now has 49 regular members. Attendees represent a wide variety of settings and content areas and meet every 6 weeks for half-day sessions. A logic model organizes WUNDIR inputs, activities, and outcomes. A mixed-methods evaluation showed that the network has led to new professional connections and enhanced skills (e.g., grant and publication development). As one of four, ongoing, formal programs, the Dissemination and Implementation Research Core (DIRC) was our first major component of D&I infrastructure. DIRC's mission is to accelerate the public health impact of clinical and health services research by increasing the engagement of investigators in later stages of translational research. The aims of DIRC are to advance D&I science and to develop and equip researchers with tools for D&I research. As a second formal component, the Washington University Institute for Public Health has provided significant support for D&I research through pilot projects and a small grants program. In a third set of formal programs, two R25 training grants (one in mental health and one in cancer) support post-doctoral scholars for intensive training and mentoring in D&I science. Finally, our team coordinates closely with D&I functions within research centers across the university. We share a series of challenges and potential solutions.ConclusionOur experience in developing D&I research at Washington University in St. Louis shows how significant capacity can be built in a relatively short period of time. Many of our ideas and ingredients for success can be replicated, tailored, and improved upon by others.

Project description:IntroductionThere has been a lot of attention on the role of human resource management interventions to improve delivery of health services in low- and middle-income countries. However, studies on this subject are few due to limited research on implementation of programmes and methodological difficulties in conducting experimental studies on human resource interventions. The authors present the protocol of an evaluation of a district-level capacity-building intervention to identify the determinants of performance of health workers in managerial positions and to understand how changes (if any) are brought about.Methods and analysisThe aim of this study is to understand how capacity building works. The authors will use realist evaluation to evaluate an intervention in Karnataka, India. The intervention is a capacity-building programme that seeks to improve management capacities of health managers at district and subdistrict levels through periodic classroom-based teaching and mentoring support at the workplace. The authors conducted interviews and reviewed literature on capacity building in health to draw out the programme theory of the intervention. Based on this, the authors formulated hypothetical pathways connecting the expected outcomes of the intervention (planning and supervision) to the inputs (contact classes and mentoring). The authors prepared a questionnaire to assess elements of the programme theory-organisational culture, self-efficacy and supervision. The authors shall conduct a survey among health managers as well as collect qualitative data through interviews with participants and non-participants selected purposively based on their planning and supervision performance. The authors will construct explanations in the form of context-mechanism-outcome configurations from the results. This will be iterative and the authors will use a realist evaluation framework to refine the explanatory theories that are based on the findings to explain and validate an improved theory on 'what works for whom and under what conditions'.DiscussionThe scope for applying realist evaluation to study human resource management interventions in health are discussed.

Project description:Inadequate research capacity impedes the development of evidence-based health programming in sub-Saharan Africa. However, funding for research capacity building (RCB) is often insufficient and restricted, limiting institutions' ability to address current RCB needs. The Doris Duke Charitable Foundation's African Health Initiative (AHI) funded Population Health Implementation and Training (PHIT) partnership projects in five African countries (Ghana, Mozambique, Rwanda, Tanzania and Zambia) to implement health systems strengthening initiatives inclusive of RCB.Using Cooke's framework for RCB, RCB activity leaders from each country reported on RCB priorities, activities, program metrics, ongoing challenges and solutions. These were synthesized by the authorship team, identifying common challenges and lessons learned.For most countries, each of the RCB domains from Cooke's framework was a high priority. In about half of the countries, domain specific activities happened prior to PHIT. During PHIT, specific RCB activities varied across countries. However, all five countries used AHI funding to improve research administrative support and infrastructure, implement research trainings and support mentorship activities and research dissemination. While outcomes data were not systematically collected, countries reported holding 54 research trainings, forming 56 mentor-mentee relationships, training 201 individuals and awarding 22 PhD and Masters-level scholarships. Over the 5 years, 116 manuscripts were developed. Of the 59 manuscripts published in peer-reviewed journals, 29 had national first authors and 18 had national senior authors. Trainees participated in 99 conferences and projects held 37 forums with policy makers to facilitate research translation into policy.All five PHIT projects strongly reported an increase in RCB activities and commended the Doris Duke Charitable Foundation for prioritizing RCB, funding RCB at adequate levels and time frames and for allowing flexibility in funding so that each project could implement activities according to their trainees' needs. As a result, many common challenges for RCB, such as adequate resources and local and international institutional support, were not identified as major challenges for these projects. Overall recommendations are for funders to provide adequate and flexible funding for RCB activities and for institutions to offer a spectrum of RCB activities to enable continued growth, provide adequate mentorship for trainees and systematically monitor RCB activities.

Project description:BackgroundSchool wellness programming is important for promoting healthy lifestyles and academic achievement in youth; however, research is needed on methods that can help schools implement and sustain such programs on their own. The purpose of this study was to investigate factors within and outside the school environment that influenced school capacity for implementation and potential sustainability of wellness programming.MethodsAs part of the School Wellness Integration Targeting Child Health (SWITCH®) intervention, elementary school wellness teams (N?=?30) were guided through a capacity-building process focused on promoting the adoption of healthy lifestyle behaviors in students. Data on implementation were collected through three standardized surveys and interviews (pre-mid-post) and a post-implementation interview. Indicators of organizational capacity were assessed using the School Wellness Readiness Assessment (SWRA). Paired t-tests were run to assess changes in implementation (classroom, physical education, and lunchroom settings), capacity, and stakeholder engagement over time. One-way analysis of variance (ANOVA) tests were run to examine how implementation of best practices (low, moderate, high) explained differences in capacity gains. Qualitative data were analyzed through inductive and deductive analysis, following the Consolidated Framework for Implementation Research (CFIR).ResultsPaired t-tests showed non-significant increases in school and setting-specific capacity and implementation of SWITCH best practices over time, in addition to a consistent level of engagement from key stakeholders. ANOVA results revealed non-significant associations between implementation group and gains in school capacity (F [2, 24] = 1.63; p?=?.21), class capacity (F [2, 24]=0.20 p?=?.82), lunchroom capacity (F [2, 24]=0.29; p?=?.78), and physical education (F [2, 24]=1.45; p?=?.25). Qualitative data demonstrated that factors within the outer setting (i.e., engaging community partners) facilitated programming. Inner-setting factors (i.e., relationships with administration and staff) influenced implementation. Implementation process themes (e.g., planning, adaptation of resources to meet school capacity/needs, and engaging students as leaders) were cited as key facilitators. Schools discussed factors affecting sustainability, such as school culture and knowledge of school wellness policy.ConclusionsThe results from this implementation study document the importance of allowing schools to adapt programming to meet their local needs, and highlight the strengths of measuring multiple implementation outcomes. Increased support is needed for schools regarding the formation and improvement of wellness policies as a means to enhance sustainability over time.

Project description:BACKGROUND:Despite the availability of effective malaria vector control intervention tools, implementation of control programmes in Nigeria is challenged by inadequate entomological surveillance data. This study was designed to assess and build the existing capacity for malaria vector surveillance, control and research (MVSC&R) in Nigerian institutions. METHODS:Application call to select qualified candidates for the capacity building (CB) intervention training programme was advertised in a widely read newspaper and online platforms of national and international professional bodies. Two trainings were organized to train selected applicants on field activities, laboratory tools and techniques relevant to malaria vector surveillance and control research. A semi-structured questionnaire was administered to collect data on socio-demographic characteristics of participants, knowledge and access of participants to field and laboratory techniques in MVSC&R. Similarly, pre and post-intervention tests were conducted to assess the performance and improvement in knowledge of the participants. Mentoring activities to sustain CB activities after the training were also carried out. RESULTS:A total of 23 suitable applicants were shortlisted out of the 89 applications received. The South West, South East and North Central geopolitical zones of the country had the highest applications and the highest selected number of qualified applicants compared to the South South and North East geopolitical zones. The distribution with respect to gender indicated that males (72.7%) were more than females (27.3%). Mean score of participants' knowledge of field techniques was 27.8 (± 10.8) before training and 67.7 (± 9.8) after the training. Similarly, participants' knowledge on laboratory techniques also improved from 37.4 (± 5.6) to 77.2 (± 10.8). The difference in the mean scores at pre and post-test was statistically significant (p < 0.05). Access of participants to laboratory and field tools used in MVSC&R was generally low with insecticide susceptibility bioassays and pyrethrum spray collection methods being the most significant (p < 0.05). CONCLUSIONS:The capacity available for vector control research and surveillance at institutional level in Nigeria is weak and require further strengthening. Increased training and access of personnel to relevant tools for MVSC&R is required in higher institutions in the six geopolitical zones of the country.

Project description:Over the past 3 decades, there has been a substantial shift to the marketisation of government-funded health services. For organisations traditionally buffered from the competitive pressures of for-profit enterprises, such as community-based organisations, this means developing the capacity to adapt to competitive tendering processes, shifting client expectations, and increasing demands for greater accountability. Drawing on ideas of institutional entrepreneurship, we believe that attempts to build adaptive capacity require the transformation of existing institutional arrangements. Key in this may be identifying and fostering institutional entrepreneurs--actors who take the lead in being the impetus for, and giving direction to, structural change. This study focuses on the strategies used by institutional entrepreneurs to build adaptive capacity in the community-based healthcare sector.The research will use an adapted rapid realist review. The review will find underlying theories that explain the circumstances surrounding the implementation of capacity-building strategies that shape organisational response and generate outcomes by activating causal mechanisms. An early scoping of the literature, and consultations with key stakeholders, will be undertaken to identify an initial programme theory. We will search for relevant journal articles and grey literature. Data will be extracted based on contextual factors, mechanisms and outcomes, and their configurations. The analysis will seek patterns and regularities in these configurations and will focus on confirming, refuting or refining our programme theory.The study does not involve primary research and, therefore, does not require formal ethical approval. However, ethical standards of utility, usefulness, feasibility, propriety, accuracy and accountability will be followed. The results will be written up according to the Realist and Meta-Review Evidence Synthesis: Evolving Standards guidelines. Once completed, findings will be published in a peer-reviewed journal.CRD42015026487.

Dataset Information

Policymakers' experience of a capacity-building intervention designed to increase their use of research: a realist process evaluation.

Publications

Policymakers' experience of a capacity-building intervention designed to increase their use of research: a realist process evaluation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets