Dataset Information

Building implementation capacity in health care and welfare through team training—study protocol of a longitudinal mixed-methods evaluation of the building implementation capacity intervention

ABSTRACT:

Background

To ensure the provision of high-quality safety and cost-effective health and welfare services, managers and professionals are required to introduce and ensure the routine use of clinical guidelines and other evidence-based interventions. Despite this, they often lack training and support in implementation. This project aims to investigate how a team training intervention, with the goal to build implementation capacity, influences participants’ implementation knowledge and skills, as well as how it influences implementation activities and implementation capacity within participating health and welfare organizations. Furthermore, the aim is to investigate how the organizations’ contexts influence the intervention outcomes.

Methods

The building implementation capacity (BIC) intervention builds on the behavior change wheel, which considers implementation as a matter of behavior change. The intervention will be provided to teams of managers and professionals working in health and welfare organizations and seeking support to implement a guideline- or evidence-based intervention. The intervention consists of a series of interactive workshops that provides the participating teams with the knowledge and skills to apply a systematic implementation model. A longitudinal mixed-methods evaluation, including interviews, surveys, and document analysis, will be applied over 24 months. The normalization process theory measure will be used to assess how the intervention influences implementation activities in practice and implementation capacity in the teams and the wider organizations.

Discussion

This project has an ambition to add to the knowledge concerning how to promote the uptake of research findings into health care by building implementation capacity through team training in implementation. The project’s uniqueness is that it is designed to move beyond individual-level outcomes and evaluate implementation activities and implementation capacity in participating organizations. Further, the intervention will be evaluated over 24 months to investigate long-term outcomes of implementation training.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00233-7.

SUBMITTER: Augustsson H

PROVIDER: S-EPMC8596934 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundManagers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.MethodsA non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.ResultsOverall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).ConclusionsThe intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

Project description:BackgroundSchool wellness programming is important for promoting healthy lifestyles and academic achievement in youth; however, research is needed on methods that can help schools implement and sustain such programs on their own. The purpose of this study was to investigate factors within and outside the school environment that influenced school capacity for implementation and potential sustainability of wellness programming.MethodsAs part of the School Wellness Integration Targeting Child Health (SWITCH®) intervention, elementary school wellness teams (N?=?30) were guided through a capacity-building process focused on promoting the adoption of healthy lifestyle behaviors in students. Data on implementation were collected through three standardized surveys and interviews (pre-mid-post) and a post-implementation interview. Indicators of organizational capacity were assessed using the School Wellness Readiness Assessment (SWRA). Paired t-tests were run to assess changes in implementation (classroom, physical education, and lunchroom settings), capacity, and stakeholder engagement over time. One-way analysis of variance (ANOVA) tests were run to examine how implementation of best practices (low, moderate, high) explained differences in capacity gains. Qualitative data were analyzed through inductive and deductive analysis, following the Consolidated Framework for Implementation Research (CFIR).ResultsPaired t-tests showed non-significant increases in school and setting-specific capacity and implementation of SWITCH best practices over time, in addition to a consistent level of engagement from key stakeholders. ANOVA results revealed non-significant associations between implementation group and gains in school capacity (F [2, 24] = 1.63; p?=?.21), class capacity (F [2, 24]=0.20 p?=?.82), lunchroom capacity (F [2, 24]=0.29; p?=?.78), and physical education (F [2, 24]=1.45; p?=?.25). Qualitative data demonstrated that factors within the outer setting (i.e., engaging community partners) facilitated programming. Inner-setting factors (i.e., relationships with administration and staff) influenced implementation. Implementation process themes (e.g., planning, adaptation of resources to meet school capacity/needs, and engaging students as leaders) were cited as key facilitators. Schools discussed factors affecting sustainability, such as school culture and knowledge of school wellness policy.ConclusionsThe results from this implementation study document the importance of allowing schools to adapt programming to meet their local needs, and highlight the strengths of measuring multiple implementation outcomes. Increased support is needed for schools regarding the formation and improvement of wellness policies as a means to enhance sustainability over time.

Project description:BACKGROUND:The prevalence of dementia is surging that results in huge service demand in the community care services. Dementia care competence of staff working in these settings is fundamental of the care quality. This project aims to examine the effects of staff training on their competence for the anticipated challenges in dementia care and explore how the training influence their care practices. METHODS:This study adopted a mixed methods triangulation design, including a prospective multi-center study with pre-test post-test evaluations and a narrative analysis of the participants' reflective essays. Seventeen experienced health and social care professionals were trained as trainers at the Dementia Services Development Centre of the University of Stirling, UK. The trainers provided local facilitator training to staff members by using training materials that were culturally adapted to the local context. The facilitators were required to deliver 12 two-hour in-service training sessions for 6 months to their colleagues in a small group format in their respective workplace. Eventually a total of 1347 staff members from community care centers, day care centers, outreach teams and care homes of 70 non-government organizations in Hong Kong participated in the study between April 2017 and December 2018. Validated instruments were used to measure knowledge, attitude, sense of competence in dementia care and job satisfaction at the baseline and at 12-month follow-up. All participants were required to write a reflective essay to describe their experiences in dementia care by the end of the training. RESULTS:A total of 1264 participants, including 195 facilitators and 1069 learners, completed all assessment were included for analysis. Significant improvements were observed in all outcomes at the 12-month follow-up assessment (Ps???.001). The magnitude of improvements in attitudes was the largest. The findings also showed that the effects of the training program significantly varied across different groups of learners in terms of age, occupation, work and training experience. CONCLUSIONS:This community-wide large-scale project provided evidence that the train-the-trainer model and reflective learning are effective means to facilitate situated learning that promote awareness and understanding of dementia, and consequently enhance sustainability of changes in care practices.

Project description:BACKGROUND:Cross-system interventions can help integrate services across different service delivery systems but require organizations to establish strong collaborative relationships for implementation. Contingency theory suggests that the effectiveness of different collaborative strategies (i.e. specific ways organizations align operations and services) varies by context. This paper describes a study of different strategies for fostering collaboration between child welfare and substance abuse treatment agencies and the conditions under which they are effective for implementation. We also describe the development and piloting of the Collaborating Across Systems for Program Implementation (CASPI) tool-a decision-making guide intended to help researchers and organizational leaders identify and use appropriate collaborative strategies for their context. METHODS/DESIGN:This multisite longitudinal, mixed methods study, leverages a naturally occurring implementation initiative -- in up to 17 Ohio counties -- to implement Ohio START (Sobriety Treatment and Reducing Trauma). START is a child welfare model that requires strong collaboration with local substance use treatment organizations to promote integrated services. During the first two years, we will identify collaborative strategies associated with improved START implementation (penetration and fidelity) and service delivery outcomes (timeliness), given system, and organizational features. We will conduct a convergent mixed methods study drawing on worker surveys, agency documents, administrative data, formal partner agreements, and group interviews. Data will be integrated and analyzed using Qualitative Comparative Analysis (QCA). To develop the CASPI, an expert panel comprised of implementation experts, and community stakeholders will convene to synthesize our findings and develop contents (including a decision tree). During the final year of the study, we will assess the acceptability, appropriateness, and feasibility of the CASPI in a randomized vignette experiment, and a pilot-test with 3 child welfare agencies that have not yet implemented START. DISCUSSION:Our results will lay the groundwork for a larger controlled trial that will test the CASPI's effectiveness for supporting effective and efficient implementation of cross-system interventions like START. The CASPI is expected to help leaders and researchers select and use collaboration strategies tailored to their context and be applicable in a wide range of settings including rural communities. Our work also advances system-level implementation strategies. TRIAL REGISTRATION:NCT03931005 , Registered April 29, 2019.

Project description:OBJECTIVE:Multidisciplinary team (MDT) meetings are assumed to produce better decisions and are extensively used to manage chronic disease in the National Health Service (NHS). However, evidence for their effectiveness is mixed. Our objective was to investigate determinants of MDT effectiveness by examining factors influencing the implementation of MDT treatment plans. This is a proxy measure of effectiveness, because it lies on the pathway to improvements in health, and reflects team decision making which has taken account of clinical and non-clinical information. Additionally, this measure can be compared across MDTs for different conditions. METHODS:We undertook a prospective mixed-methods study of 12 MDTs in London and North Thames. Data were collected by observation of 370 MDT meetings, interviews with 53 MDT members, and from 2654 patient medical records. We examined the influence of patient-related factors (disease, age, sex, deprivation, whether their preferences and other clinical/health behaviours were mentioned) and MDT features (as measured using the 'Team Climate Inventory' and skill mix) on the implementation of MDT treatment plans. RESULTS:The adjusted odds (or likelihood) of implementation was reduced by 25% for each additional professional group represented at the MDT meeting. Implementation was more likely in MDTs with clear goals and processes and a good 'Team Climate' (adjusted OR 1.96; 95% CI 1.15 to 3.31 for a unit increase in Team Climate Inventory (TCI) score). Implementation varied by disease category, with the lowest adjusted odds of implementation in mental health teams. Implementation was also lower for patients living in more deprived areas (adjusted odds of implementation for patients in the most compared with least deprived areas was 0.60, 95% CI 0.39 to 0.91). CONCLUSIONS:Greater multidisciplinarity is not necessarily associated with more effective decision making. Explicit goals and procedures are also crucial. Decision implementation should be routinely monitored to ensure the equitable provision of care.

Project description:IntroductionBehavioural parent training (BPT) programmes are effective in preventing and treating early-onset conduct problems and child maltreatment. Unfortunately, pervasive mental health service disparities continue to limit access to and engagement in these interventions. Furthermore, challenges with parental engagement can impede the successful implementation of evidence-based practices (EBPs) in community settings that serve low-income, ethnic minority families. Lay health workers (LHWs)-individuals without formal mental health training-represent an important workforce to increase engagement, as they are members of the communities they serve. However, the mobilisation of LHWs has not been well studied as an implementation strategy to extend the reach or effectiveness of EBPs in the USA. LHW-delivered implementation interventions that specifically support the engagement of Latinx parents in evidence-based BPT programmes have the potential to improve clinical and implementation outcomes.Methods and analysisA community-partnered approach will use the Quality Implementation Framework (QIF) to tailor and implement an LHW-delivered implementation intervention that aims to promote Latinx parent engagement in BPT programmes. Steps from the QIF will guide study activities to (1) conduct a mixed methods needs assessment to fit the implementation intervention to the local context, (2) adapt LHW-delivered implementation strategies to promote parent access to and engagement in Parent-Child Interaction Therapy and (3) conduct a hybrid effectiveness-implementation pilot trial to examine the feasibility, acceptability and preliminary effectiveness of the LHW implementation intervention at increasing engagement.Ethics and disseminationStudy procedures have been approved by the Institutional Review Board at the University of California, Santa Barbara. Results will be shared with the community-advisory group, at community-based meetings for other stakeholders involved in the pilot project, and submitted for publication in peer-reviewed journals.

Project description:BackgroundCommunity-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implementation was related to participant outcomes, and identify barriers and facilitators to implementation that could be addressed.MethodsThis study utilized quantitative participant evaluation data (n?=?115) and quantitative and qualitative data from semi-structured interviews with program instructors (N?=?13). At the participant level, demographic data (age, sex, insurance status) and behavior change intention were captured. Instructor data included implementation of program components and program attendance to create a 7-point implementation score of fidelity and reach variables. Degree of program implementation (high and low) was operationalized based on these variables (low: 0-4, high: 5-7). Relationships among degree of implementation, participant demographics, and participant outcomes (e.g., intent to be physically active or limit alcohol) were assessed using linear or ordinal logistic mixed effects models as appropriate. Interview data were transcribed and coded deductively for CFIR constructs, and constructs were then rated for magnitude and valence. Patterns between ratings of high and low implementation programs were used to determine constructs that manifested as barriers or facilitators.ResultsProgram implementation varied with scores ranging from 4 to 7. High implementation was related to greater improvements in intention to be physically active (p?<? 0.05), achieve a healthy weight (p?<? 0.05), and limit alcohol (p?<? 0.01). Eight constructs distinguished between high and low implementation programs. Design quality and packaging, compatibility, external change agents, access to knowledge and information, and experience were facilitators of implementation and formally appointed internal implementation leaders was a barrier to implementation.ConclusionsAs higher implementation was related to improved participant outcomes, program administrators should emphasize the importance of fidelity in training for program instructors. The CFIR can be used to identify barriers and/or facilitators to implementation in community interventions, but results may be unique from clinical contexts.