Dataset Information

Building implementation capacity in health care and welfare through team training—study protocol of a longitudinal mixed-methods evaluation of the building implementation capacity intervention

ABSTRACT:

Background

To ensure the provision of high-quality safety and cost-effective health and welfare services, managers and professionals are required to introduce and ensure the routine use of clinical guidelines and other evidence-based interventions. Despite this, they often lack training and support in implementation. This project aims to investigate how a team training intervention, with the goal to build implementation capacity, influences participants’ implementation knowledge and skills, as well as how it influences implementation activities and implementation capacity within participating health and welfare organizations. Furthermore, the aim is to investigate how the organizations’ contexts influence the intervention outcomes.

Methods

The building implementation capacity (BIC) intervention builds on the behavior change wheel, which considers implementation as a matter of behavior change. The intervention will be provided to teams of managers and professionals working in health and welfare organizations and seeking support to implement a guideline- or evidence-based intervention. The intervention consists of a series of interactive workshops that provides the participating teams with the knowledge and skills to apply a systematic implementation model. A longitudinal mixed-methods evaluation, including interviews, surveys, and document analysis, will be applied over 24 months. The normalization process theory measure will be used to assess how the intervention influences implementation activities in practice and implementation capacity in the teams and the wider organizations.

Discussion

This project has an ambition to add to the knowledge concerning how to promote the uptake of research findings into health care by building implementation capacity through team training in implementation. The project’s uniqueness is that it is designed to move beyond individual-level outcomes and evaluate implementation activities and implementation capacity in participating organizations. Further, the intervention will be evaluated over 24 months to investigate long-term outcomes of implementation training.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00233-7.

SUBMITTER: Augustsson H

PROVIDER: S-EPMC8596934 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundManagers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.MethodsA non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.ResultsOverall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).ConclusionsThe intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

Project description:BackgroundSchool wellness programming is important for promoting healthy lifestyles and academic achievement in youth; however, research is needed on methods that can help schools implement and sustain such programs on their own. The purpose of this study was to investigate factors within and outside the school environment that influenced school capacity for implementation and potential sustainability of wellness programming.MethodsAs part of the School Wellness Integration Targeting Child Health (SWITCH®) intervention, elementary school wellness teams (N?=?30) were guided through a capacity-building process focused on promoting the adoption of healthy lifestyle behaviors in students. Data on implementation were collected through three standardized surveys and interviews (pre-mid-post) and a post-implementation interview. Indicators of organizational capacity were assessed using the School Wellness Readiness Assessment (SWRA). Paired t-tests were run to assess changes in implementation (classroom, physical education, and lunchroom settings), capacity, and stakeholder engagement over time. One-way analysis of variance (ANOVA) tests were run to examine how implementation of best practices (low, moderate, high) explained differences in capacity gains. Qualitative data were analyzed through inductive and deductive analysis, following the Consolidated Framework for Implementation Research (CFIR).ResultsPaired t-tests showed non-significant increases in school and setting-specific capacity and implementation of SWITCH best practices over time, in addition to a consistent level of engagement from key stakeholders. ANOVA results revealed non-significant associations between implementation group and gains in school capacity (F [2, 24] = 1.63; p?=?.21), class capacity (F [2, 24]=0.20 p?=?.82), lunchroom capacity (F [2, 24]=0.29; p?=?.78), and physical education (F [2, 24]=1.45; p?=?.25). Qualitative data demonstrated that factors within the outer setting (i.e., engaging community partners) facilitated programming. Inner-setting factors (i.e., relationships with administration and staff) influenced implementation. Implementation process themes (e.g., planning, adaptation of resources to meet school capacity/needs, and engaging students as leaders) were cited as key facilitators. Schools discussed factors affecting sustainability, such as school culture and knowledge of school wellness policy.ConclusionsThe results from this implementation study document the importance of allowing schools to adapt programming to meet their local needs, and highlight the strengths of measuring multiple implementation outcomes. Increased support is needed for schools regarding the formation and improvement of wellness policies as a means to enhance sustainability over time.

Project description:BACKGROUND:The prevalence of dementia is surging that results in huge service demand in the community care services. Dementia care competence of staff working in these settings is fundamental of the care quality. This project aims to examine the effects of staff training on their competence for the anticipated challenges in dementia care and explore how the training influence their care practices. METHODS:This study adopted a mixed methods triangulation design, including a prospective multi-center study with pre-test post-test evaluations and a narrative analysis of the participants' reflective essays. Seventeen experienced health and social care professionals were trained as trainers at the Dementia Services Development Centre of the University of Stirling, UK. The trainers provided local facilitator training to staff members by using training materials that were culturally adapted to the local context. The facilitators were required to deliver 12 two-hour in-service training sessions for 6 months to their colleagues in a small group format in their respective workplace. Eventually a total of 1347 staff members from community care centers, day care centers, outreach teams and care homes of 70 non-government organizations in Hong Kong participated in the study between April 2017 and December 2018. Validated instruments were used to measure knowledge, attitude, sense of competence in dementia care and job satisfaction at the baseline and at 12-month follow-up. All participants were required to write a reflective essay to describe their experiences in dementia care by the end of the training. RESULTS:A total of 1264 participants, including 195 facilitators and 1069 learners, completed all assessment were included for analysis. Significant improvements were observed in all outcomes at the 12-month follow-up assessment (Ps???.001). The magnitude of improvements in attitudes was the largest. The findings also showed that the effects of the training program significantly varied across different groups of learners in terms of age, occupation, work and training experience. CONCLUSIONS:This community-wide large-scale project provided evidence that the train-the-trainer model and reflective learning are effective means to facilitate situated learning that promote awareness and understanding of dementia, and consequently enhance sustainability of changes in care practices.

Project description:Background Team-Based Learning (TBL) is an established educational strategy which has become increasingly popular in the training of healthcare professionals. TBL is highly suitable for teaching Family Medicine (FM) especially that teamwork and collaborative care, in this medical discipline, are at the core of safe and effective practice. Despite the established suitability of TBL for teaching FM, there are no empirical studies that capture the students’ perception of a TBL in FM undergraduate learning experience in the Middle East and North Africa region (MENA). Objective The overall objective of this study was to investigate the perception of students regarding a TBL in FM intervention (in Dubai, United Arab Emirates), that was designed and implemented in alignment with a constructivist learning theory. Methods A convergent mixed methods study design was utilized to develop a thorough understanding of the students’ perceptions. Qualitative and quantitative data were concurrently collected and independently analyzed. The output of thematic analysis was systematically merged with the quantitative descriptive and inferential findings using the iterative joint display process. Results The qualitative findings shed light on the students’ perception of TBL in FM, and the interplay between team cohesion and engagement with the course. As for the quantitative findings, they showed that the percentage of the total average of the Satisfaction with TBL in FM score was 88.80%. As for change in impression of FM discipline, the percentage of the total average was 83.10%. The perception of team cohesion, with a mean of agreement of 8.62(1.34), seemed to be significantly associated with the students’ perception of the team test phase component, only (P < 0.05). As for the perception of the level of engagement with the course, with a mean of agreement of 9.29(0.84), it turned out to be significantly associated with the change in impression of FM discipline (P < 0.05). Lastly, the joint display analysis showed how the quantitative and qualitative findings built upon each other, revealing how best to leverage TBL in FM trainings. Conclusion The current study showed that TBL embedded in a FM clinical clerkship was well-received by students. It is worth leveraging the lessons learned from the first-hand experience reported upon in the current study to optimize the utilization of TBL in FM. Supplementary Information The online version contains supplementary material available at 10.1186/s12909-023-04240-1.

Project description:BackgroundCross-system interventions can help integrate services across different service delivery systems but require organizations to establish strong collaborative relationships for implementation. Contingency theory suggests that the effectiveness of different collaborative strategies (i.e. specific ways organizations align operations and services) varies by context. This paper describes a study of different strategies for fostering collaboration between child welfare and substance abuse treatment agencies and the conditions under which they are effective for implementation. We also describe the development and piloting of the Collaborating Across Systems for Program Implementation (CASPI) tool-a decision-making guide intended to help researchers and organizational leaders identify and use appropriate collaborative strategies for their context.Methods/designThis multisite longitudinal, mixed methods study, leverages a naturally occurring implementation initiative -- in up to 17 Ohio counties -- to implement Ohio START (Sobriety Treatment and Reducing Trauma). START is a child welfare model that requires strong collaboration with local substance use treatment organizations to promote integrated services. During the first two years, we will identify collaborative strategies associated with improved START implementation (penetration and fidelity) and service delivery outcomes (timeliness), given system, and organizational features. We will conduct a convergent mixed methods study drawing on worker surveys, agency documents, administrative data, formal partner agreements, and group interviews. Data will be integrated and analyzed using Qualitative Comparative Analysis (QCA). To develop the CASPI, an expert panel comprised of implementation experts, and community stakeholders will convene to synthesize our findings and develop contents (including a decision tree). During the final year of the study, we will assess the acceptability, appropriateness, and feasibility of the CASPI in a randomized vignette experiment, and a pilot-test with 3 child welfare agencies that have not yet implemented START.DiscussionOur results will lay the groundwork for a larger controlled trial that will test the CASPI's effectiveness for supporting effective and efficient implementation of cross-system interventions like START. The CASPI is expected to help leaders and researchers select and use collaboration strategies tailored to their context and be applicable in a wide range of settings including rural communities. Our work also advances system-level implementation strategies.Trial registrationNCT03931005 , Registered April 29, 2019.

Project description:ObjectiveMultidisciplinary team (MDT) meetings are assumed to produce better decisions and are extensively used to manage chronic disease in the National Health Service (NHS). However, evidence for their effectiveness is mixed. Our objective was to investigate determinants of MDT effectiveness by examining factors influencing the implementation of MDT treatment plans. This is a proxy measure of effectiveness, because it lies on the pathway to improvements in health, and reflects team decision making which has taken account of clinical and non-clinical information. Additionally, this measure can be compared across MDTs for different conditions.MethodsWe undertook a prospective mixed-methods study of 12 MDTs in London and North Thames. Data were collected by observation of 370 MDT meetings, interviews with 53 MDT members, and from 2654 patient medical records. We examined the influence of patient-related factors (disease, age, sex, deprivation, whether their preferences and other clinical/health behaviours were mentioned) and MDT features (as measured using the 'Team Climate Inventory' and skill mix) on the implementation of MDT treatment plans.ResultsThe adjusted odds (or likelihood) of implementation was reduced by 25% for each additional professional group represented at the MDT meeting. Implementation was more likely in MDTs with clear goals and processes and a good 'Team Climate' (adjusted OR 1.96; 95% CI 1.15 to 3.31 for a unit increase in Team Climate Inventory (TCI) score). Implementation varied by disease category, with the lowest adjusted odds of implementation in mental health teams. Implementation was also lower for patients living in more deprived areas (adjusted odds of implementation for patients in the most compared with least deprived areas was 0.60, 95% CI 0.39 to 0.91).ConclusionsGreater multidisciplinarity is not necessarily associated with more effective decision making. Explicit goals and procedures are also crucial. Decision implementation should be routinely monitored to ensure the equitable provision of care.

Project description:IntroductionBehavioural parent training (BPT) programmes are effective in preventing and treating early-onset conduct problems and child maltreatment. Unfortunately, pervasive mental health service disparities continue to limit access to and engagement in these interventions. Furthermore, challenges with parental engagement can impede the successful implementation of evidence-based practices (EBPs) in community settings that serve low-income, ethnic minority families. Lay health workers (LHWs)-individuals without formal mental health training-represent an important workforce to increase engagement, as they are members of the communities they serve. However, the mobilisation of LHWs has not been well studied as an implementation strategy to extend the reach or effectiveness of EBPs in the USA. LHW-delivered implementation interventions that specifically support the engagement of Latinx parents in evidence-based BPT programmes have the potential to improve clinical and implementation outcomes.Methods and analysisA community-partnered approach will use the Quality Implementation Framework (QIF) to tailor and implement an LHW-delivered implementation intervention that aims to promote Latinx parent engagement in BPT programmes. Steps from the QIF will guide study activities to (1) conduct a mixed methods needs assessment to fit the implementation intervention to the local context, (2) adapt LHW-delivered implementation strategies to promote parent access to and engagement in Parent-Child Interaction Therapy and (3) conduct a hybrid effectiveness-implementation pilot trial to examine the feasibility, acceptability and preliminary effectiveness of the LHW implementation intervention at increasing engagement.Ethics and disseminationStudy procedures have been approved by the Institutional Review Board at the University of California, Santa Barbara. Results will be shared with the community-advisory group, at community-based meetings for other stakeholders involved in the pilot project, and submitted for publication in peer-reviewed journals.