Dataset Information

Building implementation capacity (BIC): a longitudinal mixed methods evaluation of a team intervention.

ABSTRACT:

Background

Managers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.

Methods

A non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.

Results

Overall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).

Conclusions

The intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

SUBMITTER: Mosson R

PROVIDER: S-EPMC6505288 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Building implementation capacity (BIC): a longitudinal mixed methods evaluation of a team intervention.

Mosson Rebecca R Augustsson Hanna H Bäck Annika A Åhström Mårten M von Thiele Schwarz Ulrica U Richter Anne A Gunnarsson Malin M Hasson Henna H

BMC health services research 20190507 1

<h4>Background</h4>Managers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.<h4>Methods</h4>A non-randomized design was used, wit ...[more]

PMID: 31064362

Similar Datasets

Project description:BackgroundTo ensure the provision of high-quality safety and cost-effective health and welfare services, managers and professionals are required to introduce and ensure the routine use of clinical guidelines and other evidence-based interventions. Despite this, they often lack training and support in implementation. This project aims to investigate how a team training intervention, with the goal to build implementation capacity, influences participants' implementation knowledge and skills, as well as how it influences implementation activities and implementation capacity within participating health and welfare organizations. Furthermore, the aim is to investigate how the organizations' contexts influence the intervention outcomes.MethodsThe building implementation capacity (BIC) intervention builds on the behavior change wheel, which considers implementation as a matter of behavior change. The intervention will be provided to teams of managers and professionals working in health and welfare organizations and seeking support to implement a guideline- or evidence-based intervention. The intervention consists of a series of interactive workshops that provides the participating teams with the knowledge and skills to apply a systematic implementation model. A longitudinal mixed-methods evaluation, including interviews, surveys, and document analysis, will be applied over 24 months. The normalization process theory measure will be used to assess how the intervention influences implementation activities in practice and implementation capacity in the teams and the wider organizations.DiscussionThis project has an ambition to add to the knowledge concerning how to promote the uptake of research findings into health care by building implementation capacity through team training in implementation. The project's uniqueness is that it is designed to move beyond individual-level outcomes and evaluate implementation activities and implementation capacity in participating organizations. Further, the intervention will be evaluated over 24 months to investigate long-term outcomes of implementation training.

Project description:BackgroundSchool wellness programming is important for promoting healthy lifestyles and academic achievement in youth; however, research is needed on methods that can help schools implement and sustain such programs on their own. The purpose of this study was to investigate factors within and outside the school environment that influenced school capacity for implementation and potential sustainability of wellness programming.MethodsAs part of the School Wellness Integration Targeting Child Health (SWITCH®) intervention, elementary school wellness teams (N?=?30) were guided through a capacity-building process focused on promoting the adoption of healthy lifestyle behaviors in students. Data on implementation were collected through three standardized surveys and interviews (pre-mid-post) and a post-implementation interview. Indicators of organizational capacity were assessed using the School Wellness Readiness Assessment (SWRA). Paired t-tests were run to assess changes in implementation (classroom, physical education, and lunchroom settings), capacity, and stakeholder engagement over time. One-way analysis of variance (ANOVA) tests were run to examine how implementation of best practices (low, moderate, high) explained differences in capacity gains. Qualitative data were analyzed through inductive and deductive analysis, following the Consolidated Framework for Implementation Research (CFIR).ResultsPaired t-tests showed non-significant increases in school and setting-specific capacity and implementation of SWITCH best practices over time, in addition to a consistent level of engagement from key stakeholders. ANOVA results revealed non-significant associations between implementation group and gains in school capacity (F [2, 24] = 1.63; p?=?.21), class capacity (F [2, 24]=0.20 p?=?.82), lunchroom capacity (F [2, 24]=0.29; p?=?.78), and physical education (F [2, 24]=1.45; p?=?.25). Qualitative data demonstrated that factors within the outer setting (i.e., engaging community partners) facilitated programming. Inner-setting factors (i.e., relationships with administration and staff) influenced implementation. Implementation process themes (e.g., planning, adaptation of resources to meet school capacity/needs, and engaging students as leaders) were cited as key facilitators. Schools discussed factors affecting sustainability, such as school culture and knowledge of school wellness policy.ConclusionsThe results from this implementation study document the importance of allowing schools to adapt programming to meet their local needs, and highlight the strengths of measuring multiple implementation outcomes. Increased support is needed for schools regarding the formation and improvement of wellness policies as a means to enhance sustainability over time.

Project description:BackgroundCommunity-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implementation was related to participant outcomes, and identify barriers and facilitators to implementation that could be addressed.MethodsThis study utilized quantitative participant evaluation data (n = 115) and quantitative and qualitative data from semi-structured interviews with program instructors (N = 13). At the participant level, demographic data (age, sex, insurance status) and behavior change intention were captured. Instructor data included implementation of program components and program attendance to create a 7-point implementation score of fidelity and reach variables. Degree of program implementation (high and low) was operationalized based on these variables (low: 0-4, high: 5-7). Relationships among degree of implementation, participant demographics, and participant outcomes (e.g., intent to be physically active or limit alcohol) were assessed using linear or ordinal logistic mixed effects models as appropriate. Interview data were transcribed and coded deductively for CFIR constructs, and constructs were then rated for magnitude and valence. Patterns between ratings of high and low implementation programs were used to determine constructs that manifested as barriers or facilitators.ResultsProgram implementation varied with scores ranging from 4 to 7. High implementation was related to greater improvements in intention to be physically active (p < 0.05), achieve a healthy weight (p < 0.05), and limit alcohol (p < 0.01). Eight constructs distinguished between high and low implementation programs. Design quality and packaging, compatibility, external change agents, access to knowledge and information, and experience were facilitators of implementation and formally appointed internal implementation leaders was a barrier to implementation.ConclusionsAs higher implementation was related to improved participant outcomes, program administrators should emphasize the importance of fidelity in training for program instructors. The CFIR can be used to identify barriers and/or facilitators to implementation in community interventions, but results may be unique from clinical contexts.

Project description:BACKGROUND:Wearable technology interventions combined with digital behavior change resources provide opportunities to increase physical activity in adolescents. The implementation of such interventions in real-world settings is unknown. The Raising Awareness of Physical Activity (RAW-PA) study was a 12-week cluster randomized controlled trial targeting inactive adolescents attending schools in socioeconomically disadvantaged areas of Melbourne, Australia. The aim was to increase moderate- to vigorous-intensity physical activity using (1) a wrist-worn Fitbit Flex and app, (2) weekly challenges, (3) digital behavior change resources, and (4) email or text message alerts. OBJECTIVE:This paper presents adolescents' and teachers' perceptions of RAW-PA in relation to program acceptability, feasibility and perceived impact, adolescent engagement and adherence, and the potential for future scale-up. METHODS:A mixed methods evaluation of the RAW-PA study assessed acceptability, engagement, feasibility, adherence, and perceived impact. A total of 9 intervention schools and 144 intervention adolescents were recruited. Only adolescents and teachers (n=17) in the intervention group were included in the analysis. Adolescents completed web-based surveys at baseline and surveys and focus groups postintervention. Teachers participated in interviews postintervention. Facebook data tracked engagement with web-based resources. Descriptive statistics were reported by sex. Qualitative data were analyzed thematically. RESULTS:Survey data were collected from 142 adolescents at baseline (mean age 13.7 years, SD 0.4 years; 51% males) and 132 adolescents postintervention. A total of 15 focus groups (n=124) and 9 interviews (n=17) were conducted. RAW-PA had good acceptability among adolescents and teachers. Adolescents perceived the intervention content as easy to understand (100/120, 83.3%) and the Fitbit easy to use (112/120; 93.3%). Half of the adolescents perceived the text messages to be useful (61/120; 50.8%), whereas 47.5% (57/120) liked the weekly challenges and 38.3% (46/120) liked the Facebook videos. Facebook engagement declined over time; only 18.6% (22/118) of adolescents self-reported wearing the Fitbit Flex daily postintervention. Adolescents perceived the Fitbit Flex to increase their physical activity motivation (85/120, 70.8%) and awareness (93/119, 78.2%). The web-based delivery facilitated implementation of the intervention, although school-level policies restricting phone use were perceived as potential inhibitors to program roll-out. CONCLUSIONS:RAW-PA showed good acceptability among adolescents attending schools in socioeconomically disadvantaged areas and their teachers. Low levels of teacher burden enhanced their perceptions concerning the feasibility of intervention delivery. Although adolescents perceived that RAW-PA had short-term positive effects on their motivation to be physically active, adolescent adherence and engagement were low. Future research exploring the feasibility of different strategies to engage adolescents with wearable technology interventions and ways of maximizing system-level embeddedness of interventions in practice would greatly advance the field.

Project description:BACKGROUND:The prevalence of dementia is surging that results in huge service demand in the community care services. Dementia care competence of staff working in these settings is fundamental of the care quality. This project aims to examine the effects of staff training on their competence for the anticipated challenges in dementia care and explore how the training influence their care practices. METHODS:This study adopted a mixed methods triangulation design, including a prospective multi-center study with pre-test post-test evaluations and a narrative analysis of the participants' reflective essays. Seventeen experienced health and social care professionals were trained as trainers at the Dementia Services Development Centre of the University of Stirling, UK. The trainers provided local facilitator training to staff members by using training materials that were culturally adapted to the local context. The facilitators were required to deliver 12 two-hour in-service training sessions for 6 months to their colleagues in a small group format in their respective workplace. Eventually a total of 1347 staff members from community care centers, day care centers, outreach teams and care homes of 70 non-government organizations in Hong Kong participated in the study between April 2017 and December 2018. Validated instruments were used to measure knowledge, attitude, sense of competence in dementia care and job satisfaction at the baseline and at 12-month follow-up. All participants were required to write a reflective essay to describe their experiences in dementia care by the end of the training. RESULTS:A total of 1264 participants, including 195 facilitators and 1069 learners, completed all assessment were included for analysis. Significant improvements were observed in all outcomes at the 12-month follow-up assessment (Ps???.001). The magnitude of improvements in attitudes was the largest. The findings also showed that the effects of the training program significantly varied across different groups of learners in terms of age, occupation, work and training experience. CONCLUSIONS:This community-wide large-scale project provided evidence that the train-the-trainer model and reflective learning are effective means to facilitate situated learning that promote awareness and understanding of dementia, and consequently enhance sustainability of changes in care practices.

Project description:Aims and objectivesTo investigate uptake of a Chest Injury Protocol (ChIP), examine factors influencing its implementation and identify interventions for promoting its use.BackgroundFailure to treat blunt chest injuries in a timely manner with sufficient analgesia, physiotherapy and respiratory support, can lead to complications such as pneumonia and respiratory failure and/or death.DesignThis is a mixed-methods implementation evaluation study.MethodsTwo methods were used: (i) identification and review of the characteristics of all patients eligible for the ChIP protocol, and (ii) survey of hospital staff opinions mapped to the Theoretical Domains Framework (TDF) to identify barriers and facilitators to implementation. The characteristics and treatment received between the groups were compared using the chi-square test or Fischer's exact test for proportions, and the Mann-Whitney U-test for continuous data. Quantitative survey data were analysed using descriptive statistics. Qualitative data were coded in NVivo 10 using a coding guide based on the TDF and Behaviour Change Wheel (BCW). Identification of interventions to change target behaviours was sourced from the Behaviour Change Technique Taxonomy Version 1 in consultation with stakeholders.ResultsOnly 68.4% of eligible patients received ChIP. Fifteen facilitators and 10 barriers were identified to influence the implementation of ChIP in the clinical setting. These themes were mapped to 10 of the 14 TDF domains and corresponded with all nine intervention functions in the BCW. Seven of these intervention functions were selected to address the target behaviours and a multi-faceted relaunch of the revised protocol developed. Following re-launch, uptake increased to 91%.ConclusionsThis study demonstrated how the BCW may be used to revise and improve a clinical protocol in the ED context.Relevance to clinical practiceNewly implemented clinical protocols should incorporate clinician behaviour change assessment, strategy and interventions. Enhancing the self-efficacy of emergency nurses when performing assessments has the potential to improve patient outcomes and should be included in implementation strategy.

Dataset Information

Building implementation capacity (BIC): a longitudinal mixed methods evaluation of a team intervention.

Background

Methods

Results

Conclusions

Publications

Building implementation capacity (BIC): a longitudinal mixed methods evaluation of a team intervention.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets