Dataset Information

Implementation strategy fidelity evaluation for a multidisciplinary Chest Injury Protocol (ChIP).

ABSTRACT:

Background

Blunt chest wall injuries can lead to complications, especially without early intervention. A blunt Chest Injury Protocol (ChIP) was developed to help improve the consistency of evidence-based care following admission to the emergency department. Implementation strategy fidelity is the extent to which the strategies of implementation are delivered in line with the intended plan. The aim of this study was to assess fidelity to the strategies of the implementation plan developed for ChIP.

Methods

A retrospective evaluation of strategies used for implementation was performed, specifically the behaviour change techniques (BCTs). BCTs were used as part of an implementation plan derived based on the Behaviour Change Wheel from results from a staff survey at two hospitals. Levels of implementation or adaptation for BCTs were scored by implementers as follows: 'Were the behaviour change interventions implemented?' (0 = 'not implemented', 1 = partially implemented, and 2 = fully implemented); 'Were adaptations made to the implementation plan?', scored 1 (many changes from plan) to 4 (just as planned). Free text explanation to their responses was also collected with supporting evidence and documentation (such as emails, implementation checklists, audit reports, and incident reports).

Results

There was high overall fidelity of 97.6% for BCTs partially or fully implemented. More than three quarters (32/42, 76.2%) of the BCTs were fully implemented with an additional 9/42 (21.4%) partially implemented. BCTs that were not fully implemented were social support, feedback on behaviour, feedback on outcomes of behaviour, adding objects to the environment, and restructuring the environment. The modes of delivery with poorer implementation or increased adaptations were clinical champions and audit/feedback.

Conclusions

This study describes the evaluation of implementation strategy fidelity in the acute care context. The systematic use and application of the behaviour change wheel was used to develop an implementation plan and was associated with high implementation strategy fidelity. A fidelity checklist developed during the implementation process may help implementers assess fidelity.

Trial registration

Trial registered on ANZCTR. Registration number ACTRN12618001548224 , date approved 17/09/2018.

SUBMITTER: Kourouche S

PROVIDER: S-EPMC8353870 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundBlunt chest injury leads to significant morbidity and mortality. The aim of this study was to evaluate the effect of a multidisciplinary chest injury care bundle (ChIP) on patient and health service outcomes. ChIP provides guidance in three key pillars of care for blunt chest injury-respiratory support, analgesia and complication prevention. ChIP was implemented using a multi-faceted implementation plan developed using the Behaviour Change Wheel.MethodsThis controlled pre-and post-test study (two intervention and two non-intervention sites) was conducted from July 2015 to June 2019. The primary outcome measures were unplanned Intensive Care Unit (ICU) admissions, non-invasive ventilation use and mortality.ResultsThere were 1790 patients included. The intervention sites had a 58% decrease in non-invasive ventilation use in the post- period compared to the pre-period (95% CI 0.18-0.96). ChIP was associated with 90% decreased odds of unplanned ICU admissions (95% CI 0.04-0.29) at the intervention sites compared to the control groups in the post- period. There was no significant change in mortality. There were higher odds of health service team reviews (surgical OR 6.6 (95% CI 4.61-9.45), physiotherapy OR 2.17 (95% CI 1.52-3.11), ICU doctor OR 6.13 (95% CI 3.94-9.55), ICU liaison OR 55.75 (95% CI 17.48-177.75), pain team OR 8.15 (95% CI 5.52 --12.03), analgesia (e.g. patient controlled analgesia OR 2.6 (95% CI 1.64-3.94) and regional analgesia OR 8.8 (95% CI 3.39-22.79), incentive spirometry OR 8.3 (95% CI 4.49-15.37) and, high flow nasal oxygen OR 22.1 (95% CI 12.43-39.2) in the intervention group compared to the control group in the post- period.ConclusionThe implementation of a chest injury care bundle using behaviour change theory was associated with a sustained improvement in evidence-based practice resulting in reduced unplanned ICU admissions and non-invasive ventilation requirement.Trial registrationANZCTR: ACTRN12618001548224, approved 17/09/2018.

Project description:BACKGROUND:Accessibility to efficient and person-centered healthcare delivery drives healthcare transformation in many countries. In Singapore, specialist outpatient clinics (SOCs) are commonly congested due to increasing demands for chronic care. To improve this situation, the National University Health System (NUHS) Regional Health System (RHS) started an integrated care initiative,the Right-Site Care (RSC) program in 2014. Through collaborations between SOCs at the National University Hospital and primary and community care (PCC) clinics in the western region of the county, the program was designed to facilitate timely discharge and appropriate transition of patients, who no longer required specialist care, to the community. The aim of this study was to evaluate the implementation fidelity of the NUHS RHS RSC program using the modified Conceptual Framework for Implementation Fidelity (CFIF), at three distinct levels; providers, organizational, and system levels to explain outcomes of the program and to inform further development of (similar) programs. METHODS:A convergent parallel mixed methods study using the realist evaluation approach was used. Data were collected between 2016 and 2018 through non-participatory observations, reviews of medical records and program database, together with semi-structured interviews with healthcare providers. Triangulation of data streams was applied guided by the modified CFIF. RESULTS:Our findings showed four out of six program components were implemented with low level of fidelity, and 9112 suitable patients were referred to the program while 3032 (33.3%) declined to be enrolled. Moderating factors found to influence fidelity included: (i) complexity of program, (ii) evolving providers' responsiveness, (iii) facilitation through synergistic partnership, training of PCC providers by specialists and supportive structures: care coordinators, guiding protocols, shared electronic medical record and shared pharmacy, (iv) lack of organization reinforcement, and (v) mismatch between program goals, healthcare financing and providers' reimbursement. CONCLUSION:Functional integration alone is insufficient for a successful right-site care program implementation. Improvement in relationships between providers, organizations, and patients are also warranted for further development of the program.

Project description:Aims and objectivesTo investigate uptake of a Chest Injury Protocol (ChIP), examine factors influencing its implementation and identify interventions for promoting its use.BackgroundFailure to treat blunt chest injuries in a timely manner with sufficient analgesia, physiotherapy and respiratory support, can lead to complications such as pneumonia and respiratory failure and/or death.DesignThis is a mixed-methods implementation evaluation study.MethodsTwo methods were used: (i) identification and review of the characteristics of all patients eligible for the ChIP protocol, and (ii) survey of hospital staff opinions mapped to the Theoretical Domains Framework (TDF) to identify barriers and facilitators to implementation. The characteristics and treatment received between the groups were compared using the chi-square test or Fischer's exact test for proportions, and the Mann-Whitney U-test for continuous data. Quantitative survey data were analysed using descriptive statistics. Qualitative data were coded in NVivo 10 using a coding guide based on the TDF and Behaviour Change Wheel (BCW). Identification of interventions to change target behaviours was sourced from the Behaviour Change Technique Taxonomy Version 1 in consultation with stakeholders.ResultsOnly 68.4% of eligible patients received ChIP. Fifteen facilitators and 10 barriers were identified to influence the implementation of ChIP in the clinical setting. These themes were mapped to 10 of the 14 TDF domains and corresponded with all nine intervention functions in the BCW. Seven of these intervention functions were selected to address the target behaviours and a multi-faceted relaunch of the revised protocol developed. Following re-launch, uptake increased to 91%.ConclusionsThis study demonstrated how the BCW may be used to revise and improve a clinical protocol in the ED context.Relevance to clinical practiceNewly implemented clinical protocols should incorporate clinician behaviour change assessment, strategy and interventions. Enhancing the self-efficacy of emergency nurses when performing assessments has the potential to improve patient outcomes and should be included in implementation strategy.

Project description:BackgroundAssessing the fidelity of an implementation strategy is important to understand why and how the strategy influences the uptake of evidence-based interventions. The present study aims to assess the fidelity of the two procedures for engaging primary care (PC) professionals and for the deployment of an implementation strategy for optimizing type 2 diabetes prevention in routine PC within the PREDIAPS randomized cluster implementation trial.MethodWe conducted a mixed-method fidelity evaluation study of the PVS-PREDIAPS implementation strategy. Nine PC centers from the Basque Health Service (Osakidetza) were allocated to two different procedures to engage physicians and nurses and deploy a implementation strategy to model and adapt the clinical intervention and its implementation to their specific contexts: a Global procedure, promoting the cooperation of all healthcare professionals from the beginning; or a Sequential procedure, centered first on nurses who then pursued the pragmatic cooperation of physicians. Process indicators of the delivery and receipt of implementation strategy actions, documented modifications to the planned implementation strategy, and a structured group interview with centers' leaders were all used to assess the following components of fidelity: adherence, dose, quality of delivery, professionals' responsiveness and program differentiation.ResultsGenerally, the procedures compared for professionals engagement and deployment of the implementation strategy were carried out with the planned differentiation. Nonetheless, some unexpected between-group differences were observed, the initial rate of collaboration of nurses being higher in the Sequential (93%) than in the Global (67%) groups. Exposure rate to the programed implementation actions (% of hours received out of those delivered) were similar in both groups by professional category, with nurses (86%) having a higher rate of exposure than physicians (75%). Professionals identified half of the planned discrete strategies and their rating of strategies' perceived usefulness was overwhelmingly positive, with few differences between Sequential and Global centers.ConclusionsThe PVS-PREDIAPS implementation strategy has been implemented with high fidelity and minor unplanned reactive modifications. Professionals' exposure to the implementation strategy was high in both groups. The centers' organizational context (i.e., work overload) led to small mismatches between groups in participation and exposure of professionals to implementation actions.Trial registrationClinicaltrials.gov identifier: NCT03254979 . Registered 16 August 2017.

Project description:BACKGROUND:Although the importance of evaluating implementation fidelity is acknowledged, little is known about heterogeneity in fidelity over time. This study aims to generate insight into the heterogeneity in implementation fidelity trajectories of a health promotion program in multidisciplinary settings and the relationship with changes in patients' health behavior. METHODS:This study used longitudinal data from the nationwide implementation of an evidence-informed physical activity promotion program in Dutch rehabilitation care. Fidelity scores were calculated based on annual surveys filled in by involved professionals (n = ± 70). Higher fidelity scores indicate a more complete implementation of the program's core components. A hierarchical cluster analysis was conducted on the implementation fidelity scores of 17 organizations at three different time points. Quantitative and qualitative data were used to explore organizational and professional differences between identified trajectories. Regression analyses were conducted to determine differences in patient outcomes. RESULTS:Three trajectories were identified as the following: 'stable high fidelity' (n = 9), 'moderate and improving fidelity' (n = 6), and 'unstable fidelity' (n = 2). The stable high fidelity organizations were generally smaller, started earlier, and implemented the program in a more structured way compared to moderate and improving fidelity organizations. At the implementation period's start and end, support from physicians and physiotherapists, professionals' appreciation, and program compatibility were rated more positively by professionals working in stable high fidelity organizations as compared to the moderate and improving fidelity organizations (p < .05). Qualitative data showed that the stable high fidelity organizations had often an explicit vision and strategy about the implementation of the program. Intriguingly, the trajectories were not associated with patients' self-reported physical activity outcomes (adjusted model β = - 651.6, t(613) = - 1032, p = .303). CONCLUSIONS:Differences in organizational-level implementation fidelity trajectories did not result in outcome differences at patient-level. This suggests that an effective implementation fidelity trajectory is contingent on the local organization's conditions. More specifically, achieving stable high implementation fidelity required the management of tensions: realizing a localized change vision, while safeguarding the program's standardized core components and engaging the scarce physicians throughout the process. When scaling up evidence-informed health promotion programs, we propose to tailor the management of implementation tensions to local organizations' starting position, size, and circumstances. TRIAL REGISTRATION:The Netherlands National Trial Register NTR3961 . Registered 18 April 2013.

Project description:Background Implementation of clinical medication reviews in daily practice is scarcely evaluated. The Opti-Med intervention applied a structured approach with external expert teams (pharmacist and physician) to conduct medication reviews. The intervention was effective with respect to resolving drug related problems, but did not improve quality of life. Objective The objective of this process evaluation was to gain more insight into the implementation fidelity of the intervention. Setting Process evaluation alongside a cluster randomized trial in 22 general practices and 518 patients of 65 years and over. Method A mixed methods design using quantitative and qualitative data and the conceptual framework for implementation fidelity was used. Implementation fidelity is defined as the degree to which the various components of an intervention are delivered as intended. Main outcome measure Implementation fidelity for key components of the Opti-Med intervention. Results Patient selection and preparation of the medication analyses were carried out as planned, although mostly by the Opti-Med researchers instead of practice nurses. Medication analyses by expert teams were performed as planned, as well as patient consultations and patient involvement. 48% of the proposed changes in the medication regime were implemented. Cooperation between expert teams members and the use of an online decision-support medication evaluation facilitated implementation. Barriers for implementation were time constraints in daily practice, software difficulties with patient selection and incompleteness of medical files. The degree of embedding of the intervention was found to influence implementation fidelity. The total time investment for healthcare professionals was 94 min per patient. Conclusion Overall, the implementation fidelity was moderate to high for all key components of the Opti-Med intervention. The absence of its effectiveness with respect to quality of life could not be explained by insufficient implementation fidelity.

Project description:Background"We Act" is a health-promoting school intervention comprising an educational, a parental and a school component. The intervention was implemented in 4 Danish public schools with 4 control schools. The objectives were to improve pupils' dietary habits, physical activity, well-being and social capital using the Investigation, Vision, Action & Change (IVAC) health educational methodology. The target group was pupils in grades 5-6. The purpose of this study was to evaluate implementation fidelity and interacting context factors in the intervention schools.MethodsThe Medical Research Council's new guidance for process evaluation was used as a framework. Data were collected concurrently and evenly at the 4 intervention schools through field visits (n?=?43?days), questionnaires (n?=?17 teachers, 52 parents), and interviews (n?=?9 teachers, 4 principals, 52 pupils). The data were analysed separately and via triangulation.ResultsA total of 289 pupils participated, and 22 teachers delivered the educational component in 12 classes. In all schools, the implementation fidelity to the educational methodology was high for the Investigation and Vision phases as the teachers delivered the proposed lessons and activities. However, the implementation fidelity to the Action & Change phase was low, and little change occurred in the schools. The pupils' presentation of their visions did not work as intended as an impact mechanism to prompt actions. The implementation of the parental and the school components was weak. The main context factors influencing implementation fidelity were a poor fit into the school-year plan and weak management support.ConclusionsAlthough 'We Act' was designed to comply with evidence- and theory-based requirements, IVAC and the health-promoting school approach did not result in change. The time dedicated to schools' preparation and competence development may have been too low. This must be considered in future process evaluation research on health-promoting schools and by school health promotion administrators when planning future school interventions.Trial registrationISRCTN85203017.

Project description:IntroductionEffective implementation of a research Program requires an actionable plan to guide execution. To assess the actionability and success of that plan, both scientific and implementation elements must be taken into account. The aim of this study is to assess the 'Zero Childhood Cancer Personalised Medicine Program' (the Zero Program), an Australian first-ever and most comprehensive personalised medicine programme for children with high-risk or relapsed cancer, in terms of its structure, process and implementational effect.Methods and analysisWe will assess Program delivery mechanisms. The development of the implementation and evaluation strategy will concentrate on the work of the Zero Program as a complex whole. This includes the structure of collaborative links across stakeholder groups involved in Program development and delivery, changes to collaborative relationships over time and the impact of group working on Program outcomes. We are applying a mixed-methods design including: a rapid ethnography (observations of stakeholder interactions and informal conversations), Program professionals' completion of a rapid health implementation proforma and a social network analysis. Formative evaluations of the implementation science effects, applying feedback techniques, for example, Formative Evaluation Feedback Loops and the Zero Program professionals' feedback, will determine where Program tailoring may be needed. A repeat of the social network analysis downstream will examine network changes over time, followed by an expert panel using the expert recommendations for implementing change to assess the integration of implementation strategies into the Program structure. A summative evaluation of the Program will bring the research elements together, leading to comprehensive data triangulation and determining the sustainability and implementational effects of Program delivery.Ethics and disseminationEthical approval for this study has been granted by Hunter New England Research Ethics Committee, New South Wales, Australia (approval ref: 2019/ETH12025). Knowledge translation will be achieved through publications, reports and conference presentations to healthcare professionals, patients, families and researchers.Trial registrationNCT03336931; Pre-results.