Dataset Information

Multi-tiered external facilitation: the role of feedback loops and tailored interventions in supporting change in a stepped-wedge implementation trial.

ABSTRACT:

Background

Facilitation is a complex, relational implementation strategy that guides change processes. Facilitators engage in multiple activities and tailor efforts to local contexts. How this work is coordinated and shared among multiple, external actors and the contextual factors that prompt and moderate facilitators to tailor activities have not been well-described.

Methods

We conducted a mixed methods evaluation of a trial to improve the quality of transient ischemic attack care. Six sites in the Veterans Health Administration received external facilitation (EF) before and during a 1-year active implementation period. We examined how EF was employed and activated. Data analysis included prospective logs of facilitator correspondence with sites (160 site-directed episodes), stakeholder interviews (a total of 78 interviews, involving 42 unique individuals), and collaborative call debriefs (n=22) spanning implementation stages. Logs were descriptively analyzed across facilitators, sites, time periods, and activity types. Interview transcripts were coded for content related to EF and themes were identified. Debriefs were reviewed to identify instances of and utilization of EF during site critical junctures.

Results

Multi-tiered EF was supported by two groups (site-facing quality improvement [QI] facilitators and the implementation support team) that were connected by feedback loops. Each site received an average of 24 episodes of site-directed EF; most of the EF was delivered by the QI nurse. For each site, site-directed EF frequently involved networking (45%), preparation and planning (44%), process monitoring (44%), and/or education (36%). EF less commonly involved audit and feedback (20%), brainstorming solutions (16%), and/or stakeholder engagement (5%). However, site-directed EF varied widely across sites and time periods in terms of these facilitation types. Site participants recognized the responsiveness of the QI nurse and valued her problem-solving, feedback, and accountability support. External facilitators used monitoring and dialogue to intervene by facilitating redirection during challenging periods of uncertainty about project direction and feasibility for sites. External facilitators, in collaboration with the implementation support team, successfully used strategies tailored to diverse local contexts, including networking, providing data, and brainstorming solutions.

Conclusions

Multi-tiered facilitation capitalizing on emergent feedback loops allowed for tailored, site-directed facilitation. Critical juncture cases illustrate the complexity of EF and the need to often try multiple strategies in combination to facilitate implementation progress.

Trial registration

The Protocol-guided Rapid Evaluation of Veterans Experiencing New Transient Neurological Symptoms (PREVENT) is a registered trial ( NCT02769338 ), May 11, 2016-prospectively registered.

SUBMITTER: Penney LS

PROVIDER: S-EPMC8317410 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundObstructive sleep apnea (OSA) can negatively impact patients' health status and outcomes. Positive airway pressure (PAP) reverses airway obstruction and may reduce the risk of adverse outcomes. Remote monitoring of PAP (as opposed to in-person visits) may improve access to sleep medicine services. This study aimed to evaluate the feasibility of implementing a clinical program that delivers treatment for OSA through PAP remote monitoring using external facilitation as an implementation strategy.MethodsParticipants included patients with OSA at a Veteran Affairs Medical Center (VAMC). PAP adherence and clinical disease severity on treatment (measured by the apnea hypopnea index [AHI]) were the preliminary effectiveness outcomes across two delivery models: usual care (in-person) and Telehealth nurse-delivered remote monitoring. We also assessed visit duration and travel distance. A prospective, mixed-methods evaluation examined the two-tiered external facilitation implementation strategy.ResultsThe pilot project included N = 52 usual care patients and N = 38 Telehealth nurse-delivered remote monitoring patients. PAP adherence and disease severity were similar across the delivery modalities. However, remote monitoring visits were 50% shorter than in-person visits and saved a mean of 72 miles of travel (median = 45.6, SD = 59.0, mode = 17.8, range 5.4-220). A total of 62 interviews were conducted during implementation with a purposive sample of 12 clinical staff involved in program implementation. Weekly external facilitation delivered to both front-line staff and supervisory physicians was necessary to ensure patient enrollment and treatment. Synchronized, "two-tiered" facilitation at the executive and coordinator levels proved crucial to developing the clinical and administrative infrastructure to support a PAP remote monitoring program and to overcome implementation barriers.ConclusionsRemote PAP monitoring had similar efficacy to in-person PAP services in this Veteran population. Although external facilitation is a widely-recognized implementation strategy in quality improvement projects, less is known about how multiple facilitators work together to help implement complex programs. Two-tiered facilitation offers a model well-suited to programs where innovations span disciplines, disrupt professional hierarchies (such as those between service chiefs, clinicians, and technicians) and bring together providers who do not know each other, yet must collaborate to improve access to care.

Project description:Practice facilitation has been associated with meaningful improvements in disease prevention and quality of patient care. Using practice facilitation, the Improved Delivery of Cardiovascular Care (IDOCC) project aimed to improve the delivery of evidence-based cardiovascular care in primary care practices across a large health region. Our goal was to evaluate IDOCC's impact on adherence to processes of care delivery.A pragmatic stepped wedge cluster randomized trial recruiting primary care providers in practices located in Eastern Ontario, Canada (ClinicalTrials.gov: NCT00574808). Participants were randomly assigned by region to one of three steps. Practice facilitators were intended to visit practices every 3-4 (year 1-intensive) or 6-12 weeks (year 2-sustainability) to support changes in practice behavior. The primary outcome was mean adherence to indicators of evidence-based care measured at the patient level. Adherence was assessed by chart review of a randomly selected cohort of 66 patients per practice in each pre-intervention year, as well as in year 1 and year 2 post-intervention.Eighty-four practices (182 physicians) participated. On average, facilitators had 6.6 (min: 2, max: 11) face-to-face visits with practices in year 1 and 2.5 (min: 0 max: 10) visits in year 2. We collected chart data from 5292 patients. After adjustment for patient and provider characteristics, there was a 1.9 % (95 % confidence interval (CI): -2.9 to -0.9 %) and 4.2 % (95 % CI: -5.7 to -2.6 %) absolute decrease in mean adherence from baseline to intensive and sustainability years, respectively.IDOCC did not improve adherence to best-practice guidelines. Our results showed a small statistically significant decrease in mean adherence of questionable clinical significance. Potential reasons for this result include implementation challenges, competing priorities in practices, a broad focus on multiple chronic disease indicators, and use of an overall index of adherence. These results contrast with findings from previously reported facilitation trials and highlight the complexities and challenges of translating research findings into clinical practice.ClinicalTrials.gov NCT00574808.

Project description:BACKGROUND:Internet-based Cognitive Behavioural Therapy (iCBT) is found effective in treating common mental disorders. However, the use of these interventions in routine care is limited. The international ImpleMentAll study is funded by the European Union's Horizon 2020 programme. It is concerned with studying and improving methods for implementing evidence-based iCBT services for common mental disorders in routine mental health care. A digitally accessible implementation toolkit (ItFits-toolkit) will be introduced to mental health care organizations with the aim to facilitate the ongoing implementation of iCBT services within local contexts. This study investigates the effectiveness of the ItFits-toolkit by comparing it to implementation-as-usual activities. METHODS:A stepped wedge cluster randomized controlled trial (SWT) design will be applied. Over a trial period of 30?months, the ItFits-toolkit will be introduced sequentially in twelve routine mental health care organizations in primary and specialist care across nine countries in Europe and Australia. Repeated measures are applied to assess change over time in the outcome variables. The effectiveness of the ItFits-toolkit will be assessed in terms of the degree of normalization of the use of the iCBT services. Several exploratory outcomes including uptake of the iCBT services will be measured to feed the interpretation of the primary outcome. Data will be collected via a centralized data collection system and analysed using generalized linear mixed modelling. A qualitative process evaluation of routine implementation activities and the use of the ItFits-toolkit will be conducted within this study. DISCUSSION:The ImpleMentAll study is a large-scale international research project designed to study the effectiveness of tailored implementation. Using a SWT design that allows to examine change over time, this study will investigate the effect of tailored implementation on the normalization of the use of iCBT services and their uptake. It will provide a better understanding of the process and methods of tailoring implementation strategies. If found effective, the ItFits-toolkit will be made accessible for mental health care service providers, to help them overcome their context-specific implementation challenges. TRIAL REGISTRATION:ClinicalTrials.gov NCT03652883 . Retrospectively registered on 29 August 2018.

Project description:BackgroundIntegrating mental health providers into primary care clinics improves access to and outcomes of mental health care. In the Veterans Health Administration (VA) Primary Care Mental Health Integration (PCMHI) program, mental health providers are co-located in primary care clinics, but the implementation of this model is challenging outside large VA medical centers, especially for rural clinics without full mental health staffing. Long wait times for mental health care, little collaboration between mental health and primary care providers, and sub-optimal outcomes for rural veterans could result. Telehealth could be used to provide PCMHI to rural clinics; however, the clinical effectiveness of the tele-PCMHI model has not been tested. Based on evidence that implementation facilitation is an effective implementation strategy to increase uptake of PCMHI when delivered on-site at larger VA clinics, it is hypothesized that this strategy may also be effective with regard to ensuring adequate uptake of the tele-PCMHI model at rural VA clinics.MethodsThis study is a hybrid type 2 pragmatic effectiveness-implementation trial of tele-PCMHI in six sites over 24 months. Tele-PCMHI, which will be delivered by clinical staff available in routine care settings, will be compared to usual care. Fidelity to the care model will be monitored but not controlled. We will use the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to evaluate the patient-level clinical effectiveness of tele-PCMHI in rural VA clinics and also to evaluate the fidelity to and outcomes of the implementation strategy, implementation facilitation. The proposed study will employ a stepped-wedge design in which study sites sequentially begin implementation in three steps at 6-month intervals. Each step will include (1) a 6-month period of implementation planning, followed by (2) a 6-month period of active implementation, and (3) a final period of stepped-down implementation facilitation.DiscussionThis study will evaluate the effectiveness of PCMHI in a novel setting and via a novel method (clinical video telehealth). We will test the feasibility of using implementation facilitation as an implementation strategy to deploy tele-PCMHI in rural VA clinics.Trial registrationClinicalTrials.gov registration number NCT02713217 . Registered on 18 March 2016.

Project description:BACKGROUND:Controlled implementation trials often randomize the intervention at the site level, enrolling relatively few sites (e.g., 6-20) compared to trials that randomize by subject. Trials with few sites carry a substantial risk of an imbalance between intervened (cases) and non-intervened (control) sites in important site characteristics, thereby threatening the internal validity of the primary comparison. A stepped wedge design (SWD) staggers the intervention at sites over a sequence of times or time waves until all sites eventually receive the intervention. We propose a new randomization method, sequential balance, to control time trend in site allocation by minimizing sequential imbalance across multiple characteristics. We illustrate the new method by applying it to a SWD implementation trial. METHODS:The trial investigated the impact of blended internal-external facilitation on the establishment of evidence-based teams in general mental health clinics in nine US Department of Veterans Affairs medical centers. Prior to randomization to start time, an expert panel of implementation researchers and health system program leaders identified by consensus a series of eight facility-level characteristics judged relevant to the success of implementation. We characterized each of the nine sites according to these consensus features. Using a weighted sum of these characteristics, we calculated imbalance scores for each of 1680 possible site assignments to identify the most sequentially balanced assignment schemes. RESULTS:From 1680 possible site assignments, we identified 34 assignments with minimal imbalance scores, and then randomly selected one assignment by which to randomize start time. Initially, the mean imbalance score was 3.10, but restricted to the 34 assignments, it declined to 0.99. CONCLUSIONS:Sequential balancing of site characteristics across groups of sites in the time waves of a SWD strengthens the internal validity of study conclusions by minimizing potential confounding. TRIAL REGISTRATION:Registered at ClinicalTrials.gov as clinical trials # NCT02543840 ; entered 9/4/2015.

Project description:BackgroundStepped wedge cluster randomized trials (SW-CRT) are increasingly used to evaluate new clinical programs, yet there is limited guidance on practical aspects of applying this design. We report our early experiences conducting a SW-CRT to examine an inpatient mobility program (STRIDE) in the Veterans Health Administration (VHA). We provide recommendations for future research using this design to evaluate clinical programs.MethodsBased on data from study records and reflections from the investigator team, we describe and assess the design and initial stages of a SW-CRT, from site recruitment to program launch in 8 VHA hospitals.ResultsSite recruitment consisted of thirty 1-h conference calls with representatives from 22 individual VAs who expressed interest in implementing STRIDE. Of these, 8 hospitals were enrolled and randomly assigned in two stratified blocks (4 hospitals per block) to a STRIDE launch date. Block 1 randomization occurred in July 2017 with first STRIDE launch in December 2017; block 2 randomization occurred in April 2018 with first STRIDE launch in January 2019. The primary study outcome of discharge destination will be assessed using routinely collected data in the electronic health record (EHR). Within randomized blocks, two hospitals per sequence launched STRIDE approximately every 3 months with primary outcome assessment paused during the 3-month time period of program launch. All sites received 6-8 implementation support calls, according to a pre-specified schedule, from the time of recruitment to program launch, and all 8 sites successfully launched within their assigned 3-month window. Seven of the eight sites initially started with a limited roll out (for example on one ward) or modified version of STRIDE (for example, using existing staff to conduct walks until new positions were filled).ConclusionsFuture studies should incorporate sufficient time for site recruitment and carefully consider the following to inform design of SW-CRTs to evaluate rollout of a new clinical program: (1) whether a blocked randomization fits study needs, (2) the amount of time and implementation support sites will need to start their programs, and (3) whether clinical programs are likely to include a "ramp-up" period. Successful execution of SW-CRT designs requires both adherence to rigorous design principles and also careful consideration of logistical requirements for timing of program roll out.Trial registrationClinicalsTrials.gov NCT03300336 . Prospectively registered on 3 October 2017.

Project description:BackgroundRelatively little guidance exists on how to use virtual implementation facilitation to successfully implement evidence-based practices and innovations into clinical programs. Yet virtual methods are increasingly common. They have potentially wider reach, emergent public health situations necessitate their use, and restrictions on resources can make them more attractive. We therefore outline a set of principles for virtual external implementation facilitation and a series of recommendations based on extensive experience successfully using virtual external implementation facilitation in a national program.Model and recommendationsSuccess in virtual external implementation facilitation may be achieved by facilitators applying three overarching principles: pilot everything, incorporate a model, and prioritize metacognition. Five practical principles also help: plan in advance, communicate in real time, build relationships, engage participants, and construct a virtual room for participants. We present eight concrete suggestions for enacting the practical principles: (1) assign key facilitation roles to facilitation team members to ensure the program runs smoothly; (2) create small cohorts of participants so they can have meaningful interactions; (3) provide clarity and structure for all participant interactions; (4) structure program content to ensure key points are described, reinforced, and practiced; (5) use visuals to supplement audio content; (6) build activities into the agenda that enable participants to immediately apply knowledge at their own sites, separate from the virtual experience; (7) create backup plans whenever possible; and (8) engage all participants in the program. These principles represent a novel conceptualization of virtual external implementation facilitation, giving structure to a process that has been, to date, inadequately described. The associated actions are demonstrably useful in supporting the principles and offer teams interested in virtual external implementation facilitation concrete methods by which to ensure success. Our examples stem from experiences in healthcare. But the principles can, in theory, be applied to virtual external implementation facilitation regardless of setting, as they and the associated actions are not setting specific.

Project description:BackgroundFacilitation is a powerful approach to support practice change. The purpose of this study is to better understand the facilitation roles exercised by both external facilitators and interprofessional facilitation teams to foster the implementation of change. Building on Dogherty et al.'s taxonomy of facilitation activities, this study uses an organizational development lens to identify and analyze facilitation roles. It includes a concise definition of what interprofessional facilitation teams actually do, thus expanding our limited knowledge of teams that act as change agents. We also investigate the facilitation dynamics between change actors.MethodsWe carried out a qualitative analysis of a 1-year process of practice change implementation. We studied four family medicine groups, in which we constituted interprofessional facilitation teams. Each team was supported by one external facilitator and included at least one family physician, one case manager nurse, and health professionals located on or off the family medicine group's site (one pharmacist, plus at least one nutritionist, kinesiologist, or psychologist). We collected our data through focus group interviews with the four teams, individual interviews with the two external facilitators, and case audit documentation. We analyzed both predetermined (as per Dogherty et al., 2012) and emerging facilitation roles, as well as facilitation dynamics.ResultsA non-linear framework of facilitation roles emerged from our data, based on four fields of expertise: change management, project management, meeting management, and group/interpersonal dynamics. We identified 72 facilitation roles, grouped into two categories: "implementation-oriented" and "support-oriented." Each category was subdivided into themes (n = 6; n = 5) for clearer understanding (e.g., legitimation of change/project, management of effective meetings). Finally, an examination of facilitation dynamics revealed eight relational ties occurring within and/or between groups of actors.ConclusionsFacilitation is an approach used by appointed individuals, which teams can also foster, to build capacity and support practice change. Increased understanding of facilitation roles constitutes an asset in training practitioners such as organizational development experts, consultants, facilitators, and facilitation teams. It also helps decision makers become aware of the multiple roles and dynamics involved and the key competencies needed to recruit facilitators and members of interprofessional facilitation teams.

Project description:BackgroundFacilitation has been identified in the literature as a potentially key component of successful implementation. It has not, however, either been well-defined or well-studied. Significant questions remain about the operational definition of facilitation and about the relationship of facilitation to other interventions, especially to other change agent roles when used in multi-faceted implementation projects. Researchers who are part of the Quality Enhancement Research Initiative (QUERI) are actively exploring various approaches and processes, including facilitation, to enable implementation of best practices in the Veterans Health Administration health care system - the largest integrated healthcare system in the United States. This paper describes a systematic, retrospective evaluation of implementation-related facilitation experiences within QUERI, a quality improvement program developed by the US Department of Veterans Affairs.MethodsA post-hoc evaluation was conducted through a series of semi-structured interviews to examine the concept of facilitation across several multi-site QUERI implementation studies. The interview process is based on a technique developed in the field of education, which systematically enhances learning through experience by stimulating recall and reflection regarding past complex activities. An iterative content analysis approach relative to a set of conceptually-based interview questions was used for data analysis.FindingsFindings suggest that facilitation, within an implementation study initiated by a central change agency, is a deliberate and valued process of interactive problem solving and support that occurs in the context of a recognized need for improvement and a supportive interpersonal relationship. Facilitation was described primarily as a distinct role with a number of potentially crucial behaviors and activities. Data further suggest that external facilitators were likely to use or integrate other implementation interventions, while performing this problem-solving and supportive role. PRELIMINARY CONCLUSIONS: This evaluation provides evidence to suggest that facilitation could be considered a distinct implementation intervention, just as audit and feedback, educational outreach, or similar methods are considered to be discrete interventions. As such, facilitation should be well-defined and explicitly evaluated for its perceived usefulness within multi-intervention implementation projects. Additionally, researchers should better define the specific contribution of facilitation to the success of implementation in different types of projects, different types of sites, and with evidence and innovations of varying levels of strength and complexity.