Dataset Information

Adapting Evidence-Based Early Psychosis Intervention Services for Virtual Delivery: Protocol for a Pragmatic Mixed Methods Implementation and Evaluation Study.

ABSTRACT:

Background

Timely and comprehensive treatment in the form of early psychosis intervention (EPI) has become the standard of care for youth with psychosis. While EPI services were designed to be delivered in person, the COVID-19 pandemic required many EPI programs to rapidly transition to virtual delivery, with little evidence to guide intervention adaptations or to support the effectiveness and satisfaction with virtual EPI services.

Objective

This study aims to explore the adaptations required to deliver NAVIGATE, a model of coordinated specialty care used in EPI, in a virtual format. This study will evaluate implementation of the NAVIGATE model delivered virtually by describing the nature of the adaptations to the intervention, assessing fidelity to the EPI model and the satisfaction of clients, family members, and care providers. We will investigate barriers and facilitators to virtual NAVIGATE implementation, service engagement, and health equity impacts of this work.

Methods

The Centre for Addiction and Mental Health (Toronto, Ontario, Canada) transitioned to delivering NAVIGATE virtually early in the COVID-19 pandemic. The Framework for Reporting Adaptations and Modifications for Evidence-Based Interventions will be used to describe the adaptations required to deliver NAVIGATE virtually. Fidelity to the EPI model will be measured using the First Episode Psychosis Services Fidelity Scale and fidelity to NAVIGATE will be assessed by investigating adherence to its core components. Implementation facilitators and barriers will be explored using semistructured interviews with providers informed by the Consolidated Framework for Implementation Research. Satisfaction with virtually delivered NAVIGATE will be assessed with virtual client and provider experience surveys and qualitative interviews with clients, family members, and providers. Service engagement data will be collected through review of medical records, and potential impacts of virtually delivered NAVIGATE on different population groups will be assessed with the Health Equity Impact Assessment.

Results

Virtual clinical delivery of NAVIGATE started in March 2020 with additional adaptations and data collection is ongoing. Data will be analyzed using descriptive statistics and survival analysis for quantitative data. Qualitative data will be analyzed using thematic content analysis. Integration of qualitative and quantitative data will occur at the data collection, interpretation, and reporting levels following a convergent design.

Conclusions

This study will provide information regarding the type of intervention adaptations required for virtual delivery of NAVIGATE for youth with early psychosis, ensuring access to high-quality care for this population during the pandemic and beyond by guiding future implementation in similar contexts.

International registered report identifier (irrid)

DERR1-10.2196/34591.

SUBMITTER: Tempelaar W

PROVIDER: S-EPMC8653974 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Background:Youth with autism spectrum disorder (ASD) represent a growing population with significant service needs. Prominent among these needs are high rates of co-occurring psychiatric conditions that contribute to increased functional impairments and often necessitate mental health services. Executive functioning deficits are associated with ASD as well as common co-occurring conditions (e.g., attention-deficit/hyperactivity disorder) and an evidence-based intervention has been developed and tested to address executive functioning within the school context. There is an urgent need to implement indicated evidence-based interventions for youth with ASD receiving care in community mental health settings. Interventions that optimally "fit" the mental health services context as well as the complex and co-occurring mental health needs of these youth have the potential to improve key clinical outcomes for this high priority population. Methods:This mixed-methods developmental study will apply the Exploration, Preparation, Implementation, Sustainment implementation framework and a community-academic partnership approach to systematically adapt and test an evidence-based executive functioning intervention for youth with ASD for delivery in community mental health settings. Specific aims are to (1) conduct a need and context assessment to inform the systematic adaptation an executive functioning evidence-based intervention; (2) systematically adapt the clinical intervention and develop a corresponding implementation plan, together entitled "Executive Functioning for Enhancing Community-based Treatment for ASD," (EFFECT for ASD); and (3) conduct a feasibility pilot test of EFFECT for ASD in community mental health settings. Discussion:Tailoring evidence-based interventions for delivery in community-based mental health services for youth with ASD has the potential to increase quality of care and improve child outcomes. Results from the current study will serve as the foundation for large-scale hybrid implementation and effectiveness trials and a generalizable approach for different service systems of care and clinical populations. Trial registration:Clinicaltrials.gov, NCT04295512.

Project description:BackgroundManagers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.MethodsA non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.ResultsOverall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).ConclusionsThe intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

Project description:BackgroundCommunity-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implementation was related to participant outcomes, and identify barriers and facilitators to implementation that could be addressed.MethodsThis study utilized quantitative participant evaluation data (n?=?115) and quantitative and qualitative data from semi-structured interviews with program instructors (N?=?13). At the participant level, demographic data (age, sex, insurance status) and behavior change intention were captured. Instructor data included implementation of program components and program attendance to create a 7-point implementation score of fidelity and reach variables. Degree of program implementation (high and low) was operationalized based on these variables (low: 0-4, high: 5-7). Relationships among degree of implementation, participant demographics, and participant outcomes (e.g., intent to be physically active or limit alcohol) were assessed using linear or ordinal logistic mixed effects models as appropriate. Interview data were transcribed and coded deductively for CFIR constructs, and constructs were then rated for magnitude and valence. Patterns between ratings of high and low implementation programs were used to determine constructs that manifested as barriers or facilitators.ResultsProgram implementation varied with scores ranging from 4 to 7. High implementation was related to greater improvements in intention to be physically active (p?<? 0.05), achieve a healthy weight (p?<? 0.05), and limit alcohol (p?<? 0.01). Eight constructs distinguished between high and low implementation programs. Design quality and packaging, compatibility, external change agents, access to knowledge and information, and experience were facilitators of implementation and formally appointed internal implementation leaders was a barrier to implementation.ConclusionsAs higher implementation was related to improved participant outcomes, program administrators should emphasize the importance of fidelity in training for program instructors. The CFIR can be used to identify barriers and/or facilitators to implementation in community interventions, but results may be unique from clinical contexts.

Project description:BACKGROUND:The Pragmatic Trial of Video Education in Nursing Homes (PROVEN) is one of the first large pragmatic randomized clinical trials (pRCTs) to be conducted in U.S. nursing homes (N = 119 intervention and N = 241 control across two health-care systems). The trial aims to evaluate the effectiveness of a suite of videos to improve advance care planning (ACP) for nursing home patients. This report uses mixed methods to explore the optimal and suboptimal conditions necessary for implementation fidelity within pRCTs in nursing homes. METHODS:PROVEN's protocol required designated facility champions to offer an ACP video to long-stay patients every 6 months during the 18-month implementation period. Champions completed a video status report, stored within electronic medical records, each time a video was offered. Data from the report were used to derive each facility's adherence rate (i.e., cumulative video offer). Qualitative interviews held after 15 months with champions were purposively sampled from facilities within the highest and lowest adherence rates (i.e., those in the top and bottom quintiles). Two researchers analyzed interview data thematically using a deductive approach based upon six domains of the revised Conceptual Framework for Implementation Fidelity (CFIF). Matrices were developed to compare coded narratives by domain across facility adherence status. RESULTS:In total, 28 interviews involving 33 champions were analyzed. Different patterns were observed across high- versus low-adherence facilities for five CFIF domains. In low-adherence nursing homes, (1) there were limited implementation resources (Context), (2) there was often a perceived negative patient or family responsiveness to the program (Participant Responsiveness), and (3) champions were reticent in offering the videos (Recruitment). In high-adherence nursing homes, (1) there was more perceived patient and family willingness to engage in the program (Participant Responsiveness), (2) champions supplemented the video with ACP conversations (Quality of Delivery), (3) there were strategic approaches to recruitment (Recruitment), and (4) champions appreciated external facilitation (Strategies to Facilitate Implementation). CONCLUSIONS:Critical lessons for implementing pRCTs in nursing homes emerged from this report: (1) flexible fidelity is important (i.e., delivering core elements of an intervention while permitting the adaptation of non-core elements), (2) reciprocal facilitation is vital (i.e., early and ongoing stakeholder engagement in research design and, reciprocally, researchers' and organizational leaders' ongoing support of the implementation), and (3) organizational and champion readiness should be formally assessed early and throughout implementation to facilitate remediation. TRIAL REGISTRATION:ClinicalTrials.gov, NCT02612688. Registered on 19 November 2015.

Project description:BACKGROUND:Wearable technology interventions combined with digital behavior change resources provide opportunities to increase physical activity in adolescents. The implementation of such interventions in real-world settings is unknown. The Raising Awareness of Physical Activity (RAW-PA) study was a 12-week cluster randomized controlled trial targeting inactive adolescents attending schools in socioeconomically disadvantaged areas of Melbourne, Australia. The aim was to increase moderate- to vigorous-intensity physical activity using (1) a wrist-worn Fitbit Flex and app, (2) weekly challenges, (3) digital behavior change resources, and (4) email or text message alerts. OBJECTIVE:This paper presents adolescents' and teachers' perceptions of RAW-PA in relation to program acceptability, feasibility and perceived impact, adolescent engagement and adherence, and the potential for future scale-up. METHODS:A mixed methods evaluation of the RAW-PA study assessed acceptability, engagement, feasibility, adherence, and perceived impact. A total of 9 intervention schools and 144 intervention adolescents were recruited. Only adolescents and teachers (n=17) in the intervention group were included in the analysis. Adolescents completed web-based surveys at baseline and surveys and focus groups postintervention. Teachers participated in interviews postintervention. Facebook data tracked engagement with web-based resources. Descriptive statistics were reported by sex. Qualitative data were analyzed thematically. RESULTS:Survey data were collected from 142 adolescents at baseline (mean age 13.7 years, SD 0.4 years; 51% males) and 132 adolescents postintervention. A total of 15 focus groups (n=124) and 9 interviews (n=17) were conducted. RAW-PA had good acceptability among adolescents and teachers. Adolescents perceived the intervention content as easy to understand (100/120, 83.3%) and the Fitbit easy to use (112/120; 93.3%). Half of the adolescents perceived the text messages to be useful (61/120; 50.8%), whereas 47.5% (57/120) liked the weekly challenges and 38.3% (46/120) liked the Facebook videos. Facebook engagement declined over time; only 18.6% (22/118) of adolescents self-reported wearing the Fitbit Flex daily postintervention. Adolescents perceived the Fitbit Flex to increase their physical activity motivation (85/120, 70.8%) and awareness (93/119, 78.2%). The web-based delivery facilitated implementation of the intervention, although school-level policies restricting phone use were perceived as potential inhibitors to program roll-out. CONCLUSIONS:RAW-PA showed good acceptability among adolescents attending schools in socioeconomically disadvantaged areas and their teachers. Low levels of teacher burden enhanced their perceptions concerning the feasibility of intervention delivery. Although adolescents perceived that RAW-PA had short-term positive effects on their motivation to be physically active, adolescent adherence and engagement were low. Future research exploring the feasibility of different strategies to engage adolescents with wearable technology interventions and ways of maximizing system-level embeddedness of interventions in practice would greatly advance the field.

Project description:BACKGROUND:Disseminating care guidelines into clinical practice remains challenging, partly due to inadequate evidence on how best to help clinics incorporate new guidelines into routine care. This is particularly true in safety net community health centers (CHCs). METHODS:This pragmatic comparative effectiveness trial used a parallel mixed methods design. Twenty-nine CHC clinics were randomized to receive increasingly intensive implementation support (implementation toolkit (arm 1); toolkit + in-person training + training webinars (arm 2); toolkit + training + webinars + offered practice facilitation (arm 3)) targeting uptake of electronic health record (EHR) tools focused on guideline-concordant cardioprotective prescribing for patients with diabetes. Outcomes were compared across study arms, to test whether increased support yielded additive improvements, and with 137 non-study CHCs that share the same EHR as the study clinics. Quantitative data from the CHCs' EHR were used to compare the magnitude of change in guideline-concordant ACE/ARB and statin prescribing, using adjusted Poisson regressions. Qualitative data collected using diverse methods (e.g., interviews, observations) identified factors influencing the quantitative outcomes. RESULTS:Outcomes at CHCs receiving higher-intensity support did not improve in an additive pattern. ACE/ARB prescribing did not improve in any CHC group. Statin prescribing improved overall and was significantly greater only in the arm 1 and arm 2 CHCs compared with the non-study CHCs. Factors influencing the finding of no additive impact included: aspects of the EHR tools that reduced their utility, barriers to providing the intended implementation support, and study design elements, e.g., inability to adapt the provided support. Factors influencing overall improvements in statin outcomes likely included a secular trend in awareness of statin prescribing guidelines, selection bias where motivated clinics volunteered for the study, and study participation focusing clinic staff on the targeted outcomes. CONCLUSIONS:Efforts to implement care guidelines should: ensure adaptability when providing implementation support and conduct formative evaluations to determine the optimal form of such support for a given clinic; consider how study data collection influences adoption; and consider barriers to clinics' ability to use/accept implementation support as planned. More research is needed on supporting change implementation in under-resourced settings like CHCs. TRIAL REGISTRATION:ClinicalTrials.gov, NCT02325531. Registered 15 December 2014.

Project description:BACKGROUND:In low-income countries such as Zambia, where maternal mortality rates are persistently high, maternity waiting homes (MWHs) represent one potential strategy to improve access to safe delivery, especially for women living in remote areas. The Maternity Homes Access in Zambia project (MAHMAZ) is evaluating the impact of a MWH model on women's access to safe delivery in rural Zambia. There is a growing need to understand not only the effectiveness of interventions but also the effectiveness of their implementation in order to appropriately interpret outcomes. There is little evidence to guide effective implementation of MWH for both immediate uptake and to promote sustainability in this context. This protocol describes a study that aims to investigate the effectiveness of the implementation of MAHMAZ by not only documenting fidelity but also identifying factors that influence implementation success and affect longer-term sustainability. METHODS:This study will use mixed methods to evaluate the implementation effectiveness and sustainability of the MAHMAZ intervention. In our study, "implementation effectiveness" means to expand beyond measuring fidelity to the MWH model and includes assessing both the adoption and uptake of the model and identifying those factors that facilitate or inhibit uptake. Sustainability is defined as the routine implementation of an intervention after external support has ended. Quantitative methods include extracting data from existing records at the MWHs and health facilities to analyze patterns of utilization, and conducting a routine health facility assessment to determine facility-level factors that may influence MWH implementation and woman-level outcomes. We will also conduct an experience survey with MWH users and apply a checklist to assess fidelity to the MWH model. Qualitative methods include in-depth interviews and focus group discussions with MWH users, community members and other stakeholders. Qualitative data will be analyzed using an integrated framework drawing constructs from the Consolidated Framework for Implementation Research and the Conceptual Framework for Sustainability. DISCUSSION:The findings from this evaluation will be shared with policymakers formulating policy affecting the implementation of MWH and may be used as evidence for programmatic decisions by the government and supporting agencies in deciding to take this model to scale. TRIAL REGISTRATION:NCT02620436, Registered 3 December 2015, Prospectively registered (clinicaltrials.gov; for the overarching quasi-experimental impact study).