Dataset Information

Adapting Evidence-Based Early Psychosis Intervention Services for Virtual Delivery: Protocol for a Pragmatic Mixed Methods Implementation and Evaluation Study.

ABSTRACT:

Background

Timely and comprehensive treatment in the form of early psychosis intervention (EPI) has become the standard of care for youth with psychosis. While EPI services were designed to be delivered in person, the COVID-19 pandemic required many EPI programs to rapidly transition to virtual delivery, with little evidence to guide intervention adaptations or to support the effectiveness and satisfaction with virtual EPI services.

Objective

This study aims to explore the adaptations required to deliver NAVIGATE, a model of coordinated specialty care used in EPI, in a virtual format. This study will evaluate implementation of the NAVIGATE model delivered virtually by describing the nature of the adaptations to the intervention, assessing fidelity to the EPI model and the satisfaction of clients, family members, and care providers. We will investigate barriers and facilitators to virtual NAVIGATE implementation, service engagement, and health equity impacts of this work.

Methods

The Centre for Addiction and Mental Health (Toronto, Ontario, Canada) transitioned to delivering NAVIGATE virtually early in the COVID-19 pandemic. The Framework for Reporting Adaptations and Modifications for Evidence-Based Interventions will be used to describe the adaptations required to deliver NAVIGATE virtually. Fidelity to the EPI model will be measured using the First Episode Psychosis Services Fidelity Scale and fidelity to NAVIGATE will be assessed by investigating adherence to its core components. Implementation facilitators and barriers will be explored using semistructured interviews with providers informed by the Consolidated Framework for Implementation Research. Satisfaction with virtually delivered NAVIGATE will be assessed with virtual client and provider experience surveys and qualitative interviews with clients, family members, and providers. Service engagement data will be collected through review of medical records, and potential impacts of virtually delivered NAVIGATE on different population groups will be assessed with the Health Equity Impact Assessment.

Results

Virtual clinical delivery of NAVIGATE started in March 2020 with additional adaptations and data collection is ongoing. Data will be analyzed using descriptive statistics and survival analysis for quantitative data. Qualitative data will be analyzed using thematic content analysis. Integration of qualitative and quantitative data will occur at the data collection, interpretation, and reporting levels following a convergent design.

Conclusions

This study will provide information regarding the type of intervention adaptations required for virtual delivery of NAVIGATE for youth with early psychosis, ensuring access to high-quality care for this population during the pandemic and beyond by guiding future implementation in similar contexts.

International registered report identifier (irrid)

DERR1-10.2196/34591.

SUBMITTER: Tempelaar W

PROVIDER: S-EPMC8653974 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundYouth with autism spectrum disorder (ASD) represent a growing population with significant service needs. Prominent among these needs are high rates of co-occurring psychiatric conditions that contribute to increased functional impairments and often necessitate mental health services. Executive functioning deficits are associated with ASD as well as common co-occurring conditions (e.g., attention-deficit/hyperactivity disorder) and an evidence-based intervention has been developed and tested to address executive functioning within the school context. There is an urgent need to implement indicated evidence-based interventions for youth with ASD receiving care in community mental health settings. Interventions that optimally "fit" the mental health services context as well as the complex and co-occurring mental health needs of these youth have the potential to improve key clinical outcomes for this high priority population.MethodsThis mixed-methods developmental study will apply the Exploration, Preparation, Implementation, Sustainment implementation framework and a community-academic partnership approach to systematically adapt and test an evidence-based executive functioning intervention for youth with ASD for delivery in community mental health settings. Specific aims are to (1) conduct a need and context assessment to inform the systematic adaptation an executive functioning evidence-based intervention; (2) systematically adapt the clinical intervention and develop a corresponding implementation plan, together entitled "Executive Functioning for Enhancing Community-based Treatment for ASD," (EFFECT for ASD); and (3) conduct a feasibility pilot test of EFFECT for ASD in community mental health settings.DiscussionTailoring evidence-based interventions for delivery in community-based mental health services for youth with ASD has the potential to increase quality of care and improve child outcomes. Results from the current study will serve as the foundation for large-scale hybrid implementation and effectiveness trials and a generalizable approach for different service systems of care and clinical populations.Trial registrationClinicaltrials.gov, NCT04295512.

Project description:BackgroundPsychological distress is prevalent among university students. However, the availability of evidence-based mental health treatment remains limited in many low- and middle-income countries, including Indonesia. Internet-delivered, mindfulness-based interventions that reduce distress have potential for treating university student distress at scale. Unfortunately, evidence-based, internet-delivered mindfulness treatments are not yet available in Indonesia. Cultural adaptation of established evidence-based, internet-delivered mindfulness interventions is needed.ObjectiveIn this paper, we describe the process of culturally adapting an Australian internet-delivered mindfulness program (Introduction to Mindfulness) to be relevant and appropriate for treating Indonesian university students' psychological distress.MethodsTo assist the cultural adaptation process, we used a systematic cultural adaptation framework and a mixed methods approach combining quantitative and qualitative methods. In study 1 (information gathering), we administered an internet-delivered questionnaire to Indonesian university students (n=248) to examine their preferences regarding an internet-delivered mindfulness intervention. In study 2 (preliminary design), a draft program was developed and independently reviewed by Indonesian stakeholders. Stakeholders (n=25) included local Indonesian mindfulness and mental health professionals (n=6) and university students (n=19), who were selected to maximize sample representativeness regarding personal and professional characteristics. To evaluate the initial design and cultural congruence of the internet-delivered mindfulness program in the Indonesian context, we conducted interviews and focus groups with stakeholders. Stakeholders also completed the Cultural Relevance Questionnaire.ResultsIn study 1, most Indonesian university students (240/248, 96.8%) reported openness to an internet-delivered mindfulness program. Most of interested students (127/240, 52.9%) preferred the length of the program to be 3 to 4 sessions, with 45.8% (110/240) preferring brief lessons taking only 15 to 30 minutes to complete. They (194/240, 80.8%) recommended that the program be accessible both through websites and mobile phones. In study 2, Indonesian stakeholders generally found the internet-delivered program to be highly culturally appropriate in terms of language, concepts, context, treatment goals, and depictions of students' emotional and behavioral experiences. However, stakeholders also recommended some specific adaptations regarding the program's delivery model (eg, combining visual and audio modalities when delivering psychoeducation), cultural components (eg, including more social and spiritual activities), program practicality (eg, including rewards to promote engagement), and design elements (eg, including additional culturally relevant illustrations). Following stakeholder feedback, a new culturally adapted Indonesian internet-delivered mindfulness program called Program Intervensi Mindfulness Daring Mahasiswa Indonesia was created.ConclusionsThis study highlights the process and importance of cultural adaptation of an evidence-based mindfulness treatment and demonstrates how this may be achieved for internet-delivered psychotherapy programs. We found that a culturally adapted internet-delivered mindfulness program was relevant for Indonesian students with some adjustments to the programs' content and delivery. Future research is now needed to evaluate the clinical benefit of this program.

Project description:BackgroundManagers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.MethodsA non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.ResultsOverall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).ConclusionsThe intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

Project description:BackgroundThis article describes factors related to adoption, implementation, and effectiveness of the Virtual Pediatric Trauma Center intervention, which uses telehealth for trauma specialist consultations for seriously injured children. We aimed at (1) measuring RE-AIM (Reach, Effectiveness, Adoption, Implementation, Maintenance) implementation outcomes and (2) identifying PRISM (Practical, Robust, Implementation, and Sustainability Model) contextual factors that influenced the implementation outcomes.MethodsThis interim implementation evaluation of our telehealth trial used a convergent mixed-methods design. The quantitative component was a cross-sectional analysis of pediatric trauma encounters using electronic health records. The qualitative component was a thematic analysis of written and verbal feedback from providers and family advisory board meetings. We compared the quantitative and qualitative data by synthesizing them in a joint display table, organized by RE-AIM dimensions. We categorized these key findings into the PRISM domains.ResultsDuring the first 10 months of this trial, 246 subjects were randomized, with 177 assigned to standard care and 69 assigned to telehealth. Four referring sites transitioned from standard care into their intervention period. PRISM contextual factors that influenced RE-AIM implementation outcomes included the following findings: Providers struggle to remember, interpret, and navigate intervention workflows; providers have preconceived ideas about the intervention purpose; the intervention mitigates parents' anxieties about the transfer process.DiscussionThis study revealed implementation challenges that influence the overall success of this telehealth trial. Early identification of these challenges allows our team the opportunity to address them now to optimize the intervention reach, adoption, and implementation. This early action will ultimately enhance the success of our trial and the ability of our intervention to achieve broad impact.

Project description:BackgroundCommunity-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implementation was related to participant outcomes, and identify barriers and facilitators to implementation that could be addressed.MethodsThis study utilized quantitative participant evaluation data (n = 115) and quantitative and qualitative data from semi-structured interviews with program instructors (N = 13). At the participant level, demographic data (age, sex, insurance status) and behavior change intention were captured. Instructor data included implementation of program components and program attendance to create a 7-point implementation score of fidelity and reach variables. Degree of program implementation (high and low) was operationalized based on these variables (low: 0-4, high: 5-7). Relationships among degree of implementation, participant demographics, and participant outcomes (e.g., intent to be physically active or limit alcohol) were assessed using linear or ordinal logistic mixed effects models as appropriate. Interview data were transcribed and coded deductively for CFIR constructs, and constructs were then rated for magnitude and valence. Patterns between ratings of high and low implementation programs were used to determine constructs that manifested as barriers or facilitators.ResultsProgram implementation varied with scores ranging from 4 to 7. High implementation was related to greater improvements in intention to be physically active (p < 0.05), achieve a healthy weight (p < 0.05), and limit alcohol (p < 0.01). Eight constructs distinguished between high and low implementation programs. Design quality and packaging, compatibility, external change agents, access to knowledge and information, and experience were facilitators of implementation and formally appointed internal implementation leaders was a barrier to implementation.ConclusionsAs higher implementation was related to improved participant outcomes, program administrators should emphasize the importance of fidelity in training for program instructors. The CFIR can be used to identify barriers and/or facilitators to implementation in community interventions, but results may be unique from clinical contexts.

Project description:BACKGROUND:The Pragmatic Trial of Video Education in Nursing Homes (PROVEN) is one of the first large pragmatic randomized clinical trials (pRCTs) to be conducted in U.S. nursing homes (N = 119 intervention and N = 241 control across two health-care systems). The trial aims to evaluate the effectiveness of a suite of videos to improve advance care planning (ACP) for nursing home patients. This report uses mixed methods to explore the optimal and suboptimal conditions necessary for implementation fidelity within pRCTs in nursing homes. METHODS:PROVEN's protocol required designated facility champions to offer an ACP video to long-stay patients every 6 months during the 18-month implementation period. Champions completed a video status report, stored within electronic medical records, each time a video was offered. Data from the report were used to derive each facility's adherence rate (i.e., cumulative video offer). Qualitative interviews held after 15 months with champions were purposively sampled from facilities within the highest and lowest adherence rates (i.e., those in the top and bottom quintiles). Two researchers analyzed interview data thematically using a deductive approach based upon six domains of the revised Conceptual Framework for Implementation Fidelity (CFIF). Matrices were developed to compare coded narratives by domain across facility adherence status. RESULTS:In total, 28 interviews involving 33 champions were analyzed. Different patterns were observed across high- versus low-adherence facilities for five CFIF domains. In low-adherence nursing homes, (1) there were limited implementation resources (Context), (2) there was often a perceived negative patient or family responsiveness to the program (Participant Responsiveness), and (3) champions were reticent in offering the videos (Recruitment). In high-adherence nursing homes, (1) there was more perceived patient and family willingness to engage in the program (Participant Responsiveness), (2) champions supplemented the video with ACP conversations (Quality of Delivery), (3) there were strategic approaches to recruitment (Recruitment), and (4) champions appreciated external facilitation (Strategies to Facilitate Implementation). CONCLUSIONS:Critical lessons for implementing pRCTs in nursing homes emerged from this report: (1) flexible fidelity is important (i.e., delivering core elements of an intervention while permitting the adaptation of non-core elements), (2) reciprocal facilitation is vital (i.e., early and ongoing stakeholder engagement in research design and, reciprocally, researchers' and organizational leaders' ongoing support of the implementation), and (3) organizational and champion readiness should be formally assessed early and throughout implementation to facilitate remediation. TRIAL REGISTRATION:ClinicalTrials.gov, NCT02612688. Registered on 19 November 2015.