Dataset Information

A rapid pre-implementation evaluation to inform a family engagement navigator program during COVID-19.

ABSTRACT:

Background

Innovative models of family engagement and support are needed in the intensive care unit (ICU) during times of restricted visitation such as the COVID-19 pandemic. Limited understanding of the factors affecting the uptake and outcomes of different family support models hinders the implementation of best practices. We aimed to conduct a rapid pre-implementation evaluation of stakeholder-perceived facilitators and barriers to design implementation strategies to support a novel program using medical students to facilitate family-centered care in the ICU.

Methods

We conducted a 2-step process. In step 1, we gathered contextual data via interview-style open-ended questions sent to clinicians and navigator stakeholders via email. We used electronic data collection due to the physical distancing requirements, the need to prioritize brief data collection for respondent burden, and the need for rapid knowledge gain. A codebook based on the Consolidated Framework for Implementation Research (CFIR), an integrated framework from the field of implementation science, was used to analyze the findings. In step 2, a pilot of the intervention was implemented with 3 navigators over 2 weeks. Implementation strategies were developed to target barriers identified by the pre-implementation evaluation.

Results

Fourteen (70%) of the identified stakeholders responded to the survey. Ten constructs encompassing all five CFIR domains were present in responses as implementation influencers, with the Intervention domain most frequently represented. Through these results and operational feedback from navigators during the pilot period, stakeholders selected multiple implementation strategies: audit and provide feedback, develop educational materials, conduct ongoing training, promote adaptability, assess and redesign workflow, identify and prepare champions, and engage community resources.

Conclusions

We demonstrated how a conceptually based pre-implementation program evaluation can be used to rapidly inform optimal implementation strategies. We report key factors to inform design and implementation strategies for a novel ICU family engagement navigator program that may be useful to others wishing to adopt similar programs.

SUBMITTER: Taylor SP

PROVIDER: S-EPMC7724442 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesAdapting evidence-based practices to local settings is critical for successful implementation and dissemination. A pre-implementation assessment evaluates local context to inform implementation, but there is little published guidance for clinician-implementers. The rural Transitions Nurse Program (TNP) is a care coordination intervention that facilitates care transitions for rural veterans. In year 1 of TNP, pre-implementation assessments were conducted by a centralized project team through multi-day visits at five sites nationwide. In year 2, we tested if local site TNP nurses could conduct pre-implementation assessments using evidence-based tools and coaching from the TNP team. This required developing a multicomponent pre-implementation strategy bundle to guide data collection and synthesis. We hypothesized that (1) nurses would find the pre-implementation assessment useful for tailoring TNP to local contexts and (2) nurses would identify similar barriers and facilitators to those identified at first year sites.MethodsThe bundle included guides for conducting key informant interviews, brainwriting, process mapping, and reflective journaling. We evaluated TNP nurse satisfaction and perceived utility of the structure and process of the training and bundle through pre-post surveys. To assess the outcome of data collection efforts, we interviewed nurses 4 months after completion of the pre-implementation assessment to determine if and how they used pre-implementation findings to tailor implementation of TNP to local contexts. To further assess outcomes, all data that the nurses collected were analyzed thematically. Themes related to barriers and facilitators were compared across years.FindingsFive nurses at different VA medical centers used the pre-implementation strategy bundle to collect site-level data and completed pre-post surveys. Findings indicated that the pre-implementation assessment was highly recommended, and the bundle provided adequate training. Nurses felt that pre-implementation work oriented them to the local context and illustrated how to integrate TNP into existing processes. Barriers and facilitators identified by nurses were similar to those collected in year 1 by the TNP research team, including communication challenges, need for buy-in, and logistical concerns.ConclusionsThis proof-of-concept study suggests that evidence-based tools can effectively guide clinician-implementers through the process of conducting a pre-implementation assessment. This approach positively informed TNP implementation and oriented nurses to their local context prior to implementation.

Project description:Background: This paper explores how implementation and refinement of an early intervention (EI) program for children with delayed development was informed by an iterative, intentional and structured process of measurement. Providing access to early intervention therapy for children in rural areas of India is challenging due to a lack of rehabilitation therapists and programs. Following a biopsychosocial framework and principles of community-based rehabilitation, a non-governmental organization, Amar Seva Sangam (ASSA), overcame those barriers by designing a digital technology supported EI program in rural Tamil Nadu, India. Program objectives included providing service access; supporting program engagement, child development and school enrollment; and positioning the intervention for scale-up. This paper contributes to a growing body of literature on how program design and implementation can be informed through a cyclical process of data collection, analysis, reflection, and adaptation. Methods: Through several strands of data collection, the design and implementation of the EI program was adapted and improved. This included qualitative data from focus groups and interviews with caregivers and service providers, and a mobile application that collected and monitored longitudinal quantitative data, including program engagement rates, developmental progression, caregiver outcomes, and school enrollment status. Results: Measurements throughout the program informed decision-making by identifying facilitators and barriers to service providers' quality of work-life, family program engagement, and school enrollment. Consultation with key stakeholders, including caregivers and service providers, and data driven decision making led to continual program changes that improved service provider quality of work-life, program engagement and school enrollment. These changes included addressing gender-related work challenges for service providers; forming caregiver support networks; introducing psychological counseling for caregivers; providing medical consultations and assistive devices; creating community awareness programs; improving access to therapy services; focusing on caregiver education, motivation and support; and advocacy for accessibility in schools. Conclusion: The process of using evidence-informed and stakeholder driven adaptations to the early intervention program, led to improved service provider quality of work-life, greater program engagement, improved school enrollment and positioned the intervention for scale-up, providing lessons that may be beneficial in other contexts.

Project description:BackgroundWhile integrated primary healthcare for the management of depression has been well researched, appropriate models of primary care for people with severe and persistent psychotic disorders are poorly understood. In 2010 the NSW (Australia) Health Department commissioned a review of the evidence on "shared care" models of ambulatory mental health services. This focussed on critical factors in the implementation of these models in clinical practice, with a view to providing policy direction. The review excluded evidence about dementia, substance use and personality disorders.MethodsA rapid review involving a search for systematic reviews on The Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effects (DARE). This was followed by a search for papers published since these systematic reviews on Medline and supplemented by limited iterative searching from reference lists.ResultsShared care trials report improved mental and physical health outcomes in some clinical settings with improved social function, self management skills, service acceptability and reduced hospitalisation. Other benefits include improved access to specialist care, better engagement with and acceptability of mental health services. Limited economic evaluation shows significant set up costs, reduced patient costs and service savings often realised by other providers. Nevertheless these findings are not evident across all clinical groups. Gains require substantial cross-organisational commitment, carefully designed and consistently delivered interventions, with attention to staff selection, training and supervision. Effective models incorporated linkages across various service levels, clinical monitoring within agreed treatment protocols, improved continuity and comprehensiveness of services.Conclusions"Shared Care" models of mental health service delivery require attention to multiple levels (from organisational to individual clinicians), and complex service re-design. Re-evaluation of the roles of specialist mental health staff is a critical requirement. As expected, no one model of "shared" care fits diverse clinical groups. On the basis of the available evidence, we recommended a local trial that examined the process of implementation of core principles of shared care within primary care and specialist mental health clinical services.

Project description:BackgroundOpioid addiction and overdose is a public health problem in the United States and is expected to remain with substance use increasing due to the COVID-19 pandemic. Communities that approach this issue through multi-sector partnerships experience more positive health outcomes. Understanding motivation for stakeholder engagement in these efforts is essential to successful adoption, implementation, and sustainability particularly in the shifting landscape of needs and resources.MethodsA formative evaluation was conducted on the C.L.E.A.R. Program in Massachusetts, a state heavily impacted by the opioid epidemic. A stakeholder power analysis identified appropriate stakeholders for the study (n = 9). The Consolidated Framework for Implementation Research (CFIR) guided data collection and analysis. Surveys (n = 8) examined perception and attitudes on the program; motivations and communication for engagement; and, benefits and barriers to collaboration. Stakeholder interviews (n = 6) explored the quantitative findings in more detail. Surveys were analyzed using descriptive statistics and a content analysis with deductive approach was conducted for stakeholder interviews. The Diffusion of Innovation (DOI) Theory guided recommendations for communications to engage stakeholders.ResultsAgencies represented a range of sectors and the majority (n = 5) were familiar with the C.L.E.A.R.ProgramDespite the many strengths of the program and existing collaboration, based on the coding densities of each CFIR construct stakeholders identified crucial gaps in the services the program provided and noted that the overall infrastructure of the program could be enhanced. Opportunities for strategic communication to address the stages of DOI align with the gaps identified in the CFIR domains to result in increased agency collaboration and expansion of services into the surrounding communities to ensure sustainability of the C.L.E.A.R.ProgramConclusionsThis study explored factors necessary for ongoing multi-sector collaboration and sustainability of an existing community-based program especially given the changing context from COVID-19. Findings informed both program revisions and communication strategies to promote the program to new and existing collaborating agencies and the community served, and identify effective communication approaches across sectors. This is essential for successful implementation and sustainability of the program, especially as it is adapted and expanded to address post-pandemic times.Trial registrationThis study does not report results of a health care intervention on human participants, however it was reviewed and determined an exempt study with the Boston University Institutional Review Board (IRB #H-42107).

Project description:BackgroundCOVIDCare@Home (CC@H) is a multifaceted, interprofessional team-based remote monitoring program led by family medicine for patients diagnosed with COVID-19, based at Women's College Hospital (WCH), an ambulatory academic center in Toronto, Canada. CC@H offers virtual visits (phone and video) to address the clinical needs and broader social determinants of the health of patients during the acute phase of COVID-19 infection, including finding a primary care provider (PCP) and support for food insecurity.ObjectiveThe objective of this evaluation is to understand the implementation and quality outcomes of CC@H within the Quadruple Aim framework of patient experience, provider experience, cost, and population health.MethodsThis multimethod cross-sectional evaluation follows the Quadruple Aim framework to focus on implementation and service quality outcomes, including feasibility, adoption, safety, effectiveness, equity, and patient centeredness. These measures were explored using clinical and service utilization data, patient experience data (an online survey and a postdischarge questionnaire), provider experience data (surveys, interviews, and focus groups), and stakeholder interviews. Descriptive analysis was conducted for surveys and utilization data. Deductive analysis was conducted for interviews and focus groups, mapping to implementation and quality domains. The Ontario Marginalization Index (ON-Marg) measured the proportion of underserved patients accessing CC@H.ResultsIn total, 3412 visits were conducted in the first 8 months of the program (April 8-December 8, 2020) for 616 discrete patients, including 2114 (62.0%) visits with family physician staff/residents and 149 (4.4%) visits with social workers/mental health professionals. There was a median of 5 (IQR 4) visits per patient, with a median follow-up of 7 days (IQR 27). The net promoter score was 77. In addition, 144 (23.3%) of the patients were in the most marginalized populations based on the residential postal code (as per ON-Marg). Interviews with providers and stakeholders indicated that the program continued to adapt to meet the needs of patients and the health care system.ConclusionsFuture remote monitoring should integrate support for addressing the social determinants of health and ensure patient-centered care through comprehensive care teams.

Project description:BackgroundThere is a pervasive mental health treatment gap for children across the globe. Engaging stakeholders in child mental health evidence-based treatment (EBT) implementation projects may increase the likelihood of successful EBT implementation, thereby better addressing the treatment gap. However, little is known about the extent of stakeholder engagement to inform the implementation of child mental health EBTs.MethodsWe conducted a scoping review to characterize stakeholder engagement in child mental health EBT implementation projects, including what stakeholders are engaged, how they are engaged, when they are engaged, where they are engaged (i.e., location of projects), why they are engaged, and the reported impacts of stakeholder engagement. We searched seven databases: MEDLINE, PsycInfo, Embase, ERIC, CINAHL Complete, Scopus, and Web of Science Core Collection. To be included, studies had to report on some form of stakeholder engagement that was undertaken to inform or explain the implementation of a child mental health EBT. We performed data extraction and synthesis to describe key study and stakeholder characteristics, stakeholder engagement methods and rationales, reported impacts of stakeholder engagement, and quality of reporting on stakeholder engagement.ResultsIn total, 122 manuscripts met our inclusion criteria, from which we identified a total of 103 unique child mental health EBT implementation projects. Projects spanned 22 countries, which included low-, lower-middle, upper-middle, and high-income countries. The largest number of projects was in the USA and conducted in public mental health settings. Most projects engaged EBT providers during the active implementation phase and with limited depth, often gathering information from stakeholders without sharing decision-making power in implementation efforts. Across projects, impacts of stakeholder engagement spanned all of Proctor and colleague's implementation outcomes.ConclusionsGiven that stakeholder engagement is often shallow and with limited shared decision-making, additional effort should be made to increase engagement to preempt challenges to EBT implementation and ensure implementation success. Such efforts may ensure the just distribution of power in EBT implementation efforts.Trial registrationAll procedures were pre-registered on the Open Science Framework prior to conducting the literature search (DOI 10.17605/OSF.IO/GR9AP ).

Project description:BackgroundWhiplash is a health and economic burden worldwide. Contributing to this burden is poor guideline adherence and variable management by health care professionals (HCPs). Web-based tools that facilitate clinical pathways of care are an innovative solution to improve management.ObjectiveThe study aimed to develop, implement, and evaluate a Web-based tool to support whiplash management following a robust process.MethodsThis study followed the first 3 processes of a research translation framework (idea generation, feasibility, and efficacy) to inform the development, implementation, and evaluation of a website that supports HCPs in whiplash management. Development followed the idea generation and feasibility processes to inform the content, design, features, and functionality of the website. This involved stakeholder (eg, industry partners, website developers, and HCPs) consultations through face-to-face meetings, surveys, and focus group discussions. Implementation followed the feasibility process to determine the practicality of the website for clinical use and the most effective strategy to promote wider uptake. Implementation strategies included classroom education, educational meetings, educational outreach, reminders, and direct phone contact. The analysis of website use and practicality of implementation involved collection of website metrics. Evaluation followed the feasibility and efficacy processes to investigate the acceptability and extent to which the website assisted HCPs in gaining knowledge about whiplash management. Surveys were conducted among student, primary, and specialist HCPs to explore ease of access, use, and satisfaction with the website, as well as self-rated improvements in knowledge of risk assessment, management, and communication between HCPs. Website logs of specialist management decisions (eg, shared care, specialist care, and referred care) were also obtained to determine actual practice.ResultsThe development process delivered an interactive, user-friendly, and acceptable website, My Whiplash Navigator, tailored to the needs of HCPs. A total of 260 registrations were recorded from June 2016 to March 2018, including 175 student, 65 primary, and 20 specialist HCPs. The most effective implementation strategies were classroom education for students (81% uptake, 175/215) and educational meetings for primary HCPs (43% uptake, 47/110). Popular pages visited included advice and exercises and risk assessment. Most HCPs agreed that their knowledge about risk management (79/97, 81%) and exercises (85/97, 88%) improved. The specialists' most common management decision was shared care, an improvement from a previous cohort. Areas to improve were navigation and access to outcome measures.ConclusionsA robust process resulted in an innovative, interactive, user-friendly, and acceptable website, the My Whiplash Navigator. Implementation with HCPs was best achieved through classroom education and educational meetings. Evaluation of the website showed improved knowledge and practice to be more consistent with a risk-based clinical care pathway for whiplash. The positive results provide sufficient evidence to scale implementation nationally and involve other target markets such as people with whiplash, insurers, and insurance regulators.

Project description:BackgroundTelemedicine has been used for decades. Despite its many advantages, its uptake and rigorous evaluation of feasibility across neurology's ambulatory subspecialties has been sparse. However, the COVID-19 pandemic prompted health care systems worldwide to reconsider traditional health care delivery. To safeguard health care workers and patients, many health care systems quickly transitioned to telemedicine, including across neurology subspecialties, providing a new opportunity to evaluate this modality of care.ObjectiveTo evaluate the accelerated implementation of video visits in ambulatory neurology during the COVID-19 pandemic, we used mixed methods to assess adoption, acceptability, appropriateness, and perceptions of potential sustainability.MethodsVideo visits were launched rapidly in ambulatory neurology clinics of a large academic medical center. To assess adoption, we analyzed clinician-level scheduling data collected between March 22 and May 16, 2020. We assessed acceptability, appropriateness, and sustainability via a clinician survey (n=48) and semistructured interviews with providers (n=30) completed between March and May 2020.ResultsVideo visits were adopted rapidly; overall, 65 (98%) clinicians integrated video visits into their workflow within the first 6 implementation weeks and 92% of all visits were conducted via video. Video visits were largely considered acceptable by clinicians, although various technological issues impacted their satisfaction. Video visits were reported to be more convenient for patients, families, and caregivers than in-person visits; however, access to technology, the patient's technological capacity, and language difficulties were considered barriers. Many clinicians expressed optimism about future utilization of video visits in neurology. They believed that video visits promote continuity of care and can be incorporated into their practice long-term, although several insisted that they can never replace the in-person examination.ConclusionsVideo visits are an important addition to clinical care in ambulatory neurology and are anticipated to remain a permanent supplement to in-person visits, promoting patient care continuity, and flexibility for patients and clinicians alike.

Project description:Background: Partnership, engagement, and collaboration (PEC) are critical factors in dissemination and implementation (D&I) research. Despite a growing recognition that incorporating PEC strategies in D&I research is likely to increase the relevance, feasibility, impacts, and of evidence-based interventions or practices (EBIs, EBPs), conceptual frameworks and methodologies to guide the development and testing of PEC strategies in D&I research are lacking. To address this methodological gap, a review was conducted to summarize what we know, what we think we know, and what we need to know about PEC to inform D&I research. Methods: A cross-field scoping review, drawing upon a broad range of PEC related literature in health, was conducted. Publications reviewed focused on factors influencing PEC, and processes, mechanisms and strategies for promoting effective PEC. The review was conducted separately for three forms of partnerships that are commonly used in D&I research: (1) consumer-provider or patient-implementer partnership; (2) delivery system or implementation team partnership; and (3) sustainment/support or interagency/community partnership. A total of 39 studies, of which 21 were review articles, were selected for an in-depth review. Results: Across three forms of partnerships, four domains (cognitive, interpersonal/affective, behavioral, and contextual domains) were consistently identified as factors and strategies for promoting PEC. Depending on the stage (preparation or execution) and purpose of the partnership (regulating performance or managing maintenance), certain PEC strategies are more or less relevant. Recent developments of PEC frameworks, such as Partnership Stage of Change and multiple dynamic processes, provide more comprehensive conceptual explanations for PEC mechanisms, which can better guide PEC strategies selection and integration in D&I research. Conclusions: This review contributes to D&I knowledge by identifying critical domain factors, processes, or mechanisms, and key strategies for PEC, and offers a multi-level PEC framework for future research to build the evidence base. However, more research is needed to test PEC mechanisms.