Dataset Information

The stages of implementation completion for evidence-based practice: protocol for a mixed methods study.

ABSTRACT: This protocol describes the 'development of outcome measures and suitable methodologies for dissemination and implementation approaches,' a priority for implementation research. Although many evidence-based practices (EBPs) have been developed, large knowledge gaps remain regarding how to routinely move EBPs into usual care. The lack of understanding of 'what it takes' to install EBPs has costly public health consequences, including a lack of availability of the most beneficial services, wasted efforts and resources on failed implementation attempts, and the potential for engendering reluctance to try implementing new EBPs after failed attempts.The Stages of Implementation Completion (SIC) is an eight-stage tool of implementation process and milestones, with stages spanning three implementation phases (pre-implementation, implementation, sustainability). Items delineate the date that a site completes implementation activities, yielding an assessment of duration (time to complete a stage), proportion (of stage activities completed), and a general measure of how far a site moved in the implementation process.We propose to extend the SIC to EBPs operating in child service sectors (juvenile justice, schools, substance use, child welfare). Both successful and failed implementation attempts will be scrutinized using a mixed methods design. Stage costs will be measured and examined. Both retrospective data (from previous site implementation efforts) and prospective data (from newly adopting sites) will be analyzed. The influence of pre-implementation on implementation and sustainability outcomes will be examined (Aim 1). Mixed methods procedures will focus on increasing understanding of the process of implementation failure in an effort to determine if the SIC can provide early detection of sites that are unlikely to succeed (Aim 2). Study activities will include cost mapping of SIC stages and an examination of the relationship between implementation costs and implementation performance (Aim 3).This project fills a gap in the field of implementation science by addressing the measurement gap between the implementation process and the associated costs. The goal of this project is to provide tools that will help increase the uptake of EBPs, thereby increasing the availability of services to youth and decreasing wasted resources from failed implementation efforts.

SUBMITTER: Saldana L

PROVIDER: S-EPMC4234147 | biostudies-literature | 2014 Apr

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The stages of implementation completion for evidence-based practice: protocol for a mixed methods study.

Saldana Lisa L

Implementation science : IS 20140405 1

<h4>Background</h4>This protocol describes the 'development of outcome measures and suitable methodologies for dissemination and implementation approaches,' a priority for implementation research. Although many evidence-based practices (EBPs) have been developed, large knowledge gaps remain regarding how to routinely move EBPs into usual care. The lack of understanding of 'what it takes' to install EBPs has costly public health consequences, including a lack of availability of the most beneficia ...[more]

PMID: 24708893

Similar Datasets

Project description:BackgroundTimely and comprehensive treatment in the form of early psychosis intervention (EPI) has become the standard of care for youth with psychosis. While EPI services were designed to be delivered in person, the COVID-19 pandemic required many EPI programs to rapidly transition to virtual delivery, with little evidence to guide intervention adaptations or to support the effectiveness and satisfaction with virtual EPI services.ObjectiveThis study aims to explore the adaptations required to deliver NAVIGATE, a model of coordinated specialty care used in EPI, in a virtual format. This study will evaluate implementation of the NAVIGATE model delivered virtually by describing the nature of the adaptations to the intervention, assessing fidelity to the EPI model and the satisfaction of clients, family members, and care providers. We will investigate barriers and facilitators to virtual NAVIGATE implementation, service engagement, and health equity impacts of this work.MethodsThe Centre for Addiction and Mental Health (Toronto, Ontario, Canada) transitioned to delivering NAVIGATE virtually early in the COVID-19 pandemic. The Framework for Reporting Adaptations and Modifications for Evidence-Based Interventions will be used to describe the adaptations required to deliver NAVIGATE virtually. Fidelity to the EPI model will be measured using the First Episode Psychosis Services Fidelity Scale and fidelity to NAVIGATE will be assessed by investigating adherence to its core components. Implementation facilitators and barriers will be explored using semistructured interviews with providers informed by the Consolidated Framework for Implementation Research. Satisfaction with virtually delivered NAVIGATE will be assessed with virtual client and provider experience surveys and qualitative interviews with clients, family members, and providers. Service engagement data will be collected through review of medical records, and potential impacts of virtually delivered NAVIGATE on different population groups will be assessed with the Health Equity Impact Assessment.ResultsVirtual clinical delivery of NAVIGATE started in March 2020 with additional adaptations and data collection is ongoing. Data will be analyzed using descriptive statistics and survival analysis for quantitative data. Qualitative data will be analyzed using thematic content analysis. Integration of qualitative and quantitative data will occur at the data collection, interpretation, and reporting levels following a convergent design.ConclusionsThis study will provide information regarding the type of intervention adaptations required for virtual delivery of NAVIGATE for youth with early psychosis, ensuring access to high-quality care for this population during the pandemic and beyond by guiding future implementation in similar contexts.International registered report identifier (irrid)DERR1-10.2196/34591.

Project description:Improving quality in children's mental health and social service settings will require implementation strategies capable of moving effective treatments and other innovations (e.g., assessment tools) into routine care. It is likely that efforts to identify, develop, and refine implementation strategies will be more successful if they are informed by relevant stakeholders and are responsive to the strengths and limitations of the contexts and implementation processes identified in usual care settings. This study will describe: the types of implementation strategies used; how organizational leaders make decisions about what to implement and how to approach the implementation process; organizational stakeholders' perceptions of different implementation strategies; and the potential influence of organizational culture and climate on implementation strategy selection, implementation decision-making, and stakeholders' perceptions of implementation strategies.This study is a mixed methods multiple case study of seven children's social service organizations in one Midwestern city in the United States that compose the control group of a larger randomized controlled trial. Qualitative data will include semi-structured interviews with organizational leaders (e.g., CEOs/directors, clinical directors, program managers) and a review of documents (e.g., implementation and quality improvement plans, program manuals, etc.) that will shed light on implementation decision-making and specific implementation strategies that are used to implement new programs and practices. Additionally, focus groups with clinicians will explore their perceptions of a range of implementation strategies. This qualitative work will inform the development of a Web-based survey that will assess the perceived effectiveness, relative importance, acceptability, feasibility, and appropriateness of implementation strategies from the perspective of both clinicians and organizational leaders. Finally, the Organizational Social Context measure will be used to assess organizational culture and climate. Qualitative, quantitative, and mixed methods data will be analyzed and interpreted at the case level as well as across cases in order to highlight meaningful similarities, differences, and site-specific experiences.This study is designed to inform efforts to develop more effective implementation strategies by fully describing the implementation experiences of a sample of community-based organizations that provide mental health services to youth in one Midwestern city.

Project description:BackgroundCross-system interventions can help integrate services across different service delivery systems but require organizations to establish strong collaborative relationships for implementation. Contingency theory suggests that the effectiveness of different collaborative strategies (i.e. specific ways organizations align operations and services) varies by context. This paper describes a study of different strategies for fostering collaboration between child welfare and substance abuse treatment agencies and the conditions under which they are effective for implementation. We also describe the development and piloting of the Collaborating Across Systems for Program Implementation (CASPI) tool-a decision-making guide intended to help researchers and organizational leaders identify and use appropriate collaborative strategies for their context.Methods/designThis multisite longitudinal, mixed methods study, leverages a naturally occurring implementation initiative -- in up to 17 Ohio counties -- to implement Ohio START (Sobriety Treatment and Reducing Trauma). START is a child welfare model that requires strong collaboration with local substance use treatment organizations to promote integrated services. During the first two years, we will identify collaborative strategies associated with improved START implementation (penetration and fidelity) and service delivery outcomes (timeliness), given system, and organizational features. We will conduct a convergent mixed methods study drawing on worker surveys, agency documents, administrative data, formal partner agreements, and group interviews. Data will be integrated and analyzed using Qualitative Comparative Analysis (QCA). To develop the CASPI, an expert panel comprised of implementation experts, and community stakeholders will convene to synthesize our findings and develop contents (including a decision tree). During the final year of the study, we will assess the acceptability, appropriateness, and feasibility of the CASPI in a randomized vignette experiment, and a pilot-test with 3 child welfare agencies that have not yet implemented START.DiscussionOur results will lay the groundwork for a larger controlled trial that will test the CASPI's effectiveness for supporting effective and efficient implementation of cross-system interventions like START. The CASPI is expected to help leaders and researchers select and use collaboration strategies tailored to their context and be applicable in a wide range of settings including rural communities. Our work also advances system-level implementation strategies.Trial registrationNCT03931005 , Registered April 29, 2019.

Project description:IntroductionIn January 2017, mifepristone-induced medical abortion was made available in Canada. In this study, we will seek to (1) understand facilitators and barriers to the implementation of mifepristone across Canada, (2) assess the impact of a 'community of practice' clinical and health service support platform and (3) engage in and assess the impact of integrated knowledge translation (iKT) activities aimed to improve health policy, systems and service delivery issues to enhance patient access to mifepristone.Methods and analysisThis prospective mixed-methods implementation study will involve a national sample of physicians and pharmacists recruited via an online training programme, professional networks and a purpose-built community of practice website. Surveys that explore constructs related to diffusion of innovation and Godin's behaviour change frameworks will be conducted at baseline and at 6 months, and qualitative data will be collected from electronic interactions on the website. Survey participants and a purposeful sample of decision-makers will be invited to participate in in-depth interviews. Descriptive analyses will be conducted for quantitative data. Thematic analysis guided by the theoretical frameworks will guide interpretation of qualitative data. We will conduct and assess iKT activities involving Canada's leading health system and health professional leaders, including evidence briefs, Geographical Information System (GIS)maps, face-to-face meetings and regular electronic exchanges. Findings will contribute to understanding the mechanisms of iKT relationships and activities that have a meaningful effect on uptake of evidence into policy and practice.Ethics and disseminationEthical approval was received from the University of British Columbia Children's and Women's Hospital Ethics Review Board (H16-01006). Full publication of the work will be sought in an international peer-reviewed journal. Findings will be disseminated to research participants through newsletters and media interviews, and to policy-makers through invited evidence briefs and face-to-face presentations.

Project description:BackgroundFew studies have explored evidence-based practice (EBP) knowledge, attitudes and behaviours of health professional graduates transitioning into the workforce. This study evaluated changes in these EBP domains in physiotherapists after one year of working.MethodA mixed methods design was used. Participants completed two psychometrically-tested EBP questionnaires at two timepoints. The Evidence-Based Practice Profile questionnaire collected self-report EBP data (Terminology, Relevance, Confidence, Practice, Sympathy) and the Knowledge of Research Evidence Competencies collected objective data (Actual Knowledge). Changes were calculated using descriptive statistics (paired t-tests, 95% CI, effect sizes). Qualitative interview data collected at one timepoint were analysed using a descriptive approach and thematic analysis, to examine the lived experience of participants in the context of their first employment. The aim of the mixed methods approach was a broader and deeper understanding of participants' first year of employment and using EBP.ResultsData were analysed from 50 participants who completed both questionnaires at the two timepoints. After one year in the workforce, there was a significant decrease in participants' perceptions of Relevance (p<0.001) and Confidence with EBP (p<0.001) and non-significant decreases in the other domains. Effect sizes showed medium decreases for Relevance (0.69) and Confidence (0.57), small decreases in Terminology (0.28) and Practice (0.23), and very small decreases in Sympathy (0.08) and Actual Knowledge (0.11). Seven themes described participants experience of using EBP in their first working year.ConclusionsAfter a year in the workplace, confidence and perceptions of relevance of EBP were significantly reduced. A subtle interplay of features related to workplace culture, competing demands to develop clinical skills, internal and external motivators to use EBP and patient expectations, together with availability of resources and time, may impact early graduates' perceptions of EBP. Workplace role models who immersed themselves in evidence discussion and experience were inspiring to early graduates.

Dataset Information

The stages of implementation completion for evidence-based practice: protocol for a mixed methods study.

Publications

The stages of implementation completion for evidence-based practice: protocol for a mixed methods study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets