Dataset Information

Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review.

ABSTRACT:

Background

The need for optimal study designs in dissemination and implementation (D&I) research is increasingly recognized. Despite the wide range of study designs available for D&I research, we lack understanding of the types of designs and methodologies that are routinely used in the field. This review assesses the designs and methodologies in recently proposed D&I studies and provides resources to guide design decisions.

Methods

We reviewed 404 study protocols published in the journal Implementation Science from 2/2006 to 9/2017. Eligible studies tested the efficacy or effectiveness of D&I strategies (i.e., not effectiveness of the underlying clinical or public health intervention); had a comparison by group and/or time; and used ?1 quantitative measure. Several design elements were extracted: design category (e.g., randomized); design type [e.g., cluster randomized controlled trial (RCT)]; data type (e.g., quantitative); D&I theoretical framework; levels of treatment assignment, intervention, and measurement; and country in which the research was conducted. Each protocol was double-coded, and discrepancies were resolved through discussion.

Results

Of the 404 protocols reviewed, 212 (52%) studies tested one or more implementation strategy across 208 manuscripts, therefore meeting inclusion criteria. Of the included studies, 77% utilized randomized designs, primarily cluster RCTs. The use of alternative designs (e.g., stepped wedge) increased over time. Fewer studies were quasi-experimental (17%) or observational (6%). Many study design categories (e.g., controlled pre-post, matched pair cluster design) were represented by only one or two studies. Most articles proposed quantitative and qualitative methods (61%), with the remaining 39% proposing only quantitative. Half of protocols (52%) reported using a theoretical framework to guide the study. The four most frequently reported frameworks were Consolidated Framework for Implementing Research and RE-AIM (n?=?16 each), followed by Promoting Action on Research Implementation in Health Services and Theoretical Domains Framework (n?=?12 each).

Conclusion

While several novel designs for D&I research have been proposed (e.g., stepped wedge, adaptive designs), the majority of the studies in our sample employed RCT designs. Alternative study designs are increasing in use but may be underutilized for a variety of reasons, including preference of funders or lack of awareness of these designs. Promisingly, the prevalent use of quantitative and qualitative methods together reflects methodological innovation in newer D&I research.

SUBMITTER: Mazzucca S

PROVIDER: S-EPMC5826311 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review.

Mazzucca Stephanie S Tabak Rachel G RG Pilar Meagan M Ramsey Alex T AT Baumann Ana A AA Kryzer Emily E Lewis Ericka M EM Padek Margaret M Powell Byron J BJ Brownson Ross C RC

Frontiers in public health 20180219

<h4>Background</h4>The need for optimal study designs in dissemination and implementation (D&I) research is increasingly recognized. Despite the wide range of study designs available for D&I research, we lack understanding of the types of designs and methodologies that are routinely used in the field. This review assesses the designs and methodologies in recently proposed D&I studies and provides resources to guide design decisions.<h4>Methods</h4>We reviewed 404 study protocols published in the ...[more]

PMID: 29515989

Similar Datasets

Project description:BACKGROUND:Research has the potential to influence US social policy; however, existing research in this area lacks a coherent message. The Model for Dissemination of Research provides a framework through which to synthesize lessons learned from research to date on the process of translating research to US policymakers. METHODS:The peer-reviewed and grey literature was systematically reviewed to understand common strategies for disseminating social policy research to policymakers in the United States. We searched Academic Search Premier, PolicyFile, SocINDEX, Social Work Abstracts, and Web of Science from January 1980 through December 2019. Articles were independently reviewed and thematically analyzed by two investigators and organized using the Model for Dissemination of Research. RESULTS:The search resulted in 5225 titles and abstracts for inclusion consideration. 303 full-text articles were reviewed with 27 meeting inclusion criteria. Common sources of research dissemination included government, academic researchers, the peer reviewed literature, and independent organizations. The most frequently disseminated research topics were health-related, and legislators and executive branch administrators were the most common target audience. Print materials and personal communication were the most common channels for disseminating research to policymakers. There was variation in dissemination channels by level of government (e.g., a more formal legislative process at the federal level compared with other levesl). Findings from this work suggest that dissemination is most effective when it starts early, galvanizes support, uses champions and brokers, considers contextual factors, is timely, relevant, and accessible, and knows the players and process. CONCLUSIONS:Effective dissemination of research to US policymakers exists; yet, rigorous quantitative evaluation is rare. A number of cross-cutting strategies appear to enhance the translation of research evidence into policy. REGISTRATION:Not registered.

Project description:BackgroundIt is widely acknowledged that health policy and management decisions rarely reflect research evidence. Therefore, it is important to determine how to improve evidence-informed decision-making. The primary aim of this systematic review was to evaluate the effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare. The secondary aim of the review was to describe factors perceived to be associated with effective strategies and the inter-relationship between these factors.MethodsAn electronic search was developed to identify studies published between January 01, 2000, and February 02, 2016. This was supplemented by checking the reference list of included articles, systematic reviews, and hand-searching publication lists from prominent authors. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data.ResultsAfter duplicate removal, the search strategy identified 3830 titles. Following title and abstract screening, 96 full-text articles were reviewed, of which 19 studies (21 articles) met all inclusion criteria. Three studies were included in the narrative synthesis, finding policy briefs including expert opinion might affect intended actions, and intentions persisting to actions for public health policy in developing nations. Workshops, ongoing technical assistance, and distribution of instructional digital materials may improve knowledge and skills around evidence-informed decision-making in US public health departments. Tailored, targeted messages were more effective in increasing public health policies and programs in Canadian public health departments compared to messages and a knowledge broker. Sixteen studies (18 articles) were included in the thematic synthesis, leading to a conceptualisation of inter-relating factors perceived to be associated with effective research implementation strategies. A unidirectional, hierarchal flow was described from (1) establishing an imperative for practice change, (2) building trust between implementation stakeholders and (3) developing a shared vision, to (4) actioning change mechanisms. This was underpinned by the (5) employment of effective communication strategies and (6) provision of resources to support change.ConclusionsEvidence is developing to support the use of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare. The design of future implementation strategies should be based on the inter-relating factors perceived to be associated with effective strategies.Trial registrationThis systematic review was registered with Prospero (record number: 42016032947).

Project description:BackgroundHealth care professionals (HCPs) use clinical practice guidelines (CPGs) to make evidence-informed decisions regarding patient care. Although a large number of cancer-related CPGs exist, it is unknown which CPG dissemination and implementation strategies are effective for improving HCP behaviour and patient outcomes in a cancer care context. This review aimed to determine the effectiveness of CPG dissemination and/or implementation strategies among HCPs in a cancer care context.MethodsA comprehensive search of five electronic databases was conducted. Studies were limited to the dissemination and/or implementation of a CPG targeting both medical and/or allied HCPs in cancer care. Two reviewers independently coded strategies using the Mazza taxonomy, extracted study findings, and assessed study quality.ResultsThe search strategy identified 33 studies targeting medical and/or allied HCPs. Across the 33 studies, 23 of a possible 49 strategies in the Mazza taxonomy were used, with a mean number of 3.25 (SD = 1.45) strategies per intervention. The number of strategies used per intervention was not associated with positive outcomes. Educational strategies (n = 24), feedback on guideline compliance (n = 11), and providing reminders (n = 10) were the most utilized strategies. When used independently, providing reminders and feedback on CPG compliance corresponded with positive significant changes in outcomes. Further, when used as part of multi-strategy interventions, group education and organizational strategies (e.g. creation of an implementation team) corresponded with positive significant changes in outcomes.ConclusionsFuture CPG dissemination and implementation interventions for cancer care HCPs may benefit from utilizing the identified strategies. Research in this area should aim for better alignment between study objectives, intervention design, and evaluation measures, and should seek to incorporate theory in intervention design, so that behavioural antecedents are considered and measured; doing so would enhance the field's understanding of the causal mechanisms by which interventions lead, or do not lead, to changes in outcomes at all levels.

Project description:BackgroundThe need to better understand implementing evidence-informed dementia care has been recognised in multiple priority-setting partnerships. The aim of this scoping review was to give an overview of the state of the evidence on implementation and dissemination of dementia care, and create a systematic evidence map.MethodsWe sought studies that addressed dissemination and implementation strategies or described barriers and facilitators to implementation across dementia stages and care settings. Twelve databases were searched from inception to October 2015 followed by forward citation and grey literature searches. Quantitative studies with a comparative research design and qualitative studies with recognised methods of data collection were included. Titles, abstracts and full texts were screened independently by two reviewers with discrepancies resolved by a third where necessary. Data extraction was performed by one reviewer and checked by a second. Strategies were mapped according to the ERIC compilation.ResultsEighty-eight studies were included (30 quantitative, 34 qualitative and 24 mixed-methods studies). Approximately 60% of studies reported implementation strategies to improve practice: training and education of professionals (94%), promotion of stakeholder interrelationships (69%) and evaluative strategies (46%) were common; financial strategies were rare (15%). Nearly 70% of studies reported barriers or facilitators of care practices primarily within residential care settings. Organisational factors, including time constraints and increased workload, were recurrent barriers, whereas leadership and managerial support were often reported to promote implementation. Less is known about implementation activities in primary care and hospital settings, or the views and experiences of people with dementia and their family caregivers.ConclusionThis scoping review and mapping of the evidence reveals a paucity of robust evidence to inform the successful dissemination and implementation of evidence-based dementia care. Further exploration of the most appropriate methods to evaluate and report initiatives to bring about change and of the effectiveness of implementation strategies is necessary if we are to make changes in practice that improve dementia care.

Project description:ContextNeuromuscular preventive training programs effectively reduce injury and improve performance in youth athletes. However, program effectiveness is directly linked to program compliance, fidelity, and dosage. Preventive training programs are not widely adopted by youth sport coaches. One way to promote widespread dissemination and compliance is to identify implementation strategies that influence program adoption and maintenance. It is unknown how previously published programs have followed the elements of an implementation framework. The objective of this review was to evaluate how elements of the 7 steps of implementation, developed by Padua et al, have been performed in the evidence of lower extremity preventive training programs.Evidence acquisitionA systematic review of the literature from 1996 through September 2016 was conducted using electronic databases. Investigations that documented implementation of a sport team-based neuromuscular preventive training program in youth athletes and measured lower extremity injury rates were included.Study designClinical review.Level of evidenceLevel 4.ResultsA total of 12 studies met the inclusion criteria and were reviewed. Information regarding the completion of any of the 7 steps within the implementation framework developed by Padua et al was extracted. None of the 12 articles documented completion of all 7 steps. While each study addressed some of the 7 steps, no study addressed maintenance or an exit strategy for youth athletes. Program implementation appears limited in obtaining administrative support, utilizing an interdisciplinary implementation team, and monitoring or promoting fidelity of the intervention.ConclusionDespite strong evidence supporting the effectiveness of preventive training programs in youth athletes, there is a gap between short-term improvements and long-term implementation strategies. Future interventions should include all 7 steps of the implementation framework to promote transparent dissemination of preventive training programs.

Project description:Policy has a tremendous potential to improve population health when informed by research evidence. Such evidence, however, typically plays a suboptimal role in policymaking processes. The field of policy dissemination and implementation research (policy D&I) exists to address this challenge. The purpose of this study was to: (1) determine the extent to which policy D&I was funded by the National Institutes of Health (NIH), (2) identify trends in NIH-funded policy D&I, and (3) describe characteristics of NIH-funded policy D&I projects.The NIH Research Portfolio Online Reporting Tool was used to identify all projects funded through D&I-focused funding announcements. We screened for policy D&I projects by searching project title, abstract, and term fields for mentions of "policy," "policies," "law," "legal," "legislation," "ordinance," "statute," "regulation," "regulatory," "code," or "rule." A project was classified as policy D&I if it explicitly proposed to conduct research about the content of a policy, the process through which it was developed, or outcomes it produced. A coding guide was iteratively developed, and all projects were independently coded by two researchers. ClinicalTrials.gov and PubMed were used to obtain additional project information and validate coding decisions. Descriptive statistics--stratified by funding mechanism, Institute, and project characteristics--were produced.Between 2007 and 2014, 146 projects were funded through the D&I funding announcements, 12 (8.2 %) of which were policy D&I. Policy D&I funding totaled $16,177,250, equivalent to 10.5 % of all funding through the D&I funding announcements. The proportion of funding for policy D&I projects ranged from 14.6 % in 2007 to 8.0 % in 2012. Policy D&I projects were primarily focused on policy outcomes (66.7 %), implementation (41.7 %), state-level policies (41.7 %), and policies within the USA (83.3 %). Tobacco (33.3 %) and cancer (25.0 %) control were the primary topics of focus. Many projects combined survey (58.3 %) and interview (33.3 %) methods with analysis of archival data sources.NIH has made an initial investment in policy D&I research, but the level of support has varied between Institutes. Policy D&I researchers have utilized a variety of designs, methods, and data sources to investigate the development processes, content, and outcomes of public and private policies.

Dataset Information

Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review.

Background

Methods

Results

Conclusion

Publications

Variation in Research Designs Used to Test the Effectiveness of Dissemination and Implementation Strategies: A Review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets