Dataset Information

Advancing Evidence Synthesis from Effectiveness to Implementation: Integration of Implementation Measures into Evidence Reviews.

ABSTRACT:

Background

In order to close the gap between discoveries that could improve health, and widespread impact on routine health care practice, there is a need for greater attention to the factors that influence dissemination and implementation of evidence-based practices. Evidence synthesis projects (e.g., systematic reviews) could contribute to this effort by collecting and synthesizing data relevant to dissemination and implementation. Such an advance would facilitate the spread of high-value, effective, and sustainable interventions.

Objective

The objective of this paper is to evaluate the feasibility of extracting factors related to implementation during evidence synthesis in order to enhance the replicability of successes of studies of interventions in health care settings.

Design

Drawing on the implementation science literature, we suggest 10 established implementation measures that should be considered when conducting evidence synthesis projects. We describe opportunities to assess these constructs in current literature and illustrate these methods through an example of a systematic review.

Subjects

Twenty-nine studies of interventions aimed at improving clinician-patient communication in clinical settings.

Key results

We identified acceptability, adoption, appropriateness, feasibility, fidelity, implementation cost, intervention complexity, penetration, reach, and sustainability as factors that are feasible and appropriate to extract during an evidence synthesis project.

Conclusions

To fully understand the potential value of a health care innovation, it is important to consider not only its effectiveness, but also the process, demands, and resource requirements involved in downstream implementation. While there is variation in the degree to which intervention studies currently report implementation factors, there is a growing demand for this information. Abstracting information about these factors may enhance the value of systematic reviews and other evidence synthesis efforts, improving the dissemination and adoption of interventions that are effective, feasible, and sustainable across different contexts.

SUBMITTER: A Tierney A

PROVIDER: S-EPMC7174479 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:IntroductionMechanisms explain how implementation strategies work. Implementation research requires careful operationalisation and empirical study of the causal pathway(s) by which strategies effect change, and factors that may amplify or weaken their effects. Understanding mechanisms is critically important to replicate findings, learn from negative studies or adapt an implementation strategy developed in one setting to another. Without understanding implementation mechanisms, it is difficult to design strategies to produce expected effects across contexts, which may have disproportionate effects on settings in which priority populations receive care. This manuscript outlines the protocol for an Agency for Healthcare Research and Quality-funded initiative to: (1) establish priorities for an agenda to guide research on implementation mechanisms in health and public health, and (2) disseminate the agenda to research, policy and practice audiences.Methods and analysisA network of scientific experts will convene in 'Deep Dive' meetings across 3 years. A research agenda will be generated through analysis and synthesis of information from six sources: (1) systematic reviews, (2) network members' approaches to studying mechanisms, (3) new proposals presented in implementation proposal feedback sessions, (4) working group sessions conducted in a leading implementation research training institute, (5) breakout sessions at the Society for Implementation Research Collaboration's (SIRC) 2019 conference and (6) SIRC conference abstracts. Two members will extract mechanism-relevant text segments from each data source and a third member will generate statements as an input for concept mapping. Concept mapping will generate unique clusters of challenges, and the network will engage in a nominal group process to identify priorities for the research agenda.Ethics and disseminationThis initiative will yield an actionable research agenda to guide research to identify and test mechanisms of change for implementation strategies. The agenda will be disseminated via multiple channels to solicit feedback and promote rigorous research on implementation mechanisms.

Project description:BackgroundThere is a fundamental gap in understanding the causal mechanisms by which strategies for implementing evidence-based practices address local barriers to effective, appropriate service delivery. Until this gap is addressed, scientific knowledge and practical guidance about which implementation strategies to use in which contexts will remain elusive. This research project aims to identify plausible strategy-mechanism linkages, develop causal models for mechanism evaluation, produce measures needed to evaluate such linkages, and make these models, methods, and measures available in a user-friendly website. The specific aims are as follows: (1) build a database of strategy-mechanism linkages and associated causal pathway diagrams, (2) develop psychometrically strong, pragmatic measures of mechanisms, and (3) develop and disseminate a website of implementation mechanisms knowledge for use by diverse stakeholders.MethodsFor the first aim, a combination of qualitative inquiry, expert panel methods, and causal pathway diagramming will be used to identify and confirm plausible strategy-mechanism linkages and articulate moderators, preconditions, and proximal and distal outcomes associated with those linkages. For the second aim, rapid-cycle measure development and testing methods will be employed to create reliable, valid, pragmatic measures of six mechanisms of common strategies for which no high-quality measures exist. For the third aim, we will develop a user-friendly website and searchable database that incorporates user-centered design, disseminating the final product using social marketing principles.DiscussionOnce strategy-mechanism linkages are identified using this multi-method approach, implementation scientists can use the searchable database to develop tailored implementation strategies and generate more robust evidence about which strategies work best in which contexts. Moreover, practitioners will be better able to select implementation strategies to address their specific implementation problems. New horizons in implementation strategy development, optimization, evaluation, and deployment are expected to be more attainable as a result of this research, which will lead to enhanced implementation of evidence-based interventions for cancer control, and ultimately improvements in patient outcomes.

Project description:ObjectivesTo assess the evidence on the impact of enhanced recovery programmes for patients undergoing elective surgery in acute hospital settings in the UK.DesignRapid evidence synthesis. Eight databases were searched from 1990 to March 2013 without language restrictions. Relevant reports and guidelines, websites and reference lists of retrieved articles were scanned to identify additional studies. Systematic reviews, RCTs not included in the systematic reviews, economic evaluations and UK NHS cost analysis, implementation case studies and surveys of patient experience in a UK setting were eligible for inclusion.Primary and secondary outcome measuresWe assessed the impact of enhanced recovery programmes on health or cost-related outcomes, and assessed implementation case studies and patient experience in UK settings. Studies were quality assessed where appropriate using the Centre for Reviews and Dissemination Database of Abstracts of Reviews of Effects critical appraisal process.Results17 systematic reviews and 12 additional RCTs were included. Ten relevant economic evaluations were included. No cost analysis studies were identified. Most of the evidence focused on colorectal surgery. 14 innovation case studies and 15 implementation case studies undertaken in National Health Service settings described factors critical to the success of an enhanced recovery programme. Evidence for colorectal surgery suggests that enhanced recovery programmes may reduce hospital stays by 0.5-3.5?days compared with conventional care. There were no significant differences in reported readmission rates. Other surgical specialties showed greater variation in reductions in length of stay reflecting the limited evidence identified. Findings relating to other outcomes were hampered by a lack of robust evidence and poor reporting.ConclusionsThere is consistent, albeit limited, evidence that enhanced recovery programmes can reduce length of patient hospital stay without increasing readmission rates. The extent to which managers and clinicians considering implementing enhanced recovery programmes in UK settings can realise savings will depend on length of stay achieved under their existing care pathway.

Project description:BACKGROUND:The literature on the implementation of knowledge products is extensive. However, this literature is still difficult to interpret for policymakers and other stakeholders when faced with choosing implementation strategies likely to bring about successful change in their health systems. This work has the particularity to examine the scope of this literature, and to clarify the effectiveness of implementation strategies for different knowledge products. Consequently, we aim to (1) determine the strengths and weaknesses of existing literature overviews; (2) produce a detailed portrait of the literature on implementation strategies for various knowledge products; and (3) assess the effectiveness of implementation strategies for each knowledge product identified and classify them. METHODS:We will use a three-phase approach consisting of a critical analysis of existing literature overviews, a systematic review of systematic reviews, and a series of systematic reviews and meta-analyses. We will follow the Cochrane Methodology for each of the three phases. Our eligibility criteria are defined following a PICOS approach: Population, individuals or stakeholders participating in healthcare delivery, specifically, healthcare providers, caregivers, and end users; Intervention, any type of strategy aiming to implement a knowledge product including, but not limited to, a decision support tool, a clinical practice guideline, a policy brief, or a decision-making tool, a one-pager, or a health intervention; Comparison, any comparator will be considered; Outcomes, phases 1 and 2-any outcome related to implementation strategies including, but not limited to, the measures of adherence/fidelity to the use of knowledge products, their acceptability, adoption, appropriateness, feasibility, adaptability, implementation costs, penetration/reach and sustainability; phase 3-any additional outcome related to patients (psychosocial, health behavioral, and clinical outcomes) or healthcare professionals (behavioral and performance outcomes); Setting, primary healthcare has to be covered. We will search MEDLINE (Ovid), EMBASE, Web of Science, PsycINFO, CINAHL, and the Cochrane Library from their inception onwards. For each phase, two reviewers will independently perform the selection of studies, data extraction, and assess their methodological quality. We will analyze extracted data, and perform narrative syntheses, and meta-analyses when possible. DISCUSSION:Our results could inform not only the overviews' methodology but also the development of an online platform for the implementation strategies of knowledge products. This platform could be useful for stakeholders in implementation science. SYSTEMATIC REVIEW REGISTRATION:Protocol registered on Open Science Framework, https://osf.io/eb8w2/.