Dataset Information

A protocol for a systematic review of the use of process evaluations in knowledge translation research.

ABSTRACT:

Background

Experimental designs for evaluating knowledge translation (KT) interventions for professional behavior change can provide strong estimates of intervention effectiveness but offer limited insight how the intervention worked or not. Furthermore, trials provide little insight into the ways through which interventions lead to behavior change and how they are moderated by different facilitators and barriers. As a result, the ability to generalize the findings from one study to a different context, organization, or clinical problem is severely compromised. Consequently, researchers have started to explore the causal mechanisms in complementary studies (process evaluations) alongside experimental designs for evaluating KT interventions. This study focuses on improving process evaluations by synthesizing current evidence on process evaluations conducted alongside experimental designs for evaluating KT interventions.

Methods/design

A medical research librarian will develop and implement search strategies designed to identify evidence that is relevant to process evaluations in health research. Studies will not be excluded based on design. Included studies must contain a process evaluation component aimed at understanding or evaluating a KT intervention targeting professional behavior change. Two reviewers will perform study selection, quality assessment, and data extraction using standard forms. Disagreements will be resolved through discussion or third party adjudication. Data to be collected include study design, details about data collection approaches and types, theoretical influences, approaches to evaluate intervention dose delivered, intervention dose received, intervention fidelity, intervention reach, data analysis, and study outcomes. This study is not registered with PROSPERO.

Discussion

There is widespread acceptance that the generalizability of quantitative trials of KT interventions would be significantly enhanced to other contexts, health professional groups, and clinical conditions through complementary process evaluations alongside trials. This systematic review will serve as a 'state of the science' on methodological approaches to process evaluations and will allow us to: 1) take stock of current research approaches and 2) develop concrete recommendations for knowledge users (e.g., quality consultants and health services researchers) designing future KT process evaluations.

SUBMITTER: Scott SD

PROVIDER: S-EPMC4307977 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundExperimental designs for evaluating knowledge translation (KT) interventions can provide strong estimates of effectiveness but offer limited insight into how the intervention worked. Consequently, process evaluations have been used to explore the causal mechanisms at work; however, there are limited standards to guide this work. This study synthesizes current evidence of KT process evaluations to provide future methodological recommendations.MethodsPeer-reviewed search strategies were developed by a health research librarian. Studies had to be in English, published since 1996, and were not excluded based on design. Studies had to (1) be a process evaluation of a KT intervention study in primary health, (2) be a primary research study, and (3) include a licensed healthcare professional delivering or receiving the intervention. A two-step, two-person hybrid screening approach was used for study inclusion with inter-rater reliability ranging from 94 to 95%. Data on study design, data collection, theoretical influences, and approaches used to evaluate the KT intervention, analysis, and outcomes were extracted by two reviewers. Methodological quality was assessed with the Mixed Methods Appraisal Tool (MMAT).ResultsOf the 20,968 articles screened, 226 studies fit our inclusion criteria. The majority of process evaluations used qualitative forms of data collection (43.4%) and individual interviews as the predominant data collection method. 72.1% of studies evaluated barriers and/or facilitators to implementation. 59.7% of process evaluations were stand-alone evaluations. The timing of data collection varied widely with post-intervention data collection being the most frequent (46.0%). Only 38.1% of the studies were informed by theory. Furthermore, 38.9% of studies had MMAT scores of 50 or less indicating poor methodological quality.ConclusionsThere is widespread acceptance that the generalizability of quantitative trials of KT interventions would be significantly enhanced through complementary process evaluations. However, this systematic review found that process evaluations are of mixed quality and lack theoretical guidance. Most process evaluation data collection occurred post-intervention undermining the ability to evaluate the process of implementation. Strong science and methodological guidance is needed to underpin and guide the design and execution of process evaluations in KT science.RegistrationThis study is not registered with PROSPERO.

Project description:BackgroundKnowledge translation (KT) aims to facilitate the use of research evidence in decision making. Changes in technology have provided considerable opportunities for KT strategies to improve access and use of evidence in decision making by public health policy makers and practitioners. Despite this opportunity, there have been no reviews that have assessed the effects of digital technology-enabled KT (TEKT) in the field of public health.ObjectiveThis study aims to examine the effectiveness of digital TEKT strategies in (1) improving the capacity for evidence-based decision making by public health policy makers and practitioners, (2) changing public health policy or practice, and (3) changes in individual or population health outcomes.MethodsA search strategy was developed to identify randomized trials assessing the effectiveness of digital TEKT strategies in public health. Any primary research study with a randomized trial design was eligible. Searches for eligible studies were undertaken in multiple electronic bibliographic databases (Medical Literature Analysis and Retrieval System Online [MEDLINE], Excerpta Medica dataBASE [EMBASE], PsycINFO, Cumulative Index to Nursing and Allied Health Literature [CINAHL], and Scopus) and the reference lists of included studies. A hand search of 2 journals (Implementation Science and Journal of Medical Internet Research) and a gray literature search were also conducted. Pairs of independent review authors screened studies, assessed the risk of bias, and extracted data from relevant studies.ResultsOf the 6819 citations screened, 8 eligible randomized trials were included in the review. The studies examined the impact of digital TEKT strategies on health professionals, including nurses, child care health consultants, physiotherapists, primary health care workers, and public health practitioners. Overall, 5 of the interventions were web-training programs. The remaining 3 interventions included simulation games, access to digital resource materials and the use of tailored messaging, and a web-based registry. The findings suggest that digital TEKT interventions may be effective in improving the knowledge of public health professionals, relative to control, and may be as effective as a face-to-face KT approach. The effectiveness of digital TEKT strategies relative to a control or other digital KT interventions on measures of health professional self-efficacy to use evidence to enhance practice behavior or behavioral intention outcomes was mixed. The evidence regarding the effects on changes to health policy or practice following exposure to digital TEKT was mixed. No trials assessed the effects on individual or population-level health outcomes.ConclusionsThis review is the first to synthesize the effectiveness of digital TEKT interventions in a public health setting. Despite its potential, relatively few trials have been undertaken to investigate the impacts of digital TEKT interventions. The findings suggest that although a digital TEKT intervention may improve knowledge, the effects of such interventions on other outcomes are equivocal.

Project description:IntroductionCollaborative research approaches, such as co-production, co-design, engaged scholarship and integrated knowledge translation (IKT), aim to bridge the evidence to practice and policy gap. There are multiple benefits of collaborative research approaches, but studies report many challenges with establishing and maintaining research partnerships. Researchers often do not have the opportunity to learn how to build collaborative relationships, and most graduate students do not receive formal training in research partnerships. We are unlikely to make meaningful progress in strengthening graduate and postgraduate training on working collaboratively with the health system until we have a better understanding of how students are currently engaging in research partnership approaches. In response, this scoping review aims to map and characterise the evidence related to using an IKT or other research partnership approach from the perspective of health research trainees.Methods and analysisWe will employ methods described by the Joanna Briggs Institute and Arksey and O'Malley's framework for conducting scoping reviews. The reporting will follow the Preferred Reporting Items for Systematic Reviews and Meta-Analysis extension for scoping reviews checklist. We will include both published and unpublished grey literature and search the following databases: MEDLINE, Embase, CINAHL, PsycINFO, ProQuest Dissertations & Theses Global databases, Google Scholar and websites from professional bodies and other organisations. Two reviewers will independently screen the articles and extract data using a standardised data collection form. We will narratively describe quantitative data and conduct a thematic analysis of qualitative data. We will map the IKT and other research partnership activities onto the Knowledge to Action cycle and IAP2 Levels of Engagement Framework.Ethics and disseminationNo ethical approval is required for this study. We will share the results in a peer-reviewed, open access publication, conference presentation and stakeholder communications.

Project description:BackgroundComplex interventions in health care are characterized by multiple interacting components as well as by numerous nonlinear interactions with the social systems within which they are being implemented. The process of developing, evaluating and implementing complex interventions is therefore challenging. Established guidance such as the MRC (Medical Research Council) framework for developing and evaluating complex interventions refers to process evaluations as an integral part of the development of complex evidence-based interventions. Even though the need for process evaluations is recognized, the realization of such approaches is challenging because methodological instruction is sparse, and the phenomenon of interest is complex. A number of theoretical approaches indicating how to conduct process evaluations of complex interventions in health care exist, but a systematic and comprehensive overview of these is missing. Thus, the objective of the systematic scoping review described herein is to provide an overview and analysis of theoretical approaches suitable for the planning and conducting of process evaluations.MethodsThe design and conduct of this review will follow the procedures of a systematic scoping review. The search strategy will be developed following the BeHEMoTh (Behaviour of interest; Health context; Exclusions; Models or Theories) template which has been conceptualized for structured reviews of theory. The systematic search of the MEDLINE (via PubMed), CINAHL (via EBSCO) and PsycInfo (via EBSCO) electronic databases will be complemented by "hand searching" techniques. Study selection, data extraction, and data analysis will be performed by tandems of two researchers independently of each other. Divergent decisions and judgements between the two researchers will be discussed by the whole review team.DiscussionThe findings from this scoping review will provide an overview and comparison of theoretical approaches suitable for process evaluations of complex interventions in health care. The review results will support researchers in choosing the theoretical approach that best fits the respective focus of their process evaluation study.Systematic review registrationThis study has been registered with PROSPERO (International Prospective Register of Systematic Reviews) under registration number CRD42020211732 .

Project description:IntroductionSedentary behaviour is defined as any waking behaviour characterised by low energy expenditure ≤1.5 metabolic equivalents while in a sitting, lying or reclining posture. The expanding evidence base suggests that sedentary behaviour may have a detrimental effect on health, well-being and is associated with an increased risk of all-cause mortality. We aim to review process evaluations of randomised controlled trials (RCTs) which included a measure of sedentary behaviour in adults in order to develop an understanding of intervention content, mechanisms of impact, implementation and delivery approaches and contexts, in which interventions were reported to be effective or effective. A secondary aim is to summarise participants, family and staff experiences of such interventions.Methods and analysisTen electronic databases and reference lists from previous similar reviews will be searched. Eligible studies will be process evaluations of RCTs that measure sedentary behaviour as a primary or secondary outcome in adults. As this review will contribute to a programme to develop a community-based intervention to reduce sedentary behaviour in stroke survivors, interventions delivered in schools, colleges, universities or workplaces will be excluded. Two reviewers will perform study selection, data extraction and quality assessment. Disagreements between reviewers will be resolved by a third reviewer. Process evaluation data to be extracted include the aims and methods used in the process evaluation; implementation data; mechanisms of impact; contextual factors; participant, family and staff experiences of the interventions. A narrative approach will be used to synthesise and report qualitative and quantitative data. Reporting of the review will be informed by Preferred Reporting Items for Systematic Review and Meta-Analysis guidance.Ethics and disseminationEthical approval is not required as it is a protocol for a systematic review. Findings will be disseminated through peer-reviewed publications and conference presentations.Prospero registration numberCRD42018087403.

Project description:IntroductionEfforts to bridge the know-do gap have paved the way for development of the field of knowledge translation (KT). KT aims to understand how evidence use can best be promoted and supported through different activities. For dissemination activities, infographics are gaining in popularity as a promising KT tool to reach multiple health research users (eg, health practitioners, patients and families, decision-makers). However, to our knowledge, no study has yet mapped the available evidence on this tool using a systematic method. This scoping review will explore the depth and breadth of evidence on infographics use and its effectiveness in improving research uptake (eg, raising awareness, influencing attitudes, increasing knowledge, informing practice and changing behaviour).Methods and analysisWe will use the scoping review methodological framework first proposed by Arksey and O'Malley (2005), improved by Levac et al, and further refined by the Joanna Briggs Institute (2020). The search will be conducted in MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Social Science Abstracts, Library and Information Science Abstracts, Education Resources Information Center, Cairn and Google Scholar. We will also search for relevant literature from the reference lists of the included publications. Two independent reviewers will select the studies. All study designs will be eligible for inclusion, with no date or publication status restrictions. The included studies will have evaluated infographics that disseminate health research evidence and target a non-scientific audience. A data extraction form will be developed and used to extract and chart the data, which will then be synthesised to present a descriptive summary of the results.Ethics and disseminationEthics approval is not required. To inform the research and KT communities, various dissemination activities will be developed, including user-friendly KT tools (eg, webinars, fact sheets and infographics), open-access publication and presentations at KT events and conferences.

Project description:BackgroundKnowledge translation (KT) activities can reduce the gap between "what is known" and "what is done". Several factors hinder or facilitate KT activities including individual characteristics and organizational attributes; we will focus on individual healthcare professional modifiable characteristics. The purpose of this scoping review is to summarize knowledge on KT competencies for knowledge users, knowledge brokers, and knowledge producers/researchers to support evidence-based practice (EBP) and inform policy and research in health. Our objectives are to explore the relevant theoretical and empirical literature; map the publications for key themes and research gaps of KT competencies, and interventions for enhancing KT competencies; summarize and disseminate findings; produce an action plan and research agenda; and develop self-assessment tools (the KT Pathways) for professional development for our three target audiences.MethodsThe scoping review method will guide our study by following six stages: formulating the research question; identifying relevant studies; selecting the literature; charting the data; collating, summarizing, and reporting the results; and developing a KT plan and consulting stakeholders involved in the fields of KT, EBP, evidence-informed policy-making, and/or research. We will include empirical and theoretical/conceptual peer-reviewed and grey literature in health that examine knowledge user, knowledge broker and knowledge producer KT competencies. Publications written in the English language and published after 2003 only will be considered. Our multidisciplinary research team will collaborate using technology (i.e., WebEx for discussions and a Web 2.0 website for storing documents). Our KT plan consists of an Advisory Group and dissemination plan of the findings.DiscussionWe expect the identified KT competencies to contribute to the KT science by providing positive outcomes in practice, policy, education, and future research. Incorporation of the core KT competencies may enhance safety, effectiveness of clinical care, and quality of health outcomes; contribute to and facilitate collaboration among practitioners, knowledge users, knowledge brokers, researchers, employers, and educators; improve education of healthcare professionals and inform policy-making process; benefit practitioners by guiding their KT professional development to become effective at moving evidence into practice and policy; guide suitable interventions and strategies to enhance KT activities in the health sector; and direct future research.

Project description:BackgroundThe arts are powerful, accessible forms of communication that have the potential to impart knowledge by attracting interest and developing meaningful connections. Knowledge translation aims to reduce the 'evidence-practice' gap by developing, implementing and evaluating strategies designed to enhance awareness and promote behavior change congruent with research evidence. Increasingly, innovative approaches such as narrative storytelling and other arts-based interventions are being investigated to bridge the growing gap between practice and research. This study is the first to systematically identify and synthesize current research on narrative storytelling and visual art to translate and disseminate health research.MethodsA health research librarian will develop and implement search strategies designed to identify relevant evidence. Studies will be included if they are primary research employing narrative storytelling and/or visual art as a knowledge translation strategy in healthcare. Two reviewers will independently perform study selection, quality assessment, and data extraction using standard forms. Disagreements will be resolved through discussion or third party adjudication. Data will be grouped and analyzed by research design, type of knowledge translation strategy (that is, a narrative or visual-arts-based approach), and target audience. An overall synthesis across all studies will be conducted.DiscussionThe findings from this research project will describe the 'state of the science' regarding the use of narrative storytelling and visual art as knowledge translation strategies. This systematic review will provide critical information for: (1) researchers conducting knowledge translation intervention studies; (2) nursing, medicine, and allied healthcare professionals; (3) healthcare consumers, including patients and families; and (4) decision makers and knowledge users who are charged to increase use of the latest research in healthcare settings.