Dataset Information

Indicators to evaluate organisational knowledge brokers: a scoping review.

ABSTRACT: BACKGROUND:Knowledge translation (KT) is currently endorsed by global health policy actors as a means to improve outcomes by institutionalising evidence-informed policy-making. Organisational knowledge brokers, comprised of researchers, policy-makers and other stakeholders, are increasingly being used to undertake and promote KT at all levels of health policy-making, though few resources exist to guide the evaluation of these efforts. Using a scoping review methodology, we identified, synthesised and assessed indicators that have been used to evaluate KT infrastructure and capacity-building activities in a health policy context in order to inform the evaluation of organisational knowledge brokers. METHODS:A scoping review methodology was used. This included the search of Medline, Global Health and the WHO Library databases for studies regarding the evaluation of KT infrastructure and capacity-building activities between health research and policy, published in English from 2005 to 2016. Data on study characteristics, outputs and outcomes measured, related indicators, mode of verification, duration and/or frequency of collection, indicator methods, KT model, and targeted capacity level were extracted and charted for analysis. RESULTS:A total of 1073 unique articles were obtained and 176 articles were qualified to be screened in full-text; 32 articles were included in the analysis. Of a total 213 indicators extracted, we identified 174 (174/213; 81.7%) indicators to evaluate the KT infrastructure and capacity-building that have been developed using methods beyond expert opinion. Four validated instruments were identified. The 174 indicators are presented in 8 domains based on an adaptation of the domains of the Lavis et al. framework of linking research to action - general climate, production of research, push efforts, pull efforts, exchange efforts, integrated efforts, evaluation and capacity-building. CONCLUSION:This review presents a total of 174 method-based indicators to evaluate KT infrastructure and capacity-building. The presented indicators can be used or adapted globally by organisational knowledge brokers and other stakeholders in their monitoring and evaluation work.

SUBMITTER: Scarlett J

PROVIDER: S-EPMC7444249 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Indicators to evaluate organisational knowledge brokers: a scoping review.

Scarlett Julia J Forsberg Birger C BC Biermann Olivia O Kuchenmüller Tanja T El-Khatib Ziad Z

Health research policy and systems 20200824 1

<h4>Background</h4>Knowledge translation (KT) is currently endorsed by global health policy actors as a means to improve outcomes by institutionalising evidence-informed policy-making. Organisational knowledge brokers, comprised of researchers, policy-makers and other stakeholders, are increasingly being used to undertake and promote KT at all levels of health policy-making, though few resources exist to guide the evaluation of these efforts. Using a scoping review methodology, we identified, sy ...[more]

PMID: 32831095

Similar Datasets

Project description:BackgroundThe purpose of this paper is to describe and reflect on the role of knowledge brokers (KBs) in the Seniors Health Research Transfer Network (SHRTN). The paper reviews the relevant literature on knowledge brokering, and then describes the evolving role of knowledge brokering in this knowledge network.MethodsThe description of knowledge brokering provided here is based on a developmental evaluation program and on the experiences of the authors. Data were gathered through qualitative and quantitative methods, analyzed by the evaluators, and interpreted by network members who participated in sensemaking forums. The results were fed back to the network each year in the form of formal written reports that were widely distributed to network members, as well as through presentations to the network's members.ResultsThe SHRTN evaluation and our experiences as evaluators and KBs suggest that a SHRTN KB facilitates processes of learning whereby people are connected with tacit or explicit knowledge sources that will help them to resolve work-related challenges. To make this happen, KBs engage in a set of relational, technical, and analytical activities that help communities of practice (CoPs) to develop and operate, facilitate exchanges among people with similar concerns and interests, and help groups and individuals to create, explore, and apply knowledge in their practice. We also suggest that the role is difficult to define, emergent, abstract, episodic, and not fully understood.ConclusionsThe KB role within this knowledge network has developed and matured over time. The KB adapts to the social and technical affordances of each situation, and fashions a unique and relevant process to create relationships and promote learning and change. The ability to work with teams and to develop relevant models and feasible approaches are critical KB skills. The KB is a leader who wields influence rather than power, and who is prepared to adopt whatever roles and approaches are needed to bring about a valuable result.

Project description:BackgroundEvaluating knowledge mobilization strategies (KMb) presents challenges for organizations seeking to understand their impact to improve KMb effectiveness. Moreover, the large number of theories, models, and frameworks (TMFs) available can be confusing for users. Therefore, the purpose of this scoping review was to identify and describe the characteristics of TMFs that have been used or proposed in the literature to evaluate KMb strategies.MethodsA scoping review methodology was used. Articles were identified through searches in electronic databases, previous reviews and reference lists of included articles. Titles, abstracts and full texts were screened in duplicate. Data were charted using a piloted data charting form. Data extracted included study characteristics, KMb characteristics, and TMFs used or proposed for KMb evaluation. An adapted version of Nilsen (Implement Sci 10:53, 2015) taxonomy and the Expert Recommendations for Implementing Change (ERIC) taxonomy (Powell et al. in Implement Sci 10:21, 2015) guided data synthesis.ResultsOf the 4763 search results, 505 were retrieved, and 88 articles were eligible for review. These consisted of 40 theoretical articles (45.5%), 44 empirical studies (50.0%) and four protocols (4.5%). The majority were published after 2010 (n = 70, 79.5%) and were health related (n = 71, 80.7%). Half of the studied KMb strategies were implemented in only four countries: Canada, Australia, the United States and the United Kingdom (n = 42, 47.7%). One-third used existing TMFs (n = 28, 31.8%). According to the adapted Nilsen taxonomy, process models (n = 34, 38.6%) and evaluation frameworks (n = 28, 31.8%) were the two most frequent types of TMFs used or proposed to evaluate KMb. According to the ERIC taxonomy, activities to "train and educate stakeholders" (n = 46, 52.3%) were the most common, followed by activities to "develop stakeholder interrelationships" (n = 23, 26.1%). Analysis of the TMFs identified revealed relevant factors of interest for the evaluation of KMb strategies, classified into four dimensions: context, process, effects and impacts.ConclusionsThis scoping review provides an overview of the many KMb TMFs used or proposed. The results provide insight into potential dimensions and components to be considered when assessing KMb strategies.

Project description:BackgroundThere is mixed evidence to support current ambitions for mobile health (mHealth) apps to improve chronic health and well-being. One proposed explanation for this variable effect is that users do not engage with apps as intended. The application of analytics, defined as the use of data to generate new insights, is an emerging approach to study and interpret engagement with mHealth interventions.ObjectiveThis study aimed to consolidate how analytic indicators of engagement have previously been applied across clinical and technological contexts, to inform how they might be optimally applied in future evaluations.MethodsWe conducted a scoping review to catalog the range of analytic indicators being used in evaluations of consumer mHealth apps for chronic conditions. We categorized studies according to app structure and application of engagement data and calculated descriptive data for each category. Chi-square and Fisher exact tests of independence were applied to calculate differences between coded variables.ResultsA total of 41 studies met our inclusion criteria. The average mHealth evaluation included for review was a two-group pretest-posttest randomized controlled trial of a hybrid-structured app for mental health self-management, had 103 participants, lasted 5 months, did not provide access to health care provider services, measured 3 analytic indicators of engagement, segmented users based on engagement data, applied engagement data for descriptive analyses, and did not report on attrition. Across the reviewed studies, engagement was measured using the following 7 analytic indicators: the number of measures recorded (76%, 31/41), the frequency of interactions logged (73%, 30/41), the number of features accessed (49%, 20/41), the number of log-ins or sessions logged (46%, 19/41), the number of modules or lessons started or completed (29%, 12/41), time spent engaging with the app (27%, 11/41), and the number or content of pages accessed (17%, 7/41). Engagement with unstructured apps was mostly measured by the number of features accessed (8/10, P=.04), and engagement with hybrid apps was mostly measured by the number of measures recorded (21/24, P=.03). A total of 24 studies presented, described, or summarized the data generated from applying analytic indicators to measure engagement. The remaining 17 studies used or planned to use these data to infer a relationship between engagement patterns and intended outcomes.ConclusionsAlthough researchers measured on average 3 indicators in a single study, the majority reported findings descriptively and did not further investigate how engagement with an app contributed to its impact on health and well-being. Researchers are gaining nuanced insights into engagement but are not yet characterizing effective engagement for improved outcomes. Raising the standard of mHealth app efficacy through measuring analytic indicators of engagement may enable greater confidence in the causal impact of apps on improved chronic health and well-being.

Project description:Background: To monitor population mental health, the identification of relevant indicators is pivotal. This scoping review provides a comprehensive overview of current indicators representing the various fields of public mental health core topics. It was conducted as a first step to build up a Mental Health Surveillance for Germany. Methods: We conducted a systematic MEDLINE search via PubMed. This search was supplemented by an extensive examination of the websites of relevant national as well as international institutions in the context of public mental health and an additional internet search via Google. To structure the data, an expert-based focus group identified superordinate topics most relevant to public mental health to which the identified indicators could be assigned to. Finally, the indicator set was screened for duplicates and appropriate content to arrive at a final set. Results: Within the various search strategies, we identified 13.811 records. Of these records, a total of 365 records were processed for indicator extraction. The extracted indicators were then assigned to 14 topics most relevant to public mental health as identified by the expert-based focus group. After the exclusion of duplicates and those indicators not meeting criteria of specificity and target group, the final set consisted of 192 indicators. Conclusion: The presented indicator set provides guidance in the field of current concepts in public mental health monitoring. As a comprehensive compilation, it may serve as basis for future surveillance efforts, which can be adjusted and condensed depending on the particular monitoring focus. Our work provides insights into established indicators included in former surveillance work as well as recent, not yet included indicators reflecting current developments in the field. Since our compilation mainly concludes indicators related to mental health in adults, it should be complemented with indicators specific to children and adolescents. Furthermore, our review revealed that indicators on mental health promotion and prevention are underrepresented in current literature of public mental health and should hence be focused on within future research and surveillance.

Project description:BackgroundAlthough important syntheses and theoretical works exist in relation to understanding the organisational factors that facilitate research use, these contributions differ in their scope and object of study as well as their theoretical underpinnings. Therefore, from an exploratory angle, it may be useful to map out the current literature on organisational factors of research use in public health policy-making when revisiting existing theories and frameworks to gain further theoretical insights.MethodsHerein, a scoping review technique and thematic content analysis were used to bring together findings from both synthesised and empirical studies of different types to map out the organisational factors that facilitate research use in public health policy-making.ResultsA total of 14 reviews and 40 empirical studies were included in the analysis. These were thematically coded and the intra-organisational factors reported as enabling research use were examined. Five main categories of organisational factors that advance research use in policy organisations - (1) individual factors, (2) the management of research integration, (3) organisational systems and infrastructures of research use, (4) institutional structures and rules for policy-making, and (5) organisational characteristics - were derived as well as 18 subcategories and a total of 64 specific factors, where 27 factors were well supported by research.ConclusionsUsing a scoping review methodology, the intra-organisational factors influencing research use in policy-making (including individual factors) were systematically mapped and the theories applied in this area of research were assessed. The review findings confirm the importance of an intra-organisational perspective when exploring research use, showing that many organisational factors are critical facilitators of research use but also that many factors and mechanisms are understudied. The synthesis shows a lack of studies on politicians and the need for more theoretically founded research. Despite increased efforts to update the existing evidential and theoretical basis of research use, we still need frameworks that combine different approaches and theories to help us grasp the complex organisational mechanisms that facilitate research use in policy settings.

Project description:BackgroundOffshore industries operate all around the world in diverse and remote environments. The use of telemedicine to ensure up-to-date medical care for thousands of people offshore has been common practice for decades. Thus, in this setting, extensive experiences with this type of health care delivery have already been gathered, while in other settings this is just beginning. However, the quality of telemedical care on offshore installations is rarely reported yet. The objective of this review was to explore published literature with regards to the following questions: Have any Quality Indicators (QIs) been published for measuring the quality of telemedical care on offshore installations or are there identifiable items that could be used as such QIs?MethodsWe conducted a comprehensive Scoping Review (PRISMA-ScR) of the published literature using the databases MEDLINE, Cochrane Library, Web of Science (Core Collection), and Google Scholar. Search results were read and QIs or findings from which QIs could be derived were classified according to the dimensions of quality established by Donabedian (structure, process, or outcome QIs).ResultsThe search returned 10,236 non-recurring articles, 45 of which were full-text screened and 15 of which were included in this review. Types of publications were heterogenous. No QIs for the quality of telemedical care offshore have been published yet. Findings that could be the basis for QIs focused on structure quality (11 QIs) followed by process quality (11 QIs), while outcome quality was less common (1 QI).ConclusionCurrently, although years of experience with telemedical care on offshore installations exist, there is a paucity of research on a solid data base regarding the quality of telemedical care offshore. The authors derived a list of 24 possible QIs from the findings of the publications for further validation. This could be the basis for implementation and definition of QIs in this and in similar remote settings.

Dataset Information

Indicators to evaluate organisational knowledge brokers: a scoping review.

Publications

Indicators to evaluate organisational knowledge brokers: a scoping review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets