Dataset Information

A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

ABSTRACT:

Background

The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.

Methods

We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.

Findings

We found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments.

Conclusion

Our findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.

SUBMITTER: Gagnon MP

PROVIDER: S-EPMC4256226 | biostudies-literature | 2014

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

Gagnon Marie-Pierre MP Attieh Randa R Ghandour El Kebir el K Légaré France F Ouimet Mathieu M Estabrooks Carole A CA Grimshaw Jeremy J

PloS one 20141204 12

<h4>Background</h4>The translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.<h4>Methods</h4>We searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included pub ...[more]

PMID: 25474622

Similar Datasets

Project description:BackgroundWith the persistent gaps between research and practice in healthcare systems, knowledge translation (KT) has gained significance and importance. Also, in most industrialized countries, there is an increasing emphasis on managing chronic health conditions with the best available evidence. Yet, organizations aiming to improve chronic care (CC) require an adequate level of organizational readiness (OR) for KT.ObjectivesThe purpose of this study is to review and synthesize the existing evidence on conceptual models/frameworks of Organizational Readiness for Change (ORC) in healthcare as the basis for the development of a comprehensive framework of OR for KT in the context of CC.Data sourcesWe conducted a systematic review of the literature on OR for KT in CC using Pubmed, Embase, CINAHL, PsychINFO, Web of Sciences (SCI and SSCI), and others. Search terms included readiness; commitment and change; preparedness; willing to change; organization and administration; and health and social services.Study selectionThe search was limited to studies that had been published between the starting date of each bibliographic database (e.g., 1964 for PubMed) and November 1, 2012. Only papers that refer to a theory, a theoretical component from any framework or model on OR that were applicable to the healthcare domain were considered. We analyzed data using conceptual mapping.Data extractionPairs of authors independently screened the published literature by reviewing their titles and abstracts. Then, the two same reviewers appraised the full text of each study independently.ResultsOverall, we found and synthesized 10 theories, theoretical models and conceptual frameworks relevant to ORC in healthcare described in 38 publications. We identified five core concepts, namely organizational dynamics, change process, innovation readiness, institutional readiness, and personal readiness. We extracted 17 dimensions and 59 sub-dimensions related to these 5 concepts.ConclusionOur findings provide a useful overview for researchers interested in ORC and aims to create a consensus on the core theoretical components of ORC in general and of OR for KT in CC in particular. However, more work is needed to define and validate the core elements of a framework that could help to assess OR for KT in CC.

Project description:BackgroundKnowledge translation (KT) is an important means of improving the health service quality. Most research on the effectiveness of KT strategies has focused on individual strategies, i.e., those directly targeting the modification of allied health professionals' knowledge, attitudes, and behaviors, for example. In general, these strategies are moderately effective in changing practices (maximum 10% change). Effecting change in organizational contexts (e.g., change readiness, general and specific organizational capacity, organizational routines) is part of a promising new avenue to service quality improvement through the implementation of evidence-based practices. The objective of this study will be to identify why, how, and under what conditions organizational KT strategies have been shown to be effective or ineffective in changing the (a) knowledge, (b) attitudes, and (c) clinical behaviors of allied health professionals in traumatology settings.MethodsThis is a realist review protocol involving four iterative steps: (1) Initial theory formulation, (2) search for Evidence search, (3) knowledge extraction and synthesis, and (4) recommendations. We will search electronic databases such as PubMed, Embase, CINHAL, Cochrane Library, and Conference Proceedings Citation Index - Science. The studies included will be those relating to the use of organizational KT strategies in trauma settings, regardless of study designs, published between January 1990 and October 2020, and presenting objective measures that demonstrate change in allied health professionals' knowledge, attitudes, and clinical behaviors. Two independent reviewers will select, screen, and extract the data related to all relevant sources in order to refine or refute the context-mechanism-outcome (CMO) configurations developed in the initial theory and identify new CMO configurations.DiscussionUsing a systematic and rigorous method, this review will help guide decision-makers and researchers in choosing the best organizational strategies to optimize the implementation of evidence-based practices.Systematic review registrationPROSPERO CRD42020216105.

Project description:BackgroundIntegrated knowledge translation (IKT) refers to collaboration between researchers and decision-makers. While advocated as an approach for enhancing the relevance and use of research, IKT is challenging and inconsistently applied. This study sought to inform future IKT practice and research by synthesizing studies that empirically evaluated IKT and identifying knowledge gaps.MethodsWe performed a scoping review. We searched MEDLINE, EMBASE, and the Cochrane Library from 2005 to 2014 for English language studies that evaluated IKT interventions involving researchers and organizational or policy-level decision-makers. Data were extracted on study characteristics, IKT intervention (theory, content, mode, duration, frequency, personnel, participants, timing from initiation, initiator, source of funding, decision-maker involvement), and enablers, barriers, and outcomes reported by studies. We performed content analysis and reported summary statistics.ResultsThirteen studies were eligible after screening 14,754 titles and reviewing 106 full-text studies. Details about IKT activities were poorly reported, and none were formally based on theory. Studies varied in the number and type of interactions between researchers and decision-makers; meetings were the most common format. All studies reported barriers and facilitators. Studies reported a range of positive and sub-optimal outcomes. Outcomes did not appear to be associated with initiator of the partnership, dedicated funding, partnership maturity, nature of decision-maker involvement, presence or absence of enablers or barriers, or the number of different IKT activities.ConclusionsThe IKT strategies that achieve beneficial outcomes remain unknown. We generated a summary of IKT approaches, enablers, barriers, conditions, and outcomes that can serve as the basis for a future review or for planning ongoing primary research. Future research can contribute to three identified knowledge gaps by examining (1) how different IKT strategies influence outcomes, (2) the relationship between the logic or theory underlying IKT interventions and beneficial outcomes, and (3) when and how decision-makers should be involved in the research process. Future IKT initiatives should more systematically plan and document their design and implementation, and evaluations should report the findings with sufficient detail to reveal how IKT was associated with outcomes.

Project description:BackgroundKnowledge translation (KT) aims to close the research-practice gap in order to realize and maximize the benefits of research within the practice setting. Previous studies have investigated KT strategies in nursing and medicine; however, the present study is the first systematic review of the effectiveness of a variety of KT interventions in five allied health disciplines: dietetics, occupational therapy, pharmacy, physiotherapy, and speech-language pathology.MethodsA health research librarian developed and implemented search strategies in eight electronic databases (MEDLINE, CINAHL, ERIC, PASCAL, EMBASE, IPA, Scopus, CENTRAL) using language (English) and date restrictions (1985 to March 2010). Other relevant sources were manually searched. Two reviewers independently screened the titles and abstracts, reviewed full-text articles, performed data extraction, and performed quality assessment. Within each profession, evidence tables were created, grouping and analyzing data by research design, KT strategy, targeted behaviour, and primary outcome. The published descriptions of the KT interventions were compared to the Workgroup for Intervention Development and Evaluation Research (WIDER) Recommendations to Improve the Reporting of the Content of Behaviour Change Interventions.ResultsA total of 2,638 articles were located and the titles and abstracts were screened. Of those, 1,172 full-text articles were reviewed and subsequently 32 studies were included in the systematic review. A variety of single (n = 15) and multiple (n = 17) KT interventions were identified, with educational meetings being the predominant KT strategy (n = 11). The majority of primary outcomes were identified as professional/process outcomes (n = 25); however, patient outcomes (n = 4), economic outcomes (n = 2), and multiple primary outcomes (n = 1) were also represented. Generally, the studies were of low methodological quality. Outcome reporting bias was common and precluded clear determination of intervention effectiveness. In the majority of studies, the interventions demonstrated mixed effects on primary outcomes, and only four studies demonstrated statistically significant, positive effects on primary outcomes. None of the studies satisfied the four WIDER Recommendations.ConclusionsAcross five allied health professions, equivocal results, low methodological quality, and outcome reporting bias limited our ability to recommend one KT strategy over another. Further research employing the WIDER Recommendations is needed to inform the development and implementation of effective KT interventions in allied health.

Project description:BACKGROUND: Continuous quality improvement (CQI) methods are widely used in healthcare; however, the effectiveness of the methods is variable, and evidence about the extent to which contextual and other factors modify effects is limited. Investigating the relationship between these factors and CQI outcomes poses challenges for those evaluating CQI, among the most complex of which relate to the measurement of modifying factors. We aimed to provide guidance to support the selection of measurement instruments by systematically collating, categorising, and reviewing quantitative self-report instruments. METHODS: DATA SOURCES: We searched MEDLINE, PsycINFO, and Health and Psychosocial Instruments, reference lists of systematic reviews, and citations and references of the main report of instruments. STUDY SELECTION: The scope of the review was determined by a conceptual framework developed to capture factors relevant to evaluating CQI in primary care (the InQuIRe framework). Papers reporting development or use of an instrument measuring a construct encompassed by the framework were included. Data extracted included instrument purpose; theoretical basis, constructs measured and definitions; development methods and assessment of measurement properties. Analysis and synthesis: We used qualitative analysis of instrument content and our initial framework to develop a taxonomy for summarising and comparing instruments. Instrument content was categorised using the taxonomy, illustrating coverage of the InQuIRe framework. Methods of development and evidence of measurement properties were reviewed for instruments with potential for use in primary care. RESULTS: We identified 186 potentially relevant instruments, 152 of which were analysed to develop the taxonomy. Eighty-four instruments measured constructs relevant to primary care, with content measuring CQI implementation and use (19 instruments), organizational context (51 instruments), and individual factors (21 instruments). Forty-one instruments were included for full review. Development methods were often pragmatic, rather than systematic and theory-based, and evidence supporting measurement properties was limited. CONCLUSIONS: Many instruments are available for evaluating CQI, but most require further use and testing to establish their measurement properties. Further development and use of these measures in evaluations should increase the contribution made by individual studies to our understanding of CQI and enhance our ability to synthesise evidence for informing policy and practice.

Project description:BackgroundLiterature related to the effectiveness of knowledge translation (KT) strategies used in public health is lacking. The capacity to seek, analyze, and synthesize evidence-based information in public health is linked to greater success in making policy choices that have the best potential to yield positive outcomes for populations. The purpose of this systematic review is to identify the effectiveness of KT strategies used to promote evidence-informed decision making (EIDM) among public health decision makers.MethodsA search strategy was developed to identify primary studies published between 2000-2010. Studies were obtained from multiple electronic databases (CINAHL, Medline, EMBASE, and the Cochrane Database of Systematic Reviews). Searches were supplemented by hand searching and checking the reference lists of included articles. Two independent review authors screened studies for relevance, assessed methodological quality of relevant studies, and extracted data from studies using standardized tools.ResultsAfter removal of duplicates, the search identified 64, 391 titles related to KT strategies. Following title and abstract review, 346 publications were deemed potentially relevant, of which 5 met all relevance criteria on full text screen. The included publications were of moderate quality and consisted of five primary studies (four randomized controlled trials and one interrupted time series analysis). Results were synthesized narratively. Simple or single KT strategies were shown in some circumstances to be as effective as complex, multifaceted ones when changing practice including tailored and targeted messaging. Multifaceted KT strategies led to changes in knowledge but not practice. Knowledge translation strategies shown to be less effective were passive and included access to registries of pre-processed research evidence or print materials. While knowledge brokering did not have a significant effect generally, results suggested that it did have a positive effect on those organizations that at baseline perceived their organization to place little value on evidence-informed decision making.ConclusionsNo singular KT strategy was shown to be effective in all contexts. Conclusions about interventions cannot be taken on their own without considering the characteristics of the knowledge that was being transferred, providers, participants and organizations.

Dataset Information

A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

Background

Methods

Findings

Conclusion

Publications

A systematic review of instruments to assess organizational readiness for knowledge translation in health care.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets