Dataset Information

Unpacking organizational readiness for change: an updated systematic review and content analysis of assessments.

ABSTRACT: BACKGROUND:Organizational readiness assessments have a history of being developed as important support tools for successful implementation. However, it remains unclear how best to operationalize readiness across varied projects or settings. We conducted a synthesis and content analysis of published readiness instruments to compare how investigators have operationalized the concept of organizational readiness for change. METHODS:We identified readiness assessments using a systematic review and update search. We mapped individual assessment items to the Consolidated Framework for Implementation Research (CFIR), which identifies five domains affecting implementation (outer setting, inner setting, intervention characteristics, characteristics of individuals, and implementation process) and multiple constructs within each domain. RESULTS:Of 1370 survey items, 897 (68%) mapped to the CFIR domain of inner setting, most commonly related to constructs of readiness for implementation (n?=?220); networks and communication (n?=?207); implementation climate (n?=?204); structural characteristics (n?=?139); and culture (n?=?93). Two hundred forty-two items (18%) mapped to characteristics of individuals (mainly other personal attributes [n?=?157] and self-efficacy [n?=?52]); 80 (6%) mapped to outer setting; 51 (4%) mapped to implementation process; 40 (3%) mapped to intervention characteristics; and 60 (4%) did not map to CFIR constructs. Instruments were typically tailored to specific interventions or contexts. DISCUSSION:Available readiness instruments predominantly focus on contextual factors within the organization and characteristics of individuals, but the specificity of most assessment items suggests a need to tailor items to the specific scenario in which an assessment is fielded. Readiness assessments must bridge the gap between measuring a theoretical construct and factors of importance to a particular implementation.

SUBMITTER: Miake-Lye IM

PROVIDER: S-EPMC7014613 | biostudies-literature | 2020 Feb

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Unpacking organizational readiness for change: an updated systematic review and content analysis of assessments.

Miake-Lye Isomi M IM Delevan Deborah M DM Ganz David A DA Mittman Brian S BS Finley Erin P EP

BMC health services research 20200211 1

<h4>Background</h4>Organizational readiness assessments have a history of being developed as important support tools for successful implementation. However, it remains unclear how best to operationalize readiness across varied projects or settings. We conducted a synthesis and content analysis of published readiness instruments to compare how investigators have operationalized the concept of organizational readiness for change.<h4>Methods</h4>We identified readiness assessments using a systemati ...[more]

PMID: 32046708

Similar Datasets

Project description:UnlabelledBackgroundThere is widespread interest in measuring organizational readiness to implement evidence-based practices in clinical care. However, there are a number of challenges to validating organizational measures, including inferential bias arising from the halo effect and method bias - two threats to validity that, while well-documented by organizational scholars, are often ignored in health services research. We describe a protocol to comprehensively assess the psychometric properties of a previously developed survey, the Organizational Readiness to Change Assessment.ObjectivesOur objective is to conduct a comprehensive assessment of the psychometric properties of the Organizational Readiness to Change Assessment incorporating methods specifically to address threats from halo effect and method bias.Methods and designWe will conduct three sets of analyses using longitudinal, secondary data from four partner projects, each testing interventions to improve the implementation of an evidence-based clinical practice. Partner projects field the Organizational Readiness to Change Assessment at baseline (n = 208 respondents; 53 facilities), and prospectively assesses the degree to which the evidence-based practice is implemented. We will conduct predictive and concurrent validities using hierarchical linear modeling and multivariate regression, respectively. For predictive validity, the outcome is the change from baseline to follow-up in the use of the evidence-based practice. We will use intra-class correlations derived from hierarchical linear models to assess inter-rater reliability. Two partner projects will also field measures of job satisfaction for convergent and discriminant validity analyses, and will field Organizational Readiness to Change Assessment measures at follow-up for concurrent validity (n = 158 respondents; 33 facilities). Convergent and discriminant validities will test associations between organizational readiness and different aspects of job satisfaction: satisfaction with leadership, which should be highly correlated with readiness, versus satisfaction with salary, which should be less correlated with readiness. Content validity will be assessed using an expert panel and modified Delphi technique.DiscussionWe propose a comprehensive protocol for validating a survey instrument for assessing organizational readiness to change that specifically addresses key threats of bias related to halo effect, method bias and questions of construct validity that often go unexplored in research using measures of organizational constructs.

Project description:BackgroundThe translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.MethodsWe searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.FindingsWe found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments.ConclusionOur findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.

Project description:Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change.We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three.Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis.This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.

Project description:BackgroundOrganizational readiness is a factor known to influence the predisposition of individuals within an organization to change. Based on Weiner's organizational theory, the "Organizational Readiness for Implementing Change" (ORIC) questionnaire was developed and validated to measure organizational readiness in healthcare contexts. However, no such tools allow French-speaking organizations to measure this concept. The objectives of this study were to (1) conduct a French cultural adaptation of the ORIC questionnaire, and (2) initiate the study of its psychometric properties.Methods(1) Cross-cultural adaptation and translation processes were first conducted with the methodologies of Beaton, Vallerand and Massoubre. (2) Subsequently, internal consistency was documented by calculating Cronbach's alpha and inter-item and item-to-scale correlations. The study of construct validity was initiated with a confirmatory factor analysis.ResultsA French 10-item scale named the Réceptivité organisationnelle à l'implantation d'un changement (ROIC) was developed and pretested by 125 occupational therapists working in Quebec homecare services. Cronbach's alpha values for the 2 item subscales show satisfactory internal consistency (Commitment: α = 0.84 and Efficacy: α = 0.86). Inter-item correlations revealed that the ROIC's items are moderately related to each other while item-to-total scale correlations pinpoint items that accounts for variance and influence internal consistency. Confirmatory factor analysis allowed the initiation of a substantial documentation of ROIC's model fit with the original version (CFI = 0.89, TLI = 0.85, SRMR = 0.08, and RMSEA = 0.12).ConclusionsThe ROIC is a new theory-based and translated questionnaire that can be used to rigorously document the organizational readiness of French organizations. The ROIC has the potential to support members of different organizations in the identification of subsequent efforts for the implementation of a change.

Project description:BackgroundImplementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.MethodsTwo distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.ResultsORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.ConclusionsMapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.

Project description:BACKGROUND:Organizational change initiatives in health care frequently achieve only partial implementation success. Understanding an organizational readiness for change (ORC) may be a way to develop more effective and efficient change strategies. Denmark, like many countries, has begun a major system-wide structural reform which involves considerable changes in service delivery. Due to the lack of a validated Danish instrument, we aimed to translate and validate a Danish version of the Organizational Readiness for Implementing Change (ORIC) questionnaire. It measures if organizational members are confident in their collective commitment towards and ability (efficacy) to implement organizational change. ORIC is concise, grounded in theory, and designed, but not yet validated among employees in a real hospital setting. METHODS:The 12-item ORIC instrument was translated into Danish and back-translated to English. Employees (N = 284) at a hospital department facing a major organizational change in the Central Denmark Region completed the questionnaire. Face and content validity was ascertained. Exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were used to assess construct validity. Reliability was assessed with Cronbach's alpha. Item response theory (Rasch analysis) was used to determine item and person reliability. RESULTS:Response rate was 72%. A two factor (commitment and efficacy), 11-item scale, of the Danish language ORIC was shown to be valid (CFI = .95, RMSEA = .067, and CMNI/DF = 2.32) and reliable (Cronbach's alpha 0.88) in a health care setting. Item response analysis confirmed acceptable person and item separation reliability. CONCLUSIONS:Our version of ORIC showed acceptable validity and reliability as an instrument for measuring readiness for implementing organizational change in a Danish-speaking health care population. For health care managers interested in evaluating their organizations and tailor change strategies, ORIC's brevity and theoretical underpinnings could make it an appealing and feasible tool to develop more successful change efforts.

Dataset Information

Unpacking organizational readiness for change: an updated systematic review and content analysis of assessments.

Publications

Unpacking organizational readiness for change: an updated systematic review and content analysis of assessments.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets