Dataset Information

Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC).

ABSTRACT: BACKGROUND:Organizational change initiatives in health care frequently achieve only partial implementation success. Understanding an organizational readiness for change (ORC) may be a way to develop more effective and efficient change strategies. Denmark, like many countries, has begun a major system-wide structural reform which involves considerable changes in service delivery. Due to the lack of a validated Danish instrument, we aimed to translate and validate a Danish version of the Organizational Readiness for Implementing Change (ORIC) questionnaire. It measures if organizational members are confident in their collective commitment towards and ability (efficacy) to implement organizational change. ORIC is concise, grounded in theory, and designed, but not yet validated among employees in a real hospital setting. METHODS:The 12-item ORIC instrument was translated into Danish and back-translated to English. Employees (N?=?284) at a hospital department facing a major organizational change in the Central Denmark Region completed the questionnaire. Face and content validity was ascertained. Exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were used to assess construct validity. Reliability was assessed with Cronbach's alpha. Item response theory (Rasch analysis) was used to determine item and person reliability. RESULTS:Response rate was 72%. A two factor (commitment and efficacy), 11-item scale, of the Danish language ORIC was shown to be valid (CFI?=?.95, RMSEA?=?.067, and CMNI/DF?=?2.32) and reliable (Cronbach's alpha 0.88) in a health care setting. Item response analysis confirmed acceptable person and item separation reliability. CONCLUSIONS:Our version of ORIC showed acceptable validity and reliability as an instrument for measuring readiness for implementing organizational change in a Danish-speaking health care population. For health care managers interested in evaluating their organizations and tailor change strategies, ORIC's brevity and theoretical underpinnings could make it an appealing and feasible tool to develop more successful change efforts.

SUBMITTER: Storkholm MH

PROVIDER: S-EPMC5989337 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC).

Storkholm Marie Höjriis MH Mazzocato Pamela P Tessma Mesfin Kassaye MK Savage Carl C

Implementation science : IS 20180605 1

<h4>Background</h4>Organizational change initiatives in health care frequently achieve only partial implementation success. Understanding an organizational readiness for change (ORC) may be a way to develop more effective and efficient change strategies. Denmark, like many countries, has begun a major system-wide structural reform which involves considerable changes in service delivery. Due to the lack of a validated Danish instrument, we aimed to translate and validate a Danish version of the O ...[more]

PMID: 29871691

Similar Datasets

Project description:BackgroundOrganizational readiness is a factor known to influence the predisposition of individuals within an organization to change. Based on Weiner's organizational theory, the "Organizational Readiness for Implementing Change" (ORIC) questionnaire was developed and validated to measure organizational readiness in healthcare contexts. However, no such tools allow French-speaking organizations to measure this concept. The objectives of this study were to (1) conduct a French cultural adaptation of the ORIC questionnaire, and (2) initiate the study of its psychometric properties.Methods(1) Cross-cultural adaptation and translation processes were first conducted with the methodologies of Beaton, Vallerand and Massoubre. (2) Subsequently, internal consistency was documented by calculating Cronbach's alpha and inter-item and item-to-scale correlations. The study of construct validity was initiated with a confirmatory factor analysis.ResultsA French 10-item scale named the Réceptivité organisationnelle à l'implantation d'un changement (ROIC) was developed and pretested by 125 occupational therapists working in Quebec homecare services. Cronbach's alpha values for the 2 item subscales show satisfactory internal consistency (Commitment: α = 0.84 and Efficacy: α = 0.86). Inter-item correlations revealed that the ROIC's items are moderately related to each other while item-to-total scale correlations pinpoint items that accounts for variance and influence internal consistency. Confirmatory factor analysis allowed the initiation of a substantial documentation of ROIC's model fit with the original version (CFI = 0.89, TLI = 0.85, SRMR = 0.08, and RMSEA = 0.12).ConclusionsThe ROIC is a new theory-based and translated questionnaire that can be used to rigorously document the organizational readiness of French organizations. The ROIC has the potential to support members of different organizations in the identification of subsequent efforts for the implementation of a change.

Project description:Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change.We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three.Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis.This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.

Project description:Sierra Leone has one of the world's highest maternal and infant mortality rates and suffers from a shortage of well-trained health professionals, including midwives. Prior to engaging in systematic interventions, it is critical to measure organizational readiness to gauge members' psychological and behavioral preparedness to implement change. We aimed to measure the organizational readiness for implementing change and compare results among midwives and administrative leaders at two schools of midwifery in Sierra Leone prior to the rollout of a midwifery preceptor program. The Organizational Readiness for Implementing Change (ORIC) survey is a validated 12-item questionnaire designed to assess two domains of organizational readiness for change: change commitment (motivation) and change efficacy (capacity). All survey items begin with the same prompt and a five-item Likert scale response, with seven questions about change commitment and five about change efficacy. Data collection occurred in two schools of midwifery in Sierra Leone during two day-long meetings with stakeholders. Statistical analysis was conducted using descriptive statistics and Wilcoxon rank-sum test to compare independent samples: School 1 versus School 2 (site), midwife versus other roles (role). Participants included 42 respondents (mean age 41 years, 95% female). Surveys were distributed evenly between the two sites. Occupations included midwifery faculty (n = 8), administrators (n = 5), clinicians (n = 25), and clinical educators (n = 4). Domain 1 (change commitment) had a mean score of 4.72 (SD 0.47) while Domain 2 (change efficacy) had a mean score of 4.53 (SD 0.54) out of a total potential score of five. There were no statistically significant differences between site responses for Domain 1 (p = 0.5479) and Domain 2 (p = 0.1026) nor role responses for Domain 1 (p = 0.0627) and Domain 2 (p = 0.2520). Stakeholders had very high overall readiness for change across all ORIC questions for both change commitment and change efficacy. Mean scores for change commitment were slightly higher which is not surprising given the low-resourced settings stakeholders work in while training students. High mean scores across sites and roles is encouraging as this novel preceptor program is currently being rolled out.

Project description:UnlabelledBackgroundThere is widespread interest in measuring organizational readiness to implement evidence-based practices in clinical care. However, there are a number of challenges to validating organizational measures, including inferential bias arising from the halo effect and method bias - two threats to validity that, while well-documented by organizational scholars, are often ignored in health services research. We describe a protocol to comprehensively assess the psychometric properties of a previously developed survey, the Organizational Readiness to Change Assessment.ObjectivesOur objective is to conduct a comprehensive assessment of the psychometric properties of the Organizational Readiness to Change Assessment incorporating methods specifically to address threats from halo effect and method bias.Methods and designWe will conduct three sets of analyses using longitudinal, secondary data from four partner projects, each testing interventions to improve the implementation of an evidence-based clinical practice. Partner projects field the Organizational Readiness to Change Assessment at baseline (n = 208 respondents; 53 facilities), and prospectively assesses the degree to which the evidence-based practice is implemented. We will conduct predictive and concurrent validities using hierarchical linear modeling and multivariate regression, respectively. For predictive validity, the outcome is the change from baseline to follow-up in the use of the evidence-based practice. We will use intra-class correlations derived from hierarchical linear models to assess inter-rater reliability. Two partner projects will also field measures of job satisfaction for convergent and discriminant validity analyses, and will field Organizational Readiness to Change Assessment measures at follow-up for concurrent validity (n = 158 respondents; 33 facilities). Convergent and discriminant validities will test associations between organizational readiness and different aspects of job satisfaction: satisfaction with leadership, which should be highly correlated with readiness, versus satisfaction with salary, which should be less correlated with readiness. Content validity will be assessed using an expert panel and modified Delphi technique.DiscussionWe propose a comprehensive protocol for validating a survey instrument for assessing organizational readiness to change that specifically addresses key threats of bias related to halo effect, method bias and questions of construct validity that often go unexplored in research using measures of organizational constructs.

Project description:BackgroundThe smoking prevalence is high among students enrolled in vocational education and training, which is considered a lower level of education. The school tobacco policy regarding smoke-free school hours stipulates that students and staff are not allowed to smoke during school hours-inside or outside school premises-and it might be an effective intervention for reducing smoking in vocational schools. For school tobacco policies to be effective, they must be appropriately implemented. A primary predictor for successful implementation is organizational readiness for change. This study seeks to identify and understand the barriers to and facilitators for developing organizational readiness to implement smoke-free school hours in Danish vocational schools.MethodsSemi-structured interviews and focus groups were carried out with managers and teachers (n = 22 participants) from six vocational schools. The interview guides were informed by "A theory of organizational readiness for change" developed by Weiner, which was also used as a framework to analyze the data.ResultsWe identified 13 facilitators and barriers. Nine factors acted as facilitators, including the following: believing that health promotion is a school role and duty; believing that society and workplaces are becoming more smoke-free, and believing that smoke-free school hours is a beneficial strategy to achieve fewer educational interruptions. Additional facilitators include establishing clear rules for sanctioning and enforcement, developing a joint understanding about smoke-free school hours, developing skills to deal with student responses to smoke-free school hours, establishing social alternatives to smoking, offering smoking cessation help, and mandating smoke-free school hours by law. Four organizational norms, practices, or discourses acted as barriers: believing that smoke-free school hours violate personal freedom, believing that students have more important problems than smoking, believing that it is difficult to administer the level of enforcement, and believing that the enforcement of smoke-free school hours negatively influences student-teacher relations.DiscussionOur results suggest that developing organizational readiness before adopting a comprehensive tobacco policy such as smoke-free school hours is important for successful implementation. Further research should investigate how to strengthen the facilitators for and counter the barriers to developing readiness for implementing smoke-free school hours.

Dataset Information

Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC).

Publications

Assessing the reliability and validity of the Danish version of Organizational Readiness for Implementing Change (ORIC).

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets