Openness Toward Organizational Change Scale (OTOCS): Validity evidence from Brazil and Portugal.
Ontology highlight
ABSTRACT:
SUBMITTER: Sinval J
PROVIDER: S-EPMC8055016 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Job satisfaction is an important construct that is known to be associated with workers' performance and wellbeing. As such, to properly measure it, one must use adapted measures that show adequate validity evidence for the desired context. Such measures should preferably be short to allow the parsimonious use of various measures/constructs in the same data collection. The aim of this paper is to adapt the Portuguese version for Brazil and Portugal of the Short Index of Job Satisfaction (SIJS). The SIJS is a psychometric instrument that measures job satisfaction through five items. A cross-sectional study was conducted with two multi-occupational workers samples, one from Brazil (n = 599) and one other from Portugal (n = 572). The SIJS presented good validity evidence based on its internal structure, namely dimensionality, reliability, and measurement invariance across countries and sexes. It also revealed to be positively correlated with work engagement, and quality of work life (convergent evidence). It also has shown to be negatively associated with burnout (discriminant evidence). The SIJS showed promising validity evidence. The SIJS can be useful to be used together with other instruments, due to its small number of items, producing data with good psychometric properties.
| S-EPMC7156096 | biostudies-literature
Project description:The Multidimensional Daily Diary of Fatigue-Fibromyalgia-17 (MDF-fibro-17) is an instrument that measures the different components of fibromyalgia-related fatigue symptoms. The current study aims to examine the factor structure of the MDF-fibro-17 in a sample of Portuguese and Brazilian patients diagnosed with fibromyalgia. Additionally, a cross-cultural analysis was carried out on these samples to understand the multidimensional complexity of examining the different dimensions of fatigue in patients with different cultural backgrounds and how fibromyalgia impacts patients with this syndrome. A confirmatory factor analysis was performed to examine the psychometric properties of the measure. Additionally, a multigroup analysis was carried out on the samples of these two cultures to examine measurement invariance. In total, 209 Portuguese women aged between 21 and 75 years (M = 47.44; SD = 10.73) and 429 Brazilians women aged between 16 and 77 years (M = 46.51; SD = 9.24) participated in this study. The results revealed that the measurement model provided an acceptable fit to the data in both the Portuguese and Brazilian samples, also displaying acceptable convergent and discriminant validity. In addition, the model showed acceptable internal consistency and was invariant between cultures. In sum, the MDF-fibro-17 is a valid measure that offers a unique assessment of fatigue symptoms in Portuguese and Brazilian women with fibromyalgia.
| S-EPMC7463927 | biostudies-literature
Project description:BACKGROUND:Organizational change initiatives in health care frequently achieve only partial implementation success. Understanding an organizational readiness for change (ORC) may be a way to develop more effective and efficient change strategies. Denmark, like many countries, has begun a major system-wide structural reform which involves considerable changes in service delivery. Due to the lack of a validated Danish instrument, we aimed to translate and validate a Danish version of the Organizational Readiness for Implementing Change (ORIC) questionnaire. It measures if organizational members are confident in their collective commitment towards and ability (efficacy) to implement organizational change. ORIC is concise, grounded in theory, and designed, but not yet validated among employees in a real hospital setting. METHODS:The 12-item ORIC instrument was translated into Danish and back-translated to English. Employees (N?=?284) at a hospital department facing a major organizational change in the Central Denmark Region completed the questionnaire. Face and content validity was ascertained. Exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were used to assess construct validity. Reliability was assessed with Cronbach's alpha. Item response theory (Rasch analysis) was used to determine item and person reliability. RESULTS:Response rate was 72%. A two factor (commitment and efficacy), 11-item scale, of the Danish language ORIC was shown to be valid (CFI?=?.95, RMSEA?=?.067, and CMNI/DF?=?2.32) and reliable (Cronbach's alpha 0.88) in a health care setting. Item response analysis confirmed acceptable person and item separation reliability. CONCLUSIONS:Our version of ORIC showed acceptable validity and reliability as an instrument for measuring readiness for implementing organizational change in a Danish-speaking health care population. For health care managers interested in evaluating their organizations and tailor change strategies, ORIC's brevity and theoretical underpinnings could make it an appealing and feasible tool to develop more successful change efforts.
| S-EPMC5989337 | biostudies-literature
Project description:Accumulating evidence suggests that many findings in psychological science and cognitive neuroscience may prove difficult to reproduce; statistical power in brain imaging studies is low and has not improved recently; software errors in analysis tools are common and can go undetected for many years; and, a few large-scale studies notwithstanding, open sharing of data, code, and materials remain the rare exception. At the same time, there is a renewed focus on reproducibility, transparency, and openness as essential core values in cognitive neuroscience. The emergence and rapid growth of data archives, meta-analytic tools, software pipelines, and research groups devoted to improved methodology reflect this new sensibility. We review evidence that the field has begun to embrace new open research practices and illustrate how these can begin to address problems of reproducibility, statistical power, and transparency in ways that will ultimately accelerate discovery.
| S-EPMC5545750 | biostudies-other
Project description:ObjectiveTo provide validity evidence for a multifaceted organizational program for assessing physician performance and evaluate the practical and psychometric consequences of 2 approaches to scoring (mean vs top box scores).Participants and methodsParticipants included physicians with a predominantly outpatient practice in general internal medicine (n=95), neurology (n=99), and psychiatry (n=39) at Mayo Clinic from January 1, 2013, through December 31, 2014. Study measures included hire year, patient complaint and compliment rates, note-signing timeliness, cost per episode of care, and Likert-scaled surveys from patients, learners, and colleagues (scored using mean ratings and top box percentages).ResultsPhysicians had a mean ± SD of 0.32±1.78 complaints and 0.12±0.76 compliments per 100 outpatient visits. Most notes were signed on time (mean ± SD, 96%±6.6%). Mean ± SD cost was 0.56±0.59 SDs above the institutional average. Mean ± SD scores were 3.77±0.25 on 4-point and 4.06±0.31 to 4.94±0.08 on 5-point Likert-scaled surveys. Mean ± SD top box scores ranged from 18.6%±16.8% to 90.7%±10.5%. Learner survey scores were positively associated with patient survey scores (r=0.26; P=.003) and negatively associated with years in practice (r=-0.20; P=.02).ConclusionThis study provides validity evidence for 7 assessments commonly used by medical centers to measure physician performance and reports that top box scores amplify differences among high-performing physicians. These findings inform the most appropriate uses of physician performance data and provide practical guidance to organizations seeking to implement similar assessment programs or use existing performance data in more meaningful ways.
| S-EPMC6135024 | biostudies-literature
Project description:IntroductionA wide variety of instruments are used when assessing the methodological quality (MQ) of intervention programs. Nevertheless, studies on their metric quality are often not available. In order to address this shortcoming, the methodological quality scale (MQS) is presented as a simple and useful tool with adequate reliability, validity evidence, and metric properties.MethodsTwo coders independently applied the MQS to a set of primary studies. The number of MQ facets was determined in parallel analyses before performing factor analyses. For each facet of validity obtained, mean and standard deviation are presented jointly with reliability and average discrimination. Additionally, the validity facet scores are interpreted based on Shadish, Cook, and Campbell's validity model.Results and discussionAn empirical validation of the three facets of the MQ (external, internal, and construct validity) and the interpretation of the scores were obtained based on a theoretical framework. Unlike other existing scales, MQS is easy to apply and presents adequate metric properties. In addition, MQ profiles can be obtained in different areas of intervention using different methodologies and proves useful for both researchers doing meta-analysis and for evaluators and professionals designing a new intervention.
| S-EPMC10358327 | biostudies-literature
Project description:BackgroundThere is a general expectation within healthcare that organizations should use evidence-based practice (EBP) as an approach to improving the quality of care. However, challenges exist regarding how to make EBP a reality, particularly at an organizational level and as a routine, sustained aspect of professional practice.MethodsA mixed method explanatory case study was conducted to study context; i.e., in terms of the presence or absence of multiple, inter-related contextual elements and associated strategic approaches required for integrated, routine use of EBP ('institutionalization'). The Pettigrew et al. Content, Context, and Process model was used as the theoretical framework. Two sites in the US were purposively sampled to provide contrasting cases: i.e., a 'role model' site, widely recognized as demonstrating capacity to successfully implement and sustain EBP to a greater degree than others; and a 'beginner' site, self-perceived as early in the journey towards institutionalization.ResultsThe two sites were clearly different in terms of their organizational context, level of EBP activity, and degree of institutionalization. For example, the role model site had a pervasive, integrated presence of EBP versus a sporadic, isolated presence in the beginner site. Within the inner context of the role model site, there was also a combination of the Pettigrew and colleagues' receptive elements that, together, appeared to enhance its ability to effectively implement EBP-related change at multiple levels. In contrast, the beginner site, which had been involved for a few years in EBP-related efforts, had primarily non-receptive conditions in several contextual elements and a fairly low overall level of EBP receptivity. The beginner site thus appeared, at the time of data collection, to lack an integrated context to either support or facilitate the institutionalization of EBP.ConclusionOur findings provide evidence of some of the key contextual elements that may require attention if institutionalization of EBP is to be realized. They also suggest the need for an integrated set of receptive contextual elements to achieve EBP institutionalization; and they further support the importance of specific interactions among these elements, including ways in which leadership affects other contextual elements positively or negatively.
| S-EPMC2795741 | biostudies-literature
Project description:We studied the Osteoporosis and You knowledge scale in 7749 participants enrolled in a clinical trial. Results confirmed its psychometric properties in a diverse audience. Baseline scores were associated with better recall of bone mineral density test results at follow-up; however, the scale was not responsive to knowledge change.IntroductionThe goal of this study was to confirm the measurement properties of the Osteoporosis and You (O&Y) knowledge scale using classic test theory methods in the 7749 men and women participating in the Patient Activation After DXA Result Notification (PAADRN) randomized controlled trial. We hypothesized a simple factor structure that would reflect the four-factor model previously published.MethodsWe conducted psychometric analyses which included item analysis, internal consistency reliability, construct validity using exploratory and confirmatory factor analysis (EFA and CFA), comparing knowledge levels across pre-specified groups, and responsiveness to change.ResultsPAADRN participants were predominantly college educated, White females with low bone density, and a moderate level of 10-year fracture risk. EFA revealed four domains closely matching those in two previous reports. While overall scale reliability was minimally acceptable at 0.68, the reliabilities of the domain subscales were unacceptably low (0.59, 0.64, 0.45, and 0.36 for the Biological, Lifestyle, Consequences, and Prevention and Treatment subscales). CFA revealed the data fit the hypothesized model reasonably well with the items loading on their expected latent variable. The scale was not responsive to change, but although not significant, improved knowledge indicated better DXA result recall at 12 and 52 weeks.ConclusionsIn the PAADRN population, the O&Y knowledge scale had psychometric properties similar to those previously reported. Over 12 and 52 weeks, participants did not demonstrate significant changes in knowledge, but those with higher knowledge at baseline were more likely to accurately recall their baseline DXA result.
| S-EPMC5685910 | biostudies-literature
Project description:Despite the increasing complexity of medication therapies and the expansion of pharmaceutical clinical services to optimize patient care working in collaboration with physicians. In this sense, interdisciplinary education has been encouraged. However, no instrument is available to measure attitudes toward collaborative relationships.To translate, cross-cultural adaptation and validation an instrument to measure collaboration attitudes toward students of medicine/pharmacy and physicians/pharmacists.The process of cross-cultural adaptation was carried out using international recommendations and was performed from January 2014 to April 2015. The instrument under consideration was translated and re-translated. A panel of experts compared the generated documents and the translation was evaluated for 20 undergraduate students of Pharmacy, 20 undergraduate students of Medicine and professionals (20 pharmacists and 20 physicians).The process of cross-cultural translation and validation result in the Portuguese version. Modifications to the grammatical structures were made in order to establish a cross-cultural similarity between the English and Portuguese versions. Regarding the evaluation of the expert panel, six questions required modifications.Psychometric evaluation demonstrated and confirmed the validity of the Brazilian-Portuguese version to assess collaborative attitudes among pharmacists and physicians. Moreover, the scale can be used to evaluate undergraduates and postgraduates and foster the development of teaching methods that promote comprehensive attitudes in patient care.
| S-EPMC5499343 | biostudies-other
Project description:Core competencies for public health in Canada require proficiency in evidence informed decision making (EIDM). However, decision makers often lack access to information, many workers lack knowledge and skills to conduct systematic literature reviews, and public health settings typically lack infrastructure to support EIDM activities. This research was conducted to explore and describe critical factors and dynamics in the early implementation of one public health unit's strategic initiative to develop capacity to make EIDM standard practice.This qualitative case study was conducted in one public health unit in Ontario, Canada between 2008 and 2010. In-depth information was gathered from two sets of semi-structured interviews and focus groups (n = 27) with 70 members of the health unit, and through a review of 137 documents. Thematic analysis was used to code the key informant and document data.The critical factors and dynamics for building EIDM capacity at an organizational level included: clear vision and strong leadership, workforce and skills development, ability to access research (library services), fiscal investments, acquisition and development of technological resources, a knowledge management strategy, effective communication, a receptive organizational culture, and a focus on change management.With leadership, planning, commitment and substantial investments, a public health department has made significant progress, within the first two years of a 10-year initiative, towards achieving its goal of becoming an evidence informed decision making organization.
| S-EPMC3305606 | biostudies-literature