Provider Attitudes, Organizational Readiness for Change, and Uptake of Research Supported Treatment.
Ontology highlight
ABSTRACT:
SUBMITTER: Bornheimer LA
PROVIDER: S-EPMC7450898 | biostudies-literature | 2019 Jul
REPOSITORIES: biostudies-literature
Publications
Provider Attitudes, Organizational Readiness for Change, and Uptake of Research Supported Treatment.
Bornheimer Lindsay A LA Acri Mary M Parchment Tyrone T McKay Mary M MM
Research on social work practice 20180418 5
<h4>Purpose</h4>As implementation and evaluation of research supported treatment (RST) expands across diverse mental health settings, it is essential to understand the facilitators and inhibitors of uptake. The current study examined the relationships between organizational readiness for change, attitudes toward RST, and use of RST among a sample primarily of social workers.<h4>Methods</h4>Participants included 158 providers from public child mental health outpatient clinics in the New York metr ...[more]
Similar Datasets
Project description:BackgroundImplementation researchers recognize the influential role of organizational factors and, thus, seek to assess these factors using quantitative measurement instruments. However, researchers are hindered by instruments that measure similar constructs but rely on different nomenclature and/or definitions. The Consolidated Framework for Implementation Research (CFIR) provides a taxonomy of constructs derived from prior frameworks and empirical studies of implementation-related constructs. The CFIR includes constructs based on the original Promoting Action on Research Implementation in Health Services (PARiHS) framework which highlights the key roles of strength of evidence for a specific evidence-based intervention (EBI), favorability of organizational context for change, and capacities to facilitate implementation of the EBI. Although the CFIR is among the most frequently used implementation frameworks, it does not include quantitative measures. The Organizational Resource and Context Assessment (ORCA) is a quantitative measurement instrument that was developed based on PARiHS, assessing its three domains. Factors within these three domains are conceptually similar to constructs in the CFIR but do not match directly. The aim of this work was to map ORCA survey items to CFIR constructs to enable direct comparisons and syntheses of findings across studies using the CFIR and/or ORCA.MethodsTwo distinct, independent research teams, each used rigorous constant comparative techniques with deliberation and consensus to map individual items from the ORCA to the five domains and 39 constructs of CFIR.ResultsORCA items were mapped primarily to three of five CFIR domains: Inner Setting, Process, and Intervention Characteristics. The two research teams agreed on 88% of mappings at the higher domain level; at the lower construct level, their mappings aligned for 62.2% of the ORCA items.ConclusionsMapping results reveal that the ORCA focuses measurement prominently on Inner Setting, Process, and Intervention Characteristics. This mapping guide can help improve consistency in measurement and reporting, enabling more efficient comparison and synthesis of findings that use either the ORCA instrument or the CFIR framework. The guide helps advance implementation science utilizing mixed methods by providing CFIR users with quantitative measures for selected constructs and enables ORCA users to map their findings to CFIR constructs.
| S-EPMC7881456 | biostudies-literature
Project description:UnlabelledBackgroundThere is widespread interest in measuring organizational readiness to implement evidence-based practices in clinical care. However, there are a number of challenges to validating organizational measures, including inferential bias arising from the halo effect and method bias - two threats to validity that, while well-documented by organizational scholars, are often ignored in health services research. We describe a protocol to comprehensively assess the psychometric properties of a previously developed survey, the Organizational Readiness to Change Assessment.ObjectivesOur objective is to conduct a comprehensive assessment of the psychometric properties of the Organizational Readiness to Change Assessment incorporating methods specifically to address threats from halo effect and method bias.Methods and designWe will conduct three sets of analyses using longitudinal, secondary data from four partner projects, each testing interventions to improve the implementation of an evidence-based clinical practice. Partner projects field the Organizational Readiness to Change Assessment at baseline (n = 208 respondents; 53 facilities), and prospectively assesses the degree to which the evidence-based practice is implemented. We will conduct predictive and concurrent validities using hierarchical linear modeling and multivariate regression, respectively. For predictive validity, the outcome is the change from baseline to follow-up in the use of the evidence-based practice. We will use intra-class correlations derived from hierarchical linear models to assess inter-rater reliability. Two partner projects will also field measures of job satisfaction for convergent and discriminant validity analyses, and will field Organizational Readiness to Change Assessment measures at follow-up for concurrent validity (n = 158 respondents; 33 facilities). Convergent and discriminant validities will test associations between organizational readiness and different aspects of job satisfaction: satisfaction with leadership, which should be highly correlated with readiness, versus satisfaction with salary, which should be less correlated with readiness. Content validity will be assessed using an expert panel and modified Delphi technique.DiscussionWe propose a comprehensive protocol for validating a survey instrument for assessing organizational readiness to change that specifically addresses key threats of bias related to halo effect, method bias and questions of construct validity that often go unexplored in research using measures of organizational constructs.
| S-EPMC3157428 | biostudies-literature
Project description:Organizational readiness for change in healthcare settings is an important factor in successful implementation of new policies, programs, and practices. However, research on the topic is hindered by the absence of a brief, reliable, and valid measure. Until such a measure is developed, we cannot advance scientific knowledge about readiness or provide evidence-based guidance to organizational leaders about how to increase readiness. This article presents results of a psychometric assessment of a new measure called Organizational Readiness for Implementing Change (ORIC), which we developed based on Weiner's theory of organizational readiness for change.We conducted four studies to assess the psychometric properties of ORIC. In study one, we assessed the content adequacy of the new measure using quantitative methods. In study two, we examined the measure's factor structure and reliability in a laboratory simulation. In study three, we assessed the reliability and validity of an organization-level measure of readiness based on aggregated individual-level data from study two. In study four, we conducted a small field study utilizing the same analytic methods as in study three.Content adequacy assessment indicated that the items developed to measure change commitment and change efficacy reflected the theoretical content of these two facets of organizational readiness and distinguished the facets from hypothesized determinants of readiness. Exploratory and confirmatory factor analysis in the lab and field studies revealed two correlated factors, as expected, with good model fit and high item loadings. Reliability analysis in the lab and field studies showed high inter-item consistency for the resulting individual-level scales for change commitment and change efficacy. Inter-rater reliability and inter-rater agreement statistics supported the aggregation of individual level readiness perceptions to the organizational level of analysis.This article provides evidence in support of the ORIC measure. We believe this measure will enable testing of theories about determinants and consequences of organizational readiness and, ultimately, assist healthcare leaders to reduce the number of health organization change efforts that do not achieve desired benefits. Although ORIC shows promise, further assessment is needed to test for convergent, discriminant, and predictive validity.
| S-EPMC3904699 | biostudies-literature
Project description:BackgroundOrganizational readiness is a factor known to influence the predisposition of individuals within an organization to change. Based on Weiner's organizational theory, the "Organizational Readiness for Implementing Change" (ORIC) questionnaire was developed and validated to measure organizational readiness in healthcare contexts. However, no such tools allow French-speaking organizations to measure this concept. The objectives of this study were to (1) conduct a French cultural adaptation of the ORIC questionnaire, and (2) initiate the study of its psychometric properties.Methods(1) Cross-cultural adaptation and translation processes were first conducted with the methodologies of Beaton, Vallerand and Massoubre. (2) Subsequently, internal consistency was documented by calculating Cronbach's alpha and inter-item and item-to-scale correlations. The study of construct validity was initiated with a confirmatory factor analysis.ResultsA French 10-item scale named the Réceptivité organisationnelle à l'implantation d'un changement (ROIC) was developed and pretested by 125 occupational therapists working in Quebec homecare services. Cronbach's alpha values for the 2 item subscales show satisfactory internal consistency (Commitment: α = 0.84 and Efficacy: α = 0.86). Inter-item correlations revealed that the ROIC's items are moderately related to each other while item-to-total scale correlations pinpoint items that accounts for variance and influence internal consistency. Confirmatory factor analysis allowed the initiation of a substantial documentation of ROIC's model fit with the original version (CFI = 0.89, TLI = 0.85, SRMR = 0.08, and RMSEA = 0.12).ConclusionsThe ROIC is a new theory-based and translated questionnaire that can be used to rigorously document the organizational readiness of French organizations. The ROIC has the potential to support members of different organizations in the identification of subsequent efforts for the implementation of a change.
| S-EPMC6668068 | biostudies-literature
Project description:BackgroundThe Promoting Action on Research Implementation in Health Services, or PARIHS, framework is a theoretical framework widely promoted as a guide to implement evidence-based clinical practices. However, it has as yet no pool of validated measurement instruments that operationalize the constructs defined in the framework. The present article introduces an Organizational Readiness to Change Assessment instrument (ORCA), organized according to the core elements and sub-elements of the PARIHS framework, and reports on initial validation.MethodsWe conducted scale reliability and factor analyses on cross-sectional, secondary data from three quality improvement projects (n = 80) conducted in the Veterans Health Administration. In each project, identical 77-item ORCA instruments were administered to one or more staff from each facility involved in quality improvement projects. Items were organized into 19 subscales and three primary scales corresponding to the core elements of the PARIHS framework: (1) Strength and extent of evidence for the clinical practice changes represented by the QI program, assessed with four subscales, (2) Quality of the organizational context for the QI program, assessed with six subscales, and (3) Capacity for internal facilitation of the QI program, assessed with nine subscales.ResultsCronbach's alpha for scale reliability were 0.74, 0.85 and 0.95 for the evidence, context and facilitation scales, respectively. The evidence scale and its three constituent subscales failed to meet the conventional threshold of 0.80 for reliability, and three individual items were eliminated from evidence subscales following reliability testing. In exploratory factor analysis, three factors were retained. Seven of the nine facilitation subscales loaded onto the first factor; five of the six context subscales loaded onto the second factor; and the three evidence subscales loaded on the third factor. Two subscales failed to load significantly on any factor. One measured resources in general (from the context scale), and one clinical champion role (from the facilitation scale).ConclusionWe find general support for the reliability and factor structure of the ORCA. However, there was poor reliability among measures of evidence, and factor analysis results for measures of general resources and clinical champion role did not conform to the PARIHS framework. Additional validation is needed, including criterion validation.
| S-EPMC2716295 | biostudies-literature
Project description:BACKGROUND:Organizational readiness assessments have a history of being developed as important support tools for successful implementation. However, it remains unclear how best to operationalize readiness across varied projects or settings. We conducted a synthesis and content analysis of published readiness instruments to compare how investigators have operationalized the concept of organizational readiness for change. METHODS:We identified readiness assessments using a systematic review and update search. We mapped individual assessment items to the Consolidated Framework for Implementation Research (CFIR), which identifies five domains affecting implementation (outer setting, inner setting, intervention characteristics, characteristics of individuals, and implementation process) and multiple constructs within each domain. RESULTS:Of 1370 survey items, 897 (68%) mapped to the CFIR domain of inner setting, most commonly related to constructs of readiness for implementation (n?=?220); networks and communication (n?=?207); implementation climate (n?=?204); structural characteristics (n?=?139); and culture (n?=?93). Two hundred forty-two items (18%) mapped to characteristics of individuals (mainly other personal attributes [n?=?157] and self-efficacy [n?=?52]); 80 (6%) mapped to outer setting; 51 (4%) mapped to implementation process; 40 (3%) mapped to intervention characteristics; and 60 (4%) did not map to CFIR constructs. Instruments were typically tailored to specific interventions or contexts. DISCUSSION:Available readiness instruments predominantly focus on contextual factors within the organization and characteristics of individuals, but the specificity of most assessment items suggests a need to tailor items to the specific scenario in which an assessment is fielded. Readiness assessments must bridge the gap between measuring a theoretical construct and factors of importance to a particular implementation.
| S-EPMC7014613 | biostudies-literature
Project description:ObjectiveTo validate a brief survey developed to be used in hospitals nationwide to assess organizational readiness to change to increase cultural competency.Data sources/study settingAnalysis of primary data collected as part of a 125-item Organizational Assessment Survey conducted in the ten US hospitals participating in the Robert Wood Johnson Foundation Expecting Success program in 2005-2006.Study designThe study utilized a cross-sectional survey.Data collectionSurveys were distributed to participants in the ten hospitals based on job title and role within the organization (including clinicians, clinical administrators, other clinical professionals, and those in relevant nonclinical roles; respondents = 513; response rate = 31%). Missing data were deleted listwise. We computed internal consistency reliability via Cronbach's alpha and interrater agreement using the rwg(j) index, and conducted exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) to examine validity of the survey. We subsequently conducted ANOVAs to examine whether the instrument adequately distinguished between hospitals.Principal findingsAcross 408 complete responses, a scree plot generated by the EFA and a follow-up CFA indicated a 2-factor solution (RMSEA = 0.06; CFI = 0.96; GFI = 0.96; RMSR = 0.08). We identified these primary factors as two scales, a 12-item Readiness to Address Quality scale (α = 0.85; rwg(j) = 0.93) and an 11-item Readiness to Address Disparities scale (α = 0.65; rwg(j) = 0.89). ANOVAs suggested that these scales distinguished between hospitals (RTAQ: F[9, 428] = 3.70, P < .001; RTAD: F[9, 435] = 3.02, P = .002).ConclusionsThis survey can help identify an organization's readiness to change to increase cultural competency.
| S-EPMC7839647 | biostudies-literature
Project description:BACKGROUND:Organizational change initiatives in health care frequently achieve only partial implementation success. Understanding an organizational readiness for change (ORC) may be a way to develop more effective and efficient change strategies. Denmark, like many countries, has begun a major system-wide structural reform which involves considerable changes in service delivery. Due to the lack of a validated Danish instrument, we aimed to translate and validate a Danish version of the Organizational Readiness for Implementing Change (ORIC) questionnaire. It measures if organizational members are confident in their collective commitment towards and ability (efficacy) to implement organizational change. ORIC is concise, grounded in theory, and designed, but not yet validated among employees in a real hospital setting. METHODS:The 12-item ORIC instrument was translated into Danish and back-translated to English. Employees (N?=?284) at a hospital department facing a major organizational change in the Central Denmark Region completed the questionnaire. Face and content validity was ascertained. Exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA) were used to assess construct validity. Reliability was assessed with Cronbach's alpha. Item response theory (Rasch analysis) was used to determine item and person reliability. RESULTS:Response rate was 72%. A two factor (commitment and efficacy), 11-item scale, of the Danish language ORIC was shown to be valid (CFI?=?.95, RMSEA?=?.067, and CMNI/DF?=?2.32) and reliable (Cronbach's alpha 0.88) in a health care setting. Item response analysis confirmed acceptable person and item separation reliability. CONCLUSIONS:Our version of ORIC showed acceptable validity and reliability as an instrument for measuring readiness for implementing organizational change in a Danish-speaking health care population. For health care managers interested in evaluating their organizations and tailor change strategies, ORIC's brevity and theoretical underpinnings could make it an appealing and feasible tool to develop more successful change efforts.
| S-EPMC5989337 | biostudies-literature
Project description:Today's organizations are operating in a highly competitive and changing environment that pushes them to continuously adapt their organizational structures to such environment. However, the success of change initiatives may face a barrier in the response of employees, especially when they lack readiness to change. While leadership can shape the culture of an organization and a culture of effectiveness can help increase employees' readiness to change, ethical leaders, who serve as a guide and offer support, can also make a difference by reducing uncertainty. Yet existing research on the role of ethical leadership in the enhancement of the employees' readiness to change is practically non-existent. Far less is the research that analyses the mechanisms that ethical leadership can use to foster employees' readiness to change. This study aims to investigate whether the ethical leadership of middle-lower echelons influences on employees' readiness to change positively (H1) and if this relationship is mediated through shaping an organizational culture of effectiveness (H2). Using data from 270 direct reports of middle-lower managers in public foreign trade Egyptian companies, the findings reveal that ethical leadership enhances employees' readiness to change and that this impact is partially mediated by an organizational culture of effectiveness. Thus, with these findings, new light is shed on the positive role of ethical leadership and the mechanisms it uses to enhance employees' readiness to change.
| S-EPMC6874171 | biostudies-literature
Project description:Sierra Leone has one of the world's highest maternal and infant mortality rates and suffers from a shortage of well-trained health professionals, including midwives. Prior to engaging in systematic interventions, it is critical to measure organizational readiness to gauge members' psychological and behavioral preparedness to implement change. We aimed to measure the organizational readiness for implementing change and compare results among midwives and administrative leaders at two schools of midwifery in Sierra Leone prior to the rollout of a midwifery preceptor program. The Organizational Readiness for Implementing Change (ORIC) survey is a validated 12-item questionnaire designed to assess two domains of organizational readiness for change: change commitment (motivation) and change efficacy (capacity). All survey items begin with the same prompt and a five-item Likert scale response, with seven questions about change commitment and five about change efficacy. Data collection occurred in two schools of midwifery in Sierra Leone during two day-long meetings with stakeholders. Statistical analysis was conducted using descriptive statistics and Wilcoxon rank-sum test to compare independent samples: School 1 versus School 2 (site), midwife versus other roles (role). Participants included 42 respondents (mean age 41 years, 95% female). Surveys were distributed evenly between the two sites. Occupations included midwifery faculty (n = 8), administrators (n = 5), clinicians (n = 25), and clinical educators (n = 4). Domain 1 (change commitment) had a mean score of 4.72 (SD 0.47) while Domain 2 (change efficacy) had a mean score of 4.53 (SD 0.54) out of a total potential score of five. There were no statistically significant differences between site responses for Domain 1 (p = 0.5479) and Domain 2 (p = 0.1026) nor role responses for Domain 1 (p = 0.0627) and Domain 2 (p = 0.2520). Stakeholders had very high overall readiness for change across all ORIC questions for both change commitment and change efficacy. Mean scores for change commitment were slightly higher which is not surprising given the low-resourced settings stakeholders work in while training students. High mean scores across sites and roles is encouraging as this novel preceptor program is currently being rolled out.
| S-EPMC11337795 | biostudies-literature