Dataset Information

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

ABSTRACT:

Background

There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs.

Methods

Based on theoretical frameworks, including Rogers' Diffusion of Innovations, we developed a survey instrument to measure four domains representing stages of readiness for EBI: awareness, adoption, implementation, and maintenance. A separate scale representing organizational climate as a potential mediator of readiness for EBIs was also included in the survey. Twenty-three questions comprised the four domains, with four to nine items each, using a seven-point response scale. Representatives from obesity, asthma, diabetes, and tobacco prevention programs serving diverse populations in the United States were surveyed (N=243); test-retest reliability was assessed with 92 respondents.

Results

Confirmatory factor analysis (CFA) was used to test and refine readiness scales. Test-retest reliability of the readiness scales, as measured by intraclass correlation, ranged from 0.47-0.71. CFA found good fit for the five-item adoption and implementation scales and resulted in revisions of the awareness and maintenance scales. The awareness scale was split into two two-item scales, representing community and agency awareness. The maintenance scale was split into five- and four-item scales, representing infrastructural maintenance and evaluation maintenance, respectively. Internal reliability of scales (Cronbach's ?) ranged from 0.66-0.78. The model for the final revised scales approached good fit, with most factor loadings >0.6 and all >0.4.

Conclusions

The lack of adequate measurement tools hinders progress in dissemination and implementation research. These preliminary results help fill this gap by describing the reliability and measurement properties of a theory-based tool; the short, user-friendly instrument may be useful to researchers and practitioners seeking to assess organizational readiness for EBIs across a variety of chronic disease prevention programs and settings.

SUBMITTER: Stamatakis KA

PROVIDER: S-EPMC3418158 | biostudies-literature | 2012 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

Stamatakis Katherine A KA McQueen Amy A Filler Carl C Boland Elizabeth E Dreisinger Mariah M Brownson Ross C RC Luke Douglas A DA

Implementation science : IS 20120716

<h4>Background</h4>There is a great deal of variation in the existing capacity of primary prevention programs and policies addressing chronic disease to deliver evidence-based interventions (EBIs). In order to develop and evaluate implementation strategies that are tailored to the appropriate level of capacity, there is a need for an easy-to-administer tool to stage organizational readiness for EBIs.<h4>Methods</h4>Based on theoretical frameworks, including Rogers' Diffusion of Innovations, we d ...[more]

PMID: 22800294

Similar Datasets

Project description:BackgroundOrganizational readiness for change is a key factor in success or failure of electronic health record (EHR) system implementations. Readiness is a multifaceted and multilevel abstract construct encompassing individual and organizational aspects, which makes it difficult to assess. Available tools for assessing readiness need to be tested in different contexts.ObjectiveTo identify and assess relevant variables that determine readiness to implement an EHR in oncology in a low-and-middle income setting.MethodsAt the Uganda Cancer Institute (UCI), a 100-bed tertiary oncology center in Uganda,we conducted a cross-sectional survey using the Paré model. This model has 39 indicator variables (Likert-scale items) for measuring 9 latent variables that contribute to readiness. We analyzed data using partial least squares structural equation modeling (PLS-SEM). In addition, we collected comments that we analyzed by qualitative content analysis and sentiment analysis as a way of triangulating the Likert-scale survey responses.ResultsOne hundred and forty-six clinical and non-clinical staff completed the survey, and 116 responses were included in the model. The measurement model showed good indicator reliability, discriminant validity, and internal consistency. Path coefficients for 6 of the 9 latent variables (i.e. vision clarity, change appropriateness, change efficacy, presence of an effective champion, organizational flexibility, and collective self-efficacy) were statistically significant at p < 0.05. The R2 for the outcome variable (organizational readiness) was 0.67. The sentiments were generally positive and correlated well with the survey scores (Pearson's r = 0.73). Perceived benefits of an EHR included improved quality, security and accessibility of clinical data, improved care coordination, reduction of errors, and time and cost saving. Recommended considerations for successful implementation include sensitization, training, resolution of organizational conflicts and computer infrastructure.ConclusionChange management during EHR implementation in oncology in low- and middle- income setting should focus on attributes of the change and the change targets, including vision clarity, change appropriateness, change efficacy, presence of an effective champion, organizational flexibility, and collective self-efficacy. Particularly, issues of training, computer skills of staff, computer infrastructure, sensitization and strategic implementation need consideration.

Project description:BackgroundThe translation of research into practices has been incomplete. Organizational readiness for change (ORC) is a potential facilitator of effective knowledge translation (KT). However we know little about the best way to assess ORC. Therefore, we sought to systematically review ORC measurement instruments.MethodsWe searched for published studies in bibliographic databases (Pubmed, Embase, CINAHL, PsychINFO, Web of Science, etc.) up to November 1st, 2012. We included publications that developed ORC measures and/or empirically assessed ORC using an instrument at the organizational level in the health care context. We excluded articles if they did not refer specifically to ORC, did not concern the health care domain or were limited to individual-level change readiness. We focused on identifying the psychometric properties of instruments that were developed to assess readiness in an organization prior to implementing KT interventions in health care. We used the Standards for Educational and Psychological Testing to assess the psychometric properties of identified ORC measurement instruments.FindingsWe found 26 eligible instruments described in 39 publications. According to the Standards for Educational and Psychological Testing, 18 (69%) of a total of 26 measurement instruments presented both validity and reliability criteria. The Texas Christian University -ORC (TCU-ORC) scale reported the highest instrument validity with a score of 4 out of 4. Only one instrument, namely the Modified Texas Christian University - Director version (TCU-ORC-D), reported a reliability score of 2 out of 3. No information was provided regarding the reliability and validity of five (19%) instruments.ConclusionOur findings indicate that there are few valid and reliable ORC measurement instruments that could be applied to KT in the health care sector. The TCU-ORC instrument presents the best evidence in terms of validity testing. Future studies using this instrument could provide more knowledge on its relevance to diverse clinical contexts.

Project description:IntroductionPreventing falls is a priority for aged care providers. Research to date has focused on fall prevention strategies in single settings (e.g., residential aged care (RAC) or community settings). However, some aged care providers deliver care, including fall prevention interventions, across RAC and community settings. We conducted an umbrella review to identify what type of fall prevention interventions had the greatest impact on falls outcomes in RAC and community settings.MethodsFive databases were searched for systematic reviews of falls prevention randomised control trials in older adults living in the community or RAC. Data extracted included systematic review methods, population characteristics, intervention characteristics, setting details (RAC or community), and fall-related outcomes (falls, people who have had a fall, fall-related hospitalisations, and fall-related fractures). Review quality was appraised using the Assessment of Multiple Systematic Reviews-2 tool.ResultsOne-hundred and six systematic reviews were included; 63 and 19 of these stratified results by community and RAC settings respectively, the remainder looked at both settings. The most common intervention types discussed in reviews included 'exercise' (61%, n = 65), 'multifactorial' (two or more intervention types delivered together) (26%, n = 28), and 'vitamin D' (18%, n = 19). In RAC and community settings, 'exercise' interventions demonstrated the most consistent reduction in falls and people who have had a fall compared to other intervention types. 'Multifactorial' interventions were also beneficial in both settings however demonstrated more consistent reduction in falls and people who fall in RAC settings compared to community settings. 'Vitamin D' interventions may be beneficial in community-dwelling populations but not in RAC settings. It was not possible to stratify fall-related hospitalisation and fall-related fracture outcomes by setting due to limited number of RAC-specific reviews (n = 3 and 0 respectively).Conclusion'Exercise' interventions may be the most appropriate falls prevention intervention for older adults in RAC and community settings as it is beneficial for multiple fall-related outcomes (falls, fall-related fractures, and people who have had a fall). Augmenting 'exercise' interventions to become 'multifactorial' interventions may also improve the incidence of falls in both settings.

Project description:BackgroundEvidence-based quality improvement models for depression have not been fully implemented in routine primary care settings. To date, few studies have examined the organizational factors associated with depression management in real-world primary care practice. To successfully implement quality improvement models for depression, there must be a better understanding of the relevant organizational structure and processes of the primary care setting. The objective of this study is to describe these organizational features of routine primary care practice, and the organization of depression care, using survey questions derived from an evidence-based framework.MethodsWe used this framework to implement a survey of 27 practices comprised of 49 unique offices within a large primary care practice network in western Pennsylvania. Survey questions addressed practice structure (e.g., human resources, leadership, information technology (IT) infrastructure, and external incentives) and process features (e.g., staff performance, degree of integrated depression care, and IT performance).ResultsThe results of our survey demonstrated substantial variation across the practice network of organizational factors pertinent to implementation of evidence-based depression management. Notably, quality improvement capability and IT infrastructure were widespread, but specific application to depression care differed between practices, as did coordination and communication tasks surrounding depression treatment.ConclusionsThe primary care practices in the network that we surveyed are at differing stages in their organization and implementation of evidence-based depression management. Practical surveys such as this may serve to better direct implementation of these quality improvement strategies for depression by improving understanding of the organizational barriers and facilitators that exist within both practices and practice networks. In addition, survey information can inform efforts of individual primary care practices in customizing intervention strategies to improve depression management.

Dataset Information

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

Background

Methods

Results

Conclusions

Publications

Measurement properties of a novel survey to assess stages of organizational readiness for evidence-based interventions in community chronic disease prevention settings.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets