Dataset Information

Measuring Fidelity to Evidence-Based Practices: Psychometrics.

ABSTRACT: This special section presents the psychometric properties of fidelity scales used in a national mental health services project in Norway to improve the quality of care of people with psychoses. Across Norway, 39 clinical units in six health trusts participated. The project provided education, implementation support and fidelity assessments. The papers in the section address the psychometrics of fidelity measurement for the specific evidence-based practices: illness management and recovery, family psychoeducation, physical healthcare and antipsychotic medication management. Another paper analyzes the psychometrics of a scale measuring individualization and quality improvement that may be used in conjunction with fidelity scales for specific evidence-based practices. The first paper in the section presents the development and field of fidelity scales, and the two final papers with comments add some additional perspectives and discuss fidelity scales in a wider context. The psychometrics of the five scales were good to excellent. Fidelity assessment is a necessary and effective strategy for quality improvement.

SUBMITTER: Ruud T

PROVIDER: S-EPMC7547989 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring Fidelity to Evidence-Based Practices: Psychometrics.

Ruud T T Drake R E RE Bond G R GR

Administration and policy in mental health 20201101 6

This special section presents the psychometric properties of fidelity scales used in a national mental health services project in Norway to improve the quality of care of people with psychoses. Across Norway, 39 clinical units in six health trusts participated. The project provided education, implementation support and fidelity assessments. The papers in the section address the psychometrics of fidelity measurement for the specific evidence-based practices: illness management and recovery, famil ...[more]

PMID: 32737716

Similar Datasets

Project description:BackgroundImplementation researchers have typically studied organizational culture and climate by testing whether individual dimensions are linked to the implementation of evidence-based practices (EBPs) rather than examining how the overarching social context influences implementation. This approach may limit implementation theory and strategy development to the extent that individual dimensions of culture and climate interact, mutually reinforce or counteract one another, or exhibit non-linear relationships. This study tests whether empirically identifiable culture and climate profiles emerge in a sample of organizations and examines how these profiles relate to EBP fidelity and work attitudes that support EBP sustainment, focusing on three EBPs for youth with autism delivered in schools as an example.MethodsThe study included 65 elementary schools in the U.S. that implemented three EBPs-discrete trial training, pivotal response training, and visual schedules-for youth with autism. Organizational culture and climate and work attitudes were assessed using the Organizational Social Context measure at the beginning of the school year. Observations of EBP fidelity occurred mid school-year. We used bias-adjusted stepwise latent profile modeling to (1) identify subpopulations of schools that share similar culture and climate profiles, and (2) test for mean differences across profiles in observed EBP fidelity and teacher and staff work attitudes.ResultsControlling for region, four profiles best characterized the organizational cultures and climates of schools. Teachers and staff in schools with a comprehensive profile (high proficiency culture, positive climate) exhibited higher fidelity to two of three EBPs (d's?=?.95 to 1.64) and reported superior work attitudes (d's?=?.71 to 1.93) than teachers and staff in all other schools. Teachers and staff in supportive schools (low rigidity culture, positive climate) had better work attitudes, but not better fidelity, than those in schools with indifferent (low culture/climate, elevated stress) and constrained (high rigidity and resistance, high stress) profiles.ConclusionsOrganizational culture and climate profiles are a strong predictor of EBP fidelity and work attitudes that support EBP sustainment, highlighting the importance of an organization's overarching social context when developing implementation theory and strategies. Strategies that foster a comprehensive profile may improve EBP implementation.

Project description:Aside from breastfeeding, there are little data on use of essential newborn care practices, such as thermal protection and hygienic cord care, in high mortality countries. These practices have not typically been measured in national household surveys, often the main source for coverage data in these settings. The Every Newborn Action Plan proposed early breastfeeding as a tracer for essential newborn care due to data availability and evidence for the benefits of breastfeeding. In the past decade, a few national surveys have added questions on other practices, presenting an opportunity to assess the performance of early breastfeeding initiation as a tracer indicator.We identified twelve national surveys between 2005-2014 that included at least one indicator for immediate newborn care in addition to breastfeeding. Because question wording and reference populations varied, we standardized data to the extent possible to estimate coverage of newborn care practices, accounting for strata and multistage survey design. We assessed early breastfeeding as a tracer by: 1) examining associations with other indicators using Pearson correlations; and 2) stratifying by early breastfeeding to determine differences in coverage of other practices for initiators vs non-initiators in each survey, then pooling across surveys for a meta-analysis, using the inverse standard error as the weight for each observation.Associations between pairs of coverage indicators are generally weak, including those with breastfeeding. The exception is drying and wrapping, which have the strongest association of any two interventions in all five surveys where measured; estimated correlations for this range from 0.47 in Bangladesh's 2007 DHS to 0.83 in Nepal's 2006 DHS. The contrast in coverage for other practices by early breastfeeding is generally small; the greatest absolute difference was 6.7%, between coverage of immediate drying for newborns breastfed early compared to those who were not.Early initiation of breastfeeding is not a high performing tracer indicator for essential newborn care practices measured in previous national surveys. To have informative data on whether newborns are getting life-saving services, standardized questions about specific practices, in addition to breastfeeding initiation, need to be added to surveys.

Project description:BackgroundUntil now, there is no clear overview of how fidelity is assessed in school-based obesity prevention programmes. In order to move the field of obesity prevention programmes forward, the current review aimed to 1) identify which fidelity components have been measured in school-based obesity prevention programmes; 2) identify how fidelity components have been measured; and 3) score the quality of these methods.MethodsStudies published between January 2001-October 2017 were selected from searches in PubMed, EMBASE, PsycINFO, CINAHL, Cochrane Library and ERIC. We included studies examining the fidelity of obesity prevention programmes (nutrition and/or physical activity and/or sitting) at school (children aged 4-18 year) measuring at least one component of implementation fidelity. A data extraction was performed to identify which and how fidelity components were measured. Thereafter, a quality assessment was performed to score the quality of these methods. We scored each fidelity component on 7 quality criteria. Each fidelity component was rated high (>?75% positive), moderate (50-75%) or low (<?50%).ResultsOf the 26,294 retrieved articles, 73 articles reporting on 63 different studies were included in this review. In 17 studies a process evaluation was based on a theoretical framework. In total, 120 fidelity components were measured across studies: dose was measured most often (N =?50), followed by responsiveness (N =?36), adherence (N =?26) and quality of delivery (N =?8). There was substantial variability in how fidelity components were defined as well as how they were measured. Most common methods were observations, logbooks and questionnaires targeting teachers. The quality assessment scores ranged from 0 to 86%; most fidelity components scored low quality (n =?77).ConclusionsThere is no consensus on the operationalisation of concepts and methods used for assessing fidelity in school-based obesity prevention programmes and the quality of methods used is weak. As a result, we call for more consensus on the concepts and clear reporting on the methods employed for measurements of fidelity to increase the quality of fidelity measurements. Moreover, researchers should focus on the relation between fidelity and programme outcomes and determine to what extent adaptations to programmes have been made, whilst still being effective.

Dataset Information

Measuring Fidelity to Evidence-Based Practices: Psychometrics.

Publications

Measuring Fidelity to Evidence-Based Practices: Psychometrics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets