Dataset Information

Development and Evaluation of a Recovery College Fidelity Measure.

ABSTRACT:

Objective

Recovery Colleges are widespread, with little empirical research on their key components. This study aimed to characterize key components of Recovery Colleges and to develop and evaluate a developmental checklist and a quantitative fidelity measure.

Methods

Key components were identified through a systematized literature review, international expert consultation (n = 77), and semistructured interviews with Recovery College managers across England (n = 10). A checklist was developed and refined through semistructured interviews with Recovery College students, trainers, and managers (n = 44) in 3 sites. A fidelity measure was adapted from the checklist and evaluated with Recovery College managers (n = 39, 52%), clinicians providing psychoeducational courses (n = 11), and adult education lecturers (n = 10).

Results

Twelve components were identified, comprising 7 nonmodifiable components (Valuing Equality, Learning, Tailored to the Student, Coproduction of the Recovery College, Social Connectedness, Community Focus, and Commitment to Recovery) and 5 modifiable components (Available to All, Location, Distinctiveness of Course Content, Strengths Based, and Progressive). The checklist has service user student, peer trainer, and manager versions. The fidelity measure meets scaling assumptions and demonstrates adequate internal consistency (0.72), test-retest reliability (0.60), content validity, and discriminant validity.

Conclusions

Coproduction and an orientation to adult learning should be the highest priority in developing Recovery Colleges. The creation of the first theory-based empirically evaluated developmental checklist and fidelity measure (both downloadable at researchintorecovery.com/recollect ) for Recovery Colleges will help service users understand what Recovery Colleges offer, will inform decision making by clinicians and commissioners about Recovery Colleges, and will enable formal evaluation of their impact on students.

SUBMITTER: Toney R

PROVIDER: S-EPMC6591755 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Evaluation of a Recovery College Fidelity Measure.

Toney Rebecca R Knight Jane J Hamill Kate K Taylor Anna A Henderson Claire C Crowther Adam A Meddings Sara S Barbic Skye S Jennings Helen H Pollock Kristian K Bates Peter P Repper Julie J Slade Mike M

Canadian journal of psychiatry. Revue canadienne de psychiatrie 20181230 6

<h4>Objective</h4>Recovery Colleges are widespread, with little empirical research on their key components. This study aimed to characterize key components of Recovery Colleges and to develop and evaluate a developmental checklist and a quantitative fidelity measure.<h4>Methods</h4>Key components were identified through a systematized literature review, international expert consultation (<i>n</i> = 77), and semistructured interviews with Recovery College managers across England (<i>n</i> = 10). ...[more]

PMID: 30595039

Similar Datasets

Project description:BackgroundAlong with the increasing prevalence of chronic illness has been an increase in interventions, such as nurse case management programs, to improve outcomes for patients with chronic illness. Evidence supports the effectiveness of such interventions in reducing patient morbidity, mortality, and resource utilization, but other studies have produced equivocal results. Often, little is known about how implementation of an intervention actually occurs in clinical practice. While studies often assume that interventions are used in clinical practice exactly as originally designed, this may not be the case. Thus, fidelity of an intervention's implementation reflects how an intervention is, or is not, used in clinical practice and is an important factor in understanding intervention effectiveness and in replicating the intervention in dissemination efforts. The purpose of this paper is to contribute to the understanding of implementation science by (a) proposing a methodology for measuring fidelity of implementation (FOI) and (b) testing the measure by examining the association between FOI and intervention effectiveness.MethodsWe define and measure FOI based on organizational members' level of commitment to using the distinct components that make up an intervention as they were designed. Semistructured interviews were conducted among 18 organizational members in four medical centers, and the interviews were analyzed qualitatively to assess three dimensions of commitment to use--satisfaction, consistency, and quality--and to develop an overall rating of FOI. Mixed methods were used to explore the association between FOI and intervention effectiveness (inpatient resource utilization and mortality).ResultsPredictive validity of the FOI measure was supported based on the statistical significance of FOI as a predictor of intervention effectiveness. The strongest relationship between FOI and intervention effectiveness was found when an alternative measure of FOI was utilized based on individual intervention components that had the greatest variation across medical centers.ConclusionsIn addition to contextual factors, implementation research needs to consider FOI as an important factor in influencing intervention effectiveness. Our proposed methodology offers a systematic means for understanding organizational members' use of distinct intervention components, assessing the reasons for variation in use across components and organizations, and evaluating the impact of FOI on intervention effectiveness.

Project description:BackgroundTo promote and ensure coaches' fidelity in delivering an online health coaching program to parents of children with suspected developmental delay, we developed and implemented a novel coaching fidelity rating tool, CO-FIDEL (COaches Fidelity in Intervention DELivery). We aimed to (1) Demonstrate CO-FIDEL's feasibility in evaluating coaches' fidelity and its change over time; and (2) Explore coaches' satisfaction with and usefulness of the tool.MethodsIn an observational study design, coaches (n = 4) were assessed using the CO-FIDEL following each coaching session (n = 13-14 sessions/parent-participant) during the pilot phase of a large randomized clinical trial involving eleven (n = 11) parent-participants. Outcome measures included subsections' fidelity measures, overall coaching fidelity, and coaching fidelity changes over time analyzed using descriptive and non-parametric statistics. In addition, using a four-point Likert Scale and open-ended questions, coaches were surveyed on their satisfaction and preference levels, as well as facilitators, barriers, and impacts related to the use of CO-FIDEL. These were analyzed using descriptive statistics and content analysis.ResultsOne hundred and thirty-nine (n = 139) coaching sessions were evaluated with the CO-FIDEL. On average, overall fidelity was high (88.0 ± 6.3 to 99.5 ± 0.8%). Four coaching sessions were needed to achieve and maintain a ≥ 85.0% fidelity in all four sections of the tool. Two coaches showed significant improvements in their coaching skills over time in some of the CO-FIDEL sections (Coach B/Section 1/between parent-participant B1 and B3: 89.9 ± 4.6 vs. 98.5 ± 2.6, Z = -2.74, p = 0.00596; Coach C/Section 4/between parent-participant C1 and C2: 82.4 ± 7.5 vs. 89.1 ± 4.1, Z = -2.66; p = 0.00758), and in overall fidelity (Coach C, between parent-participant C1 and C2: 88.67 ± 6.32 vs. 94.53 ± 1.23, Z = -2.66; p = 0. 00758). Coaches mainly reported moderate-high satisfaction with and usefulness of the tool, and pointed out areas of improvement (e.g., ceiling effect, missing elements).ConclusionsA new tool ascertaining coaches' fidelity was developed, applied, and shown to be feasible. Future research should address the identified challenges and examine the psychometric properties of the CO-FIDEL.

Project description:PurposeThis manuscript describes the development and the preliminary evaluation of a fidelity instrument for the Program for Encouraging Active and Rewarding Lives (PEARLS), an evidence-based depression care management (DCM) program. The objective of the study was to find an effective, practical, multidimensional approach to measure fidelity of PEARLS programs to the original, research-driven PEARLS protocol in order to inform program implementation at various settings nationwide.MethodsWe conducted key informant interviews with PEARLS stakeholders, and held focus groups with former PEARLS clients, to identify core program components. These components were then ranked using a Q-sort process, and incorporated into a brief instrument. We tested the instrument at two time points with PEARLS counselors, other DCM program counselors, and non-DCM program counselors (n?=?56) in six states. Known-groups method was used to compare findings from PEARLS programs, other DCM programs, and non-DCM programs. We asked supervisors of the counselors to complete the fidelity instrument on behalf of their counselors to affirm the validity of the results. We examined the association of PEARLS program fidelity with individual client outcomes.ResultsProgram for Encouraging Active and Rewarding Lives providers reported the highest fidelity scores compared to DCM program providers and non-DCM program providers. The sample size was too small to yield significant results on the comparison between counselor experience and fidelity. Scores varied between PEARLS counselors and their supervisors. PEARLS program fidelity was not significantly correlated with client outcomes, suggesting that other implementation factors may have influenced the outcomes and/or that the instrument needs refinement.ConclusionOur findings suggest that providers may be able to use the instrument to assess PEARLS program fidelity in various settings across the country. However, more rigorous research is needed to evaluate instrument effectiveness.

Dataset Information

Development and Evaluation of a Recovery College Fidelity Measure.

Objective

Methods

Results

Conclusions

Publications

Development and Evaluation of a Recovery College Fidelity Measure.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets