Dataset Information

Development and Evaluation of a Recovery College Fidelity Measure.

ABSTRACT:

Objective

Recovery Colleges are widespread, with little empirical research on their key components. This study aimed to characterize key components of Recovery Colleges and to develop and evaluate a developmental checklist and a quantitative fidelity measure.

Methods

Key components were identified through a systematized literature review, international expert consultation (n = 77), and semistructured interviews with Recovery College managers across England (n = 10). A checklist was developed and refined through semistructured interviews with Recovery College students, trainers, and managers (n = 44) in 3 sites. A fidelity measure was adapted from the checklist and evaluated with Recovery College managers (n = 39, 52%), clinicians providing psychoeducational courses (n = 11), and adult education lecturers (n = 10).

Results

Twelve components were identified, comprising 7 nonmodifiable components (Valuing Equality, Learning, Tailored to the Student, Coproduction of the Recovery College, Social Connectedness, Community Focus, and Commitment to Recovery) and 5 modifiable components (Available to All, Location, Distinctiveness of Course Content, Strengths Based, and Progressive). The checklist has service user student, peer trainer, and manager versions. The fidelity measure meets scaling assumptions and demonstrates adequate internal consistency (0.72), test-retest reliability (0.60), content validity, and discriminant validity.

Conclusions

Coproduction and an orientation to adult learning should be the highest priority in developing Recovery Colleges. The creation of the first theory-based empirically evaluated developmental checklist and fidelity measure (both downloadable at researchintorecovery.com/recollect ) for Recovery Colleges will help service users understand what Recovery Colleges offer, will inform decision making by clinicians and commissioners about Recovery Colleges, and will enable formal evaluation of their impact on students.

SUBMITTER: Toney R

PROVIDER: S-EPMC6591755 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development and Evaluation of a Recovery College Fidelity Measure.

Toney Rebecca R Knight Jane J Hamill Kate K Taylor Anna A Henderson Claire C Crowther Adam A Meddings Sara S Barbic Skye S Jennings Helen H Pollock Kristian K Bates Peter P Repper Julie J Slade Mike M

Canadian journal of psychiatry. Revue canadienne de psychiatrie 20181230 6

<h4>Objective</h4>Recovery Colleges are widespread, with little empirical research on their key components. This study aimed to characterize key components of Recovery Colleges and to develop and evaluate a developmental checklist and a quantitative fidelity measure.<h4>Methods</h4>Key components were identified through a systematized literature review, international expert consultation (<i>n</i> = 77), and semistructured interviews with Recovery College managers across England (<i>n</i> = 10). ...[more]

PMID: 30595039

Similar Datasets

Project description:BackgroundAlong with the increasing prevalence of chronic illness has been an increase in interventions, such as nurse case management programs, to improve outcomes for patients with chronic illness. Evidence supports the effectiveness of such interventions in reducing patient morbidity, mortality, and resource utilization, but other studies have produced equivocal results. Often, little is known about how implementation of an intervention actually occurs in clinical practice. While studies often assume that interventions are used in clinical practice exactly as originally designed, this may not be the case. Thus, fidelity of an intervention's implementation reflects how an intervention is, or is not, used in clinical practice and is an important factor in understanding intervention effectiveness and in replicating the intervention in dissemination efforts. The purpose of this paper is to contribute to the understanding of implementation science by (a) proposing a methodology for measuring fidelity of implementation (FOI) and (b) testing the measure by examining the association between FOI and intervention effectiveness.MethodsWe define and measure FOI based on organizational members' level of commitment to using the distinct components that make up an intervention as they were designed. Semistructured interviews were conducted among 18 organizational members in four medical centers, and the interviews were analyzed qualitatively to assess three dimensions of commitment to use--satisfaction, consistency, and quality--and to develop an overall rating of FOI. Mixed methods were used to explore the association between FOI and intervention effectiveness (inpatient resource utilization and mortality).ResultsPredictive validity of the FOI measure was supported based on the statistical significance of FOI as a predictor of intervention effectiveness. The strongest relationship between FOI and intervention effectiveness was found when an alternative measure of FOI was utilized based on individual intervention components that had the greatest variation across medical centers.ConclusionsIn addition to contextual factors, implementation research needs to consider FOI as an important factor in influencing intervention effectiveness. Our proposed methodology offers a systematic means for understanding organizational members' use of distinct intervention components, assessing the reasons for variation in use across components and organizations, and evaluating the impact of FOI on intervention effectiveness.

Project description:PurposeThis manuscript describes the development and the preliminary evaluation of a fidelity instrument for the Program for Encouraging Active and Rewarding Lives (PEARLS), an evidence-based depression care management (DCM) program. The objective of the study was to find an effective, practical, multidimensional approach to measure fidelity of PEARLS programs to the original, research-driven PEARLS protocol in order to inform program implementation at various settings nationwide.MethodsWe conducted key informant interviews with PEARLS stakeholders, and held focus groups with former PEARLS clients, to identify core program components. These components were then ranked using a Q-sort process, and incorporated into a brief instrument. We tested the instrument at two time points with PEARLS counselors, other DCM program counselors, and non-DCM program counselors (n?=?56) in six states. Known-groups method was used to compare findings from PEARLS programs, other DCM programs, and non-DCM programs. We asked supervisors of the counselors to complete the fidelity instrument on behalf of their counselors to affirm the validity of the results. We examined the association of PEARLS program fidelity with individual client outcomes.ResultsProgram for Encouraging Active and Rewarding Lives providers reported the highest fidelity scores compared to DCM program providers and non-DCM program providers. The sample size was too small to yield significant results on the comparison between counselor experience and fidelity. Scores varied between PEARLS counselors and their supervisors. PEARLS program fidelity was not significantly correlated with client outcomes, suggesting that other implementation factors may have influenced the outcomes and/or that the instrument needs refinement.ConclusionOur findings suggest that providers may be able to use the instrument to assess PEARLS program fidelity in various settings across the country. However, more rigorous research is needed to evaluate instrument effectiveness.

Project description:BackgroundFidelity of implementation (FOI) reflects whether an intervention was implemented in clinical practice according to the originally developed manual and is a key aspect in understanding intervention effectiveness. To illustrate this process of developing a fidelity measure, this study uses the Mini-AFTERc, a brief psychological intervention aimed at managing breast cancer patients' fear of cancer recurrence, as an example.ObjectivesTo illustrate the development of an FOI measure through (1) applying this process to the Mini-AFTERc intervention, by including the design of a scoring system and rating criteria; (2) content validating the FOI measure using thematic framework analysis as a qualitative approach; (3) testing consistency of the FOI measure using interrater reliability.MethodsThe FOI measure was developed, its scoring system modified and the rating criteria defined. Thematic framework analysis was conducted to content validate the FOI measure using nine intervention discussions between four specialist cancer nurses and four breast cancer patients, and one simulated breast cancer patient. Intraclass-correlation was conducted to assess interrater reliability.ResultsThe qualitative findings suggested that the Mini-AFTERc FOI measure has content validity as it was able to measure all five components of the Mini-AFTERc intervention. The interrater reliability suggested a moderate to excellent degree of reliability among three raters, r ICC = 0.84, 95% CI [0.51, 0.96].ConclusionThe study has illustrated the steps that an FOI measure can be developed through a systematic approach applied to the Mini-AFTERc intervention. The FOI measure was found to have content validity and was consistently applied, independently, by three researchers familiar with the Mini-AFTERc intervention. Future studies should determine whether similar levels of interrater reliability can be obtained by distributing written and/or video instructions to researchers who are unfamiliar with the FOI measure, using a larger sample. Employing developed and validated FOI measures such as the one presented for the Mini-AFTERc would facilitate implementation of interventions in the FCR field in clinical practice as intended.Clinical trial registrationwww.ClinicalTrials.gov, identifier: NCT03763825.

Dataset Information

Development and Evaluation of a Recovery College Fidelity Measure.

Objective

Methods

Results

Conclusions

Publications

Development and Evaluation of a Recovery College Fidelity Measure.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure