Dataset Information

Measurement Training and Feedback System for Implementation of family-based services for adolescent substance use: protocol for a cluster randomized trial of two implementation strategies.

ABSTRACT: BACKGROUND:This article describes a study protocol for testing the Measurement Training and Feedback System for Implementation (MTFS-I) and comparing two implementation strategies for MTFS-I delivery. MTFS-I is a web-based treatment quality improvement system designed to increase the delivery of evidence-based interventions for behavioral health problems in routine care settings. This version of MTFS-I focuses on family-based services (FBS) for adolescent substance use. FBS, comprising both family participation in treatment and family therapy technique use, have achieved the strongest evidence base for adolescent substance use and are a prime candidate for upgrading treatment quality in outpatient care. For FBS to fulfill their potential for widespread dissemination, FBS implementation must be bolstered by effective quality procedures that support sustainable delivery in usual care. METHODS/DESIGN:Adapted from measurement feedback systems for client outcomes, MTFS-I contains three synergistic components: (a) weekly reporter training modules to instruct therapists in reliable post-session self-reporting on FBS utilization; (b) weekly mock session videos of FBS interventions (5-8?min) for supportive training in, and practice coding of, high-quality FBS; and (c) monthly feedback reports to therapists and supervisors displaying aggregated data on therapist-reported FBS use. MTFS-I is hosted online and requires approximately 20?min per week to complete. The study will experimentally compare two well-established implementation strategies designed to foster ongoing MTFS-I usage: Core Training, consisting of two 3-h training sessions focused on FBS site mapping, selecting FBS improvement goals, and sustaining MTFS-I, followed by routine remote technical assistance; and Core + Facilitation, which boosts Core Training sessions with collaborative phone-based clinical consultation and on-site facilitation meetings for 1?year to promote FBS goal achievement. The study design is a cluster randomized trial testing Core Training versus Core + Facilitation in ten substance use treatment clinics. Study aims will compare conditions on MTFS-I uptake, FBS delivery (based on therapist-report and observational data), and 1-year client outcomes. DISCUSSION:Study contributions to implementation science and considerations of MTFS-I sustainability are discussed. TRIAL REGISTRATION:ClinicalTrials.gov NCT03342872 . Registered 10 November 2017.

SUBMITTER: Hogue A

PROVIDER: S-EPMC6416843 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measurement Training and Feedback System for Implementation of family-based services for adolescent substance use: protocol for a cluster randomized trial of two implementation strategies.

Hogue Aaron A Dauber Sarah S Bobek Molly M Jensen-Doss Amanda A Henderson Craig E CE

Implementation science : IS 20190311 1

<h4>Background</h4>This article describes a study protocol for testing the Measurement Training and Feedback System for Implementation (MTFS-I) and comparing two implementation strategies for MTFS-I delivery. MTFS-I is a web-based treatment quality improvement system designed to increase the delivery of evidence-based interventions for behavioral health problems in routine care settings. This version of MTFS-I focuses on family-based services (FBS) for adolescent substance use. FBS, comprising b ...[more]

PMID: 30866967

Similar Datasets

Project description:BackgroundInnovations in clinical training and support that enhance fidelity to evidence-based treatment (EBT) for adolescent behavior problems are sorely needed. This study will develop an online training system to address this gap: Measurement Training and Feedback System for Implementation (MTFS-I). Using procedures intended to be practical and sustainable, MTFS-I is designed to increase two aspects of therapist behavior that are fundamental to boosting EBT fidelity: therapist self-monitoring of EBT delivery, and therapist utilization of core techniques of EBTs in treatment sessions. This version of MTFS-I focuses on two empirically supported treatment approaches for adolescent conduct and substance use problems: family therapy and cognitive behavioral therapy (CBT).Methods/designMTFS-I expands on conventional measurement feedback systems for client outcomes by adding training in observational coding to promote EBT self-monitoring and focusing on implementation of EBT treatment techniques. It has two primary components. (1) The training component, delivered weekly in two connected parts, involves self-monitored learning modules containing brief clinical descriptions of core EBT techniques and mock session coding exercises based on 5-8 min video segments that illustrate delivery of core techniques. (2) The feedback component summarizes aggregated therapist-reported data on EBT techniques used with their active caseloads. MTFS-I is hosted online and requires approximately 20 min per week to complete for each treatment approach. This randomized trial will first collect data on existing delivery of family therapy and CBT techniques for youth in outpatient behavioral health sites (Baseline phase). It will then randomize site clinicians to two study conditions (Implementation phase): Training Only versus Training + Feedback + Consultation. Therapists will choose whether to train in family therapy, CBT, or both. Study aims will compare clinician performance across study phase and between study conditions on MTFS-I uptake, reliability and accuracy in EBT self-monitoring, and utilization of EBT techniques in treatment sessions (based on observer coding of audiotapes).DiscussionStudy contributions to implementation science and considerations of MTFS-I sustainability are discussed.Trial registrationClinicalTrials.gov, NCT03722654. Registered on 29 October 2018.

Project description:IntroductionAcross sub-Saharan Africa, ministries of health have proposed integrating pre-exposure prophylaxis (PrEP) for HIV prevention into family planning (FP) services to reach adolescent girls and young women (AGYW); however, evidence on effective implementation strategies is still limited. We conducted a qualitative study of integrated PrEP-FP service implementation at two FP clinics in Kisumu, Kenya.MethodsFrom June 2017 to May 2020, the Prevention Options for Women Evaluation Research (POWER) study enrolled 1000 sexually active, HIV-negative AGYW age 16 to 25. Actions taken to implement PrEP were captured prospectively in 214 monitoring and evaluation documents and 15 interviews with PrEP implementers. We analysed data using conventional and directed content analysis, with the latter informed by the Consolidated Framework for Implementation Research (CFIR) and the Expert Recommendations for Implementing Change (ERIC) compilation.ResultsPOWER deployed a variety of implementation strategies to train and educate stakeholders (e.g., having new providers shadow PrEP providers); develop stakeholder interrelationships (e.g., organizing support teams with protected time to reflect on implementation progress and make refinements); provide technical assistance; and change physical infrastructure and workflow. Although these strategies reportedly influenced contextual factors across four of the five CFIR domains, they primarily interacted with contextual factors relevant to inner setting, especially implementation climate and readiness for implementation. Overall, implementing PrEP proved easier and less labor-intensive at a private, youth-friendly clinic than a public FP clinic, largely because the baseline structural characteristics (e.g., space, workflow) and organizational mission of the former were more conducive to offering AGYW-centered care. Nevertheless, adoption of PrEP delivery among non-study staff at both sites was low, likely due to the widespread perception that PrEP was not within their scope of work.ConclusionsSome FP clinics may be "lower-hanging fruit" than others for PrEP implementation. Approaching PrEP implementation as a behavioral intervention for FP providers may help ensure that providers have the requisite capability, opportunity, and motivation to adopt the clinical innovation. In particular, PrEP implementers should assess the need for implementation strategies that support providers' clinical decision-making, establish worker expectations and accountability, and address workload constraints.Trial registrationClinical Trial Number: NCT03490058 .

Project description:ObjectiveTo test whether pay for performance (P4P) is an effective method to improve adolescent substance use disorder treatment implementation and efficacy.DesignCluster randomized trial.SettingCommunity-based treatment organizations.ParticipantsTwenty-nine community-based treatment organizations, 105 therapists, and 986 adolescent patients (953 with complete data).InterventionCommunity-based treatment organizations were assigned to 1 of the following conditions: the implementation-as-usual (IAU) control condition or the P4P experimental condition. In addition to delivering the same evidence-based treatment (ie, using the Adolescent Community Reinforcement Approach [A-CRA]), each organization received standardized levels of funding, training, and coaching from the treatment developers. Therapists in the P4P condition received US $50 for each month that they demonstrated competence in treatment delivery (ie, A-CRA competence) and US $200 for each patient who received a specified number of treatment procedures and sessions (ie, target A-CRA) that has been found to be associated with significantly improved patient outcomes.Main outcome measuresOutcomes included ACRA competence (ie, a therapist-level implementation measure), target A-CRA (ie, a patient-level implementation measure), and remission status (ie, a patient-level treatment effectiveness measure).ResultsRelative to therapists in the IAU control condition, therapists in the P4P condition were significantly more likely to demonstrate A-CRA competence (24.0% vs 8.9%; event rate ratio, 2.24; 95% CI, 1.12- 4.48; P=.02). Relative to patients in the IAU control condition, patients in the P4P condition were significantly more likely to receive target A-CRA (17.3% vs 2.5%; odds ratio, 5.19; 95% CI, 1.53-17.62; P=.01). However, no significant differences were found between conditions with regard to patients' end-of-treatment remission status.ConclusionPay for performance can be an effective method of improving treatment implementation.Trial registrationclinicaltrials.gov Identifier: NCT01016704

Project description:BackgroundCommunication-based activities and products (i.e., training programs, webinars) are a critical component of implementation strategies that relay information to various audiences. Audience perceptions of communication effectiveness contribute important insight into the processes and mechanisms through which an implementation effort may succeed or fail. To advance research on this front, a psychometrically sound instrument for measuring perceived communication effectiveness (PCE) is needed.MethodsAn expert panel identified the theoretical foundations and conceptual domains of PCE and drafted preliminary items. Five focus groups of correctional professionals who had recently completed an implementation leadership training reviewed the items and provided feedback for refinement. Revised items were then included in a survey-based evaluation of an ongoing eLearning curriculum designed to improve the practices used by front-line probation officers in supervising individuals in the field. The factorial structure of a final 6-item scale as well as its convergent, divergent, and predictive validity was evaluated using data from the evaluation surveys (Nfollow-up = 358, Nbaseline+follow-up = 159).ResultsConfirmatory factor analysis of the final scale of PCE demonstrated adequate fit. PCE was strongly correlated with measures of implementation outcomes (acceptability, r = .819, p < .001; appropriateness, r = .809, p < .001; and feasibility, r = .754, p < .001), yet uncorrelated with a scale of need to evaluate (r = - .051, p = .422), demonstrating both convergent and divergent validities. The predictive validity of PCE was evidenced by significant associations between PCE and key training outcomes, including perceived staff use of evidence-based practices (β = .230, p < .05), agency climate (β = .261, p < .05), and value concordance (β = .209, p < .05), after controlling for baseline values and other confounders.ConclusionsThe PCE scale is psychometrically sound and can be a useful tool for gauging audience receptivity to and the potential impact of communication-based implementation activities and products.

Project description:Background: Comorbid depression and substance use disorders (SUDs) are associated with poor health and social outcomes disproportionately affecting under-resourced communities.Objectives: To test the hypothesis that a coalition approach to collaborative care (CC) for depression would improve outcomes of hazardous drinking and behavioral health hospitalizations, relative to technical assistance, for individuals with comorbid substance use problems. Substance use problems were defined by meeting criteria for DSM-IV substance abuse or dependence, hazardous drinking by AUDIT-C, or treatment in a SUD program within the prior 6 months.Methods: Two depression CC implementation approaches were compared: Resources for Services (RS) provided expert technical support for CC toolkits to individual programs. Community engagement and planning (CEP) supported multi-sector coalitions in collaborating in planning, adapting, implementing and monitoring CC toolkits. One thousand eighteen individuals with depression (PHQ-8 ≥10) enrolled. Regression analyses estimated intervention effects in participants with comorbid substance use problems (n = 588, 281 females, 307 males). Substance use problems were defined by meeting criteria for DSM-IV substance abuse or dependence, hazardous drinking by AUDIT-C, or treatment in a SUD program within the prior 6 months.Results: There were no significant baseline differences by intervention status among participants with depression and substance use problems. Intervention effects on primary outcomes including depression were not significant at 6 months. Compared to RS, CEP significantly reduced alcohol consumption (CEP = 1.6, RS = 2.1, p = .038), probability of behavioral health hospitalizations (OR = 0.50, p = .036), and use of specialty mental health visits (IRR = 0.52, p = .027), while increasing use of faith-based depression services (IRR = 3.4, p = .001).Conclusions: Given feasibility and possible benefits, CEP should be considered a promising approach to implementing depression CC with potential benefits to adults with comorbid substance use problems.

Dataset Information

Measurement Training and Feedback System for Implementation of family-based services for adolescent substance use: protocol for a cluster randomized trial of two implementation strategies.

Publications

Measurement Training and Feedback System for Implementation of family-based services for adolescent substance use: protocol for a cluster randomized trial of two implementation strategies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets