Dataset Information

Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®.

ABSTRACT: BACKGROUND:Research is needed to evaluate the impact of implementation support interventions over and above typical efforts by community settings to deploy evidence-based prevention programs. METHODS:Enhancing Quality Interventions Promoting Healthy Sexuality is a randomized controlled trial testing Getting To Outcomes (GTO), a 2-year implementation support intervention. It compares 16 Boys and Girls Club sites implementing Making Proud Choices (MPC, control group), a structured teen pregnancy prevention evidence-based program with 16 similar sites implementing MPC augmented with GTO (intervention group). All sites received training and manuals typical for MPC. GTO has its own manuals, training, and onsite technical assistance (TA) to help practitioners complete key programming practices specified by GTO. During the first year, TA providers helped the intervention group adopt, plan, and deliver MPC. This group then received training on the evaluation and quality improvement steps of GTO, including feedback reports summarizing their data, which were used in a TA-facilitated quality improvement process that yielded revised plans for the second MPC implementation. This paper presents results regarding GTO's impact on performance of the sites (i.e., how well key programming practices were carried out), fidelity of MPC implementation, and the relationship between amount of TA support, performance, and fidelity. Performance was measured using ratings made from a standardized, structured interview conducted with participating staff at all 32 Boys and Girls Clubs sites after the first and second years of MPC implementation. Multiple elements of fidelity (adherence, classroom delivery, dosage) were assessed at all sites by observer ratings and attendance logs. RESULTS:After 2 years, the intervention sites had higher ratings of performance, adherence, and classroom delivery (dosage remained similar). Higher performance predicted greater adherence in both years. CONCLUSIONS:These findings suggest that in typical community-based settings, manuals and training common to structured EBPs may be sufficient to yield low levels of performance and moderate levels of fidelity but that systematic implementation support is needed to achieve high levels of performance and fidelity. TRIAL REGISTRATION:ClinicalTrials.gov, NCT01818791.

SUBMITTER: Chinman M

PROVIDER: S-EPMC4886421 | biostudies-literature | 2016 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®.

Chinman Matthew M Acosta Joie J Ebener Patricia P Malone Patrick S PS Slaughter Mary E ME

Implementation science : IS 20160531 1

<h4>Background</h4>Research is needed to evaluate the impact of implementation support interventions over and above typical efforts by community settings to deploy evidence-based prevention programs.<h4>Methods</h4>Enhancing Quality Interventions Promoting Healthy Sexuality is a randomized controlled trial testing Getting To Outcomes (GTO), a 2-year implementation support intervention. It compares 16 Boys and Girls Club sites implementing Making Proud Choices (MPC, control group), a structured t ...[more]

PMID: 27245158

Similar Datasets

Project description:BackgroundCommunity organizations can have difficulty implementing evidence-based prevention programs. More research is needed on implementation support interventions designed to help these organizations implement programs with quality.MethodsPreparing to Run Effective Programs (PREP) is a randomized controlled trial testing Getting To Outcomes (GTO), a 2-year implementation support intervention. It compares 15 Boys and Girls Club sites implementing CHOICE (control group), a five-session evidence-based alcohol and drug prevention program, with 14 similar sites implementing CHOICE supported by GTO (intervention group). PREP replicates a previous GTO study that had the same design, but featured a teen pregnancy prevention program instead. All sites received typical CHOICE training. Fourteen intervention sites received GTO manuals, training, and onsite technical assistance to help practitioners complete implementation best practices specified by GTO (i.e., GTO steps). During the first year, technical assistance providers helped the intervention group adopt, plan, and deliver CHOICE. Then, this group was trained on evaluation and quality improvement steps of GTO using feedback reports summarizing their own data, which yielded revised plans for subsequent implementation of CHOICE. This paper presents results regarding GTO's impact on CHOICE fidelity (adherence, quality of delivery, dosage) and the proximal outcomes of the youth participants (aged 10-14)-attitudes and intentions regarding cigarettes, alcohol, and marijuana use. Fidelity was assessed at all sites by observer ratings and attendance logs. Proximal outcomes were assessed via survey at baseline, 3, and 6 months.ResultsAfter 1 year, fidelity and proximal outcomes were similar between Intervention and control groups. After 2 years (which included GTO quality improvement activities that took place between years 1 and 2), intervention sites had higher ratings of CHOICE adherence and quality of delivery (dosage remained similar). Proximal outcomes did not differ between groups in either year, although there was universally high endorsement of prosocial responses to those outcomes from the start.ConclusionsFindings suggest that systematic implementation support provided by GTO can help community organizations achieve better fidelity. Findings replicate the implementation results from a previous GTO study using the same design, but with a different evidence-based program and different fidelity measures. Although proximal outcomes did not change, in large part due to ceiling effects, the implementation findings suggest GTO can support a variety of programs.Trial registrationThis project is registered at ClinicalTrials.gov with number NCT02135991 . The trial was first registered on May 12, 2014.

Project description:Background: Existing efforts to understand school-based child sexual abuse (CSA) prevention programs mainly focus on the effectiveness of these programs in increasing participants' CSA knowledge and self-protective skills. There are currently no reviews addressing the underpinning pathways leading to these outcomes. In order to increase our understanding about the underpinning causal and contextual factors and inform the further development of school-based CSA prevention programs, a realist review was conducted to synthesize existing evidence from a broad range of data. Methods: An iterative search of electronic databases and grey literature was conducted, supplemented with citation tracking to locate relevant literature. For quantitative evidence, we considered evaluation studies that focused on students aged 5-18 years, who were enrolled in primary or secondary schools; for other types/formats of studies/documents, no population restrictions were applied. We included school-based CSA prevention programs that focused on improving knowledge of CSA or self-protective skills. Outcomes of interest included knowledge of CSA or self-protective skills. We did not apply methodological filters in terms of the types of studies to be included. Thematic content analysis was conducted to synthesize data. Results: Sixty-two studies were included. Five themes and five overarching Context-Strategy-Mechanism-Outcome configurations (CSMOs) that contributed to the success of school-based CSA interventions were identified, including tailoring programs to participants' cognitive developmental levels, repeated exposure of key concepts and skills, utilization of interactive delivery methods and positive feedback, delivery of positive information and application of the 'train-the-trainer' model. Implications: Findings from this realist review provide insights into the underlying program theory of school-based CSA prevention programs, which can aid in the development and implementation of these programs in the future.

Project description:BackgroundWithin many public health settings, there remain large challenges to sustaining evidence-based practices. The Program Sustainability Assessment Tool has been developed and validated to measure sustainability capacity of public health, social service, and educational programs. This paper describes how this tool was utilized between January 2014 and January 2019. We describe characteristics of programs that are associated with increased capacity for sustainability and ultimately describe the utility of the PSAT in sustainability research and practice.MethodsThe PSAT is comprised of 8 subscales, measuring sustainability capacity in eight distinct conceptual domains. Each subscale is made up of five items, all assessed on a 7-point Likert scale. Data were obtained from persons who used the PSAT on the online website (https://sustaintool.org/), from 2014 to 2019. In addition to the PSAT scale, participants were asked about four program-level characteristics. The resulting dataset includes 5,706 individual assessments reporting on 2,892 programs.ResultsThe mean overall PSAT score was 4.73, with the lowest and highest scoring subscales being funding stability and program adaptation, respectively. Internal consistency for each subscale was excellent (average Cronbach's alpha = 0.90, ranging from 0.85 to 0.94). Confirmatory factor analysis highlighted good to excellent fit of the PSAT measurement model (eight distinct conceptual domains) to the observed data, with a comparative fit index of 0.902, root mean square error of approximation equal to 0.054, and standardized root mean square residual of 0.054. Overall sustainability capacity was significantly related to program size (F = 25.6; p < 0.001). Specifically, smaller programs (with staff sizes of ten or below) consistently reported lower program sustainability capacity. Capacity was not associated with program age and did not vary significantly by program level.DiscussionThe PSAT maintained its excellent reliability when tested with a large and diverse sample over time. Initial criterion validity was explored through the assessment of program characteristics, including program type and program size. The data collected reinforces the ability of the PSAT to assess sustainability capacity for a wide variety of public health and social programs.

Project description:BACKGROUND:Implementation of evidence-based programs (EBPs) for disease self-management and prevention is a policy priority. It is challenging to implement EBPs offered in community settings and to integrate them with healthcare. We sought to understand, categorize, and richly describe key challenges and opportunities related to integrating EBPs into routine primary care practice in the United States. METHODS:As part of a parent, participatory action research project, we conducted a mixed methods evaluation guided by the PRECEDE implementation planning model in an 11-county region of Southeast Minnesota. Our community-partnered research team interviewed and surveyed 15 and 190 primary care clinicians and 15 and 88 non-clinician stakeholders, respectively. We coded interviews according to pre-defined PRECEDE factors and by participant type and searched for emerging themes. We then categorized survey items-before looking at participant responses-according to their ability to generate further evidence supporting the PRECEDE factors and emerging themes. We statistically summarized data within and across responder groups. When consistent, we merged these with qualitative insight. RESULTS:The themes we found, "Two Systems, Two Worlds," "Not My Job," and "Seeing is Believing," highlighted the disparate nature of prescribed activities that different stakeholders do to contribute to health. For instance, primary care clinicians felt pressured to focus on activities of diagnosis and treatment and did not imagine ways in which EBPs could contribute to either. Quantitative analyses supported aspects of all three themes, highlighting clinicians' limited trust in community-placed activities, and the need for tailored education and system and policy-level changes to support their integration with primary care. CONCLUSIONS:Primary care and community-based programs exist in disconnected worlds. Without urgent and intentional efforts to bridge well-care and sick-care, interventions that support people's efforts to be and stay well in their communities will remain outside of-if not at odds with-healthcare.

Dataset Information

Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®.

Publications

Can implementation support help community-based settings better deliver evidence-based sexual health promotion programs? A randomized trial of Getting To Outcomes®.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets