Dataset Information

Mixed methods evaluation of implementation and outcomes in a community-based cancer prevention intervention.

ABSTRACT:

Background

Community-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implementation was related to participant outcomes, and identify barriers and facilitators to implementation that could be addressed.

Methods

This study utilized quantitative participant evaluation data (n?=?115) and quantitative and qualitative data from semi-structured interviews with program instructors (N?=?13). At the participant level, demographic data (age, sex, insurance status) and behavior change intention were captured. Instructor data included implementation of program components and program attendance to create a 7-point implementation score of fidelity and reach variables. Degree of program implementation (high and low) was operationalized based on these variables (low: 0-4, high: 5-7). Relationships among degree of implementation, participant demographics, and participant outcomes (e.g., intent to be physically active or limit alcohol) were assessed using linear or ordinal logistic mixed effects models as appropriate. Interview data were transcribed and coded deductively for CFIR constructs, and constructs were then rated for magnitude and valence. Patterns between ratings of high and low implementation programs were used to determine constructs that manifested as barriers or facilitators.

Results

Program implementation varied with scores ranging from 4 to 7. High implementation was related to greater improvements in intention to be physically active (p?ConclusionsAs higher implementation was related to improved participant outcomes, program administrators should emphasize the importance of fidelity in training for program instructors. The CFIR can be used to identify barriers and/or facilitators to implementation in community interventions, but results may be unique from clinical contexts.

SUBMITTER: King ES

PROVIDER: S-EPMC6683347 | biostudies-literature | 2019 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Mixed methods evaluation of implementation and outcomes in a community-based cancer prevention intervention.

King Emily S ES Moore Carla J CJ Wilson Hannah K HK Harden Samantha M SM Davis Marsha M Berg Alison C AC

BMC public health 20190805 1

<h4>Background</h4>Community-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implement ...[more]

PMID: 31383019

Similar Datasets

Project description:To describe the implementation of an enhanced rehabilitation programme for elderly hip fracture patients with mental capacity, in a randomised feasibility study compared with usual rehabilitation. To compare processes between the two and to collect the views of patients, carers and therapy staff about trial participation.Mixed methods process evaluation in a randomised feasibility study.Patient participants were recruited on orthopaedic and rehabilitation wards; the intervention was delivered in the community following hospital discharge.Sixty-one older adults (aged ?65 years) recovering from surgical treatment (replacement arthroplasty or internal fixation) following hip fracture, who were living independently prior to fracture and had mental capacity and 31 of their carers.Usual care (control) or usual care plus an enhanced rehabilitation package (intervention). The enhanced rehabilitation consisted of a patient-held information workbook, goal-setting diary and up to six additional therapy sessions.Recruitment of sites and rehabilitation teams, response of rehabilitation teams, recruitment and reach in patient and carer participants, intervention delivery, delivery to individuals, response of individual patients to the enhanced intervention or usual rehabilitation, response of carer participants, unintended consequences and testing intervention theory and context.Usual rehabilitation care was very variable. The enhanced rehabilitation group received a mean of five additional therapy sessions. All of the returned goal-setting diaries had inputs from the therapy team, and half had written comments by the patients and carers. Focus group themes: variation of usual care and its impact on delivering the intervention; the importance of goal setting; the role of the therapist in providing reassurance about safe physical activities; and acceptability of the extra therapy sessions.Lessons learnt for a future definitive RCT include how to enhance recruitment and improve training materials, the workbook, delivery of the extra therapy sessions and recording of usual rehabilitation care.ISRCTN22464643; Post- results.

Project description:BackgroundManagers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.MethodsA non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.ResultsOverall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).ConclusionsThe intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

Project description:BACKGROUND:Wearable technology interventions combined with digital behavior change resources provide opportunities to increase physical activity in adolescents. The implementation of such interventions in real-world settings is unknown. The Raising Awareness of Physical Activity (RAW-PA) study was a 12-week cluster randomized controlled trial targeting inactive adolescents attending schools in socioeconomically disadvantaged areas of Melbourne, Australia. The aim was to increase moderate- to vigorous-intensity physical activity using (1) a wrist-worn Fitbit Flex and app, (2) weekly challenges, (3) digital behavior change resources, and (4) email or text message alerts. OBJECTIVE:This paper presents adolescents' and teachers' perceptions of RAW-PA in relation to program acceptability, feasibility and perceived impact, adolescent engagement and adherence, and the potential for future scale-up. METHODS:A mixed methods evaluation of the RAW-PA study assessed acceptability, engagement, feasibility, adherence, and perceived impact. A total of 9 intervention schools and 144 intervention adolescents were recruited. Only adolescents and teachers (n=17) in the intervention group were included in the analysis. Adolescents completed web-based surveys at baseline and surveys and focus groups postintervention. Teachers participated in interviews postintervention. Facebook data tracked engagement with web-based resources. Descriptive statistics were reported by sex. Qualitative data were analyzed thematically. RESULTS:Survey data were collected from 142 adolescents at baseline (mean age 13.7 years, SD 0.4 years; 51% males) and 132 adolescents postintervention. A total of 15 focus groups (n=124) and 9 interviews (n=17) were conducted. RAW-PA had good acceptability among adolescents and teachers. Adolescents perceived the intervention content as easy to understand (100/120, 83.3%) and the Fitbit easy to use (112/120; 93.3%). Half of the adolescents perceived the text messages to be useful (61/120; 50.8%), whereas 47.5% (57/120) liked the weekly challenges and 38.3% (46/120) liked the Facebook videos. Facebook engagement declined over time; only 18.6% (22/118) of adolescents self-reported wearing the Fitbit Flex daily postintervention. Adolescents perceived the Fitbit Flex to increase their physical activity motivation (85/120, 70.8%) and awareness (93/119, 78.2%). The web-based delivery facilitated implementation of the intervention, although school-level policies restricting phone use were perceived as potential inhibitors to program roll-out. CONCLUSIONS:RAW-PA showed good acceptability among adolescents attending schools in socioeconomically disadvantaged areas and their teachers. Low levels of teacher burden enhanced their perceptions concerning the feasibility of intervention delivery. Although adolescents perceived that RAW-PA had short-term positive effects on their motivation to be physically active, adolescent adherence and engagement were low. Future research exploring the feasibility of different strategies to engage adolescents with wearable technology interventions and ways of maximizing system-level embeddedness of interventions in practice would greatly advance the field.

Project description:BackgroundTimely and comprehensive treatment in the form of early psychosis intervention (EPI) has become the standard of care for youth with psychosis. While EPI services were designed to be delivered in person, the COVID-19 pandemic required many EPI programs to rapidly transition to virtual delivery, with little evidence to guide intervention adaptations or to support the effectiveness and satisfaction with virtual EPI services.ObjectiveThis study aims to explore the adaptations required to deliver NAVIGATE, a model of coordinated specialty care used in EPI, in a virtual format. This study will evaluate implementation of the NAVIGATE model delivered virtually by describing the nature of the adaptations to the intervention, assessing fidelity to the EPI model and the satisfaction of clients, family members, and care providers. We will investigate barriers and facilitators to virtual NAVIGATE implementation, service engagement, and health equity impacts of this work.MethodsThe Centre for Addiction and Mental Health (Toronto, Ontario, Canada) transitioned to delivering NAVIGATE virtually early in the COVID-19 pandemic. The Framework for Reporting Adaptations and Modifications for Evidence-Based Interventions will be used to describe the adaptations required to deliver NAVIGATE virtually. Fidelity to the EPI model will be measured using the First Episode Psychosis Services Fidelity Scale and fidelity to NAVIGATE will be assessed by investigating adherence to its core components. Implementation facilitators and barriers will be explored using semistructured interviews with providers informed by the Consolidated Framework for Implementation Research. Satisfaction with virtually delivered NAVIGATE will be assessed with virtual client and provider experience surveys and qualitative interviews with clients, family members, and providers. Service engagement data will be collected through review of medical records, and potential impacts of virtually delivered NAVIGATE on different population groups will be assessed with the Health Equity Impact Assessment.ResultsVirtual clinical delivery of NAVIGATE started in March 2020 with additional adaptations and data collection is ongoing. Data will be analyzed using descriptive statistics and survival analysis for quantitative data. Qualitative data will be analyzed using thematic content analysis. Integration of qualitative and quantitative data will occur at the data collection, interpretation, and reporting levels following a convergent design.ConclusionsThis study will provide information regarding the type of intervention adaptations required for virtual delivery of NAVIGATE for youth with early psychosis, ensuring access to high-quality care for this population during the pandemic and beyond by guiding future implementation in similar contexts.International registered report identifier (irrid)DERR1-10.2196/34591.

Project description:BackgroundChildhood obesity prevention interventions have engaged coalitions in study design, implementation, and/or evaluation to improve research outcomes; yet, no systematic reviews have been conducted on this topic. This mixed methods review aims to characterize the processes and dynamics of coalition engagement in community-based childhood obesity prevention interventions.MethodsData Sources: Studies extracted from Ovid MEDLINE, PubMed, and Web of Science; complementary original survey and interview data among researchers of included studies. Eligible Studies: Multisetting community-based obesity prevention interventions in high-income countries targeting children 0-12 years with anthropometric, behavioral, or environmental/policy outcomes. The Community-Based Participatory Research (CBPR) Conceptual Model was used as an overarching framework.ResultsThirteen studies met inclusion criteria. Elements of CBPR were evident across all studies with community engagement in problem identification (n = 7), design/planning (n = 11), implementation (n = 12), evaluation (n = 4), dissemination (n = 2), and sustainability (n = 10) phases. Five studies reported favorable intervention effects on anthropometric (n = 4), behavioral (n = 1), and/or policy (n = 1) outcomes; descriptive associations suggested that these studies tended to engage community members in a greater number of research phases. Researchers involved in 7 of 13 included studies completed a survey and interview. Respondents recalled the importance of group facilitation, leadership, and shared understanding to multisector coalition work. Perceived coalition impacts included community capacity building and intervention sustainability.ConclusionsThis review contributes to a deeper understanding of intervention processes and dynamics within communities engaged in childhood obesity prevention. Future research should more rigorously assess and report on coalition involvement to assess the influence of coalitions on multiple outcomes, including child weight status.

Project description:Background: There is a lack of evidence concerning the effective implementation of strategies for stroke prevention and management, particularly in resource-limited settings. A primary-care-based integrated mobile health intervention (SINEMA intervention) has been implemented and evaluated via a 1-year-long cluster-randomized controlled trial. This study reports the findings from the trial implementation and process evaluation that investigate the implementation of the intervention and inform factors that may influence the wider implementation of the intervention in the future. Methods: We developed an evaluation framework by employing both the RE-AIM framework and the MRC process evaluation framework to describe the implementation indicators, related enablers and barriers, and illustrate some potential impact pathways that may influence the effectiveness of the intervention in the trial. Quantitative data were collected from surveys and extracted from digital health monitoring systems. In addition, we conducted quarterly in-depth interviews with stakeholders in order to understand barriers and enablers of program implementation and effectiveness. Quantitative data analysis and thematic qualitative data analysis were applied, and the findings were synthesized based on the evaluation framework. Results: The SINEMA intervention was successfully implemented in 25 rural villages, reached 637 patients with stroke in rural Northern China during the 12 months of the trial. Almost 90% of the participants received all follow-up visits per protocol, and about half of the participants received daily voice messages. The majority of the intervention components were adopted by village doctors with some adaptation made. The interaction between human-delivered and technology-enabled components reinforced the program implementation and effectiveness. However, characteristics of the participants, doctor-patient relationships, and the healthcare system context attributed to the variation of program implementation and effectiveness. Conclusion: A comprehensive evaluation of program implementation demonstrates that the SINEMA program was well implemented in rural China. Findings from this research provide additional information for program adaptation, which shed light on the future program scale-up. The study also demonstrates the feasibility of combining RE-AIM and MRC process evaluation frameworks in process and implementation evaluation in trials. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: NCT03185858.

Project description:Aims and objectivesTo investigate uptake of a Chest Injury Protocol (ChIP), examine factors influencing its implementation and identify interventions for promoting its use.BackgroundFailure to treat blunt chest injuries in a timely manner with sufficient analgesia, physiotherapy and respiratory support, can lead to complications such as pneumonia and respiratory failure and/or death.DesignThis is a mixed-methods implementation evaluation study.MethodsTwo methods were used: (i) identification and review of the characteristics of all patients eligible for the ChIP protocol, and (ii) survey of hospital staff opinions mapped to the Theoretical Domains Framework (TDF) to identify barriers and facilitators to implementation. The characteristics and treatment received between the groups were compared using the chi-square test or Fischer's exact test for proportions, and the Mann-Whitney U-test for continuous data. Quantitative survey data were analysed using descriptive statistics. Qualitative data were coded in NVivo 10 using a coding guide based on the TDF and Behaviour Change Wheel (BCW). Identification of interventions to change target behaviours was sourced from the Behaviour Change Technique Taxonomy Version 1 in consultation with stakeholders.ResultsOnly 68.4% of eligible patients received ChIP. Fifteen facilitators and 10 barriers were identified to influence the implementation of ChIP in the clinical setting. These themes were mapped to 10 of the 14 TDF domains and corresponded with all nine intervention functions in the BCW. Seven of these intervention functions were selected to address the target behaviours and a multi-faceted relaunch of the revised protocol developed. Following re-launch, uptake increased to 91%.ConclusionsThis study demonstrated how the BCW may be used to revise and improve a clinical protocol in the ED context.Relevance to clinical practiceNewly implemented clinical protocols should incorporate clinician behaviour change assessment, strategy and interventions. Enhancing the self-efficacy of emergency nurses when performing assessments has the potential to improve patient outcomes and should be included in implementation strategy.

Dataset Information

Mixed methods evaluation of implementation and outcomes in a community-based cancer prevention intervention.

Background

Methods

Results

Publications

Mixed methods evaluation of implementation and outcomes in a community-based cancer prevention intervention.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets