Dataset Information

Implementation of the 'Optimising the Health Extension Program' Intervention in Ethiopia: A Process Evaluation Using Mixed Methods.

ABSTRACT: An intervention called 'Optimising the Health Extension Program', aiming to increase care-seeking for childhood illnesses in four regions of Ethiopia, was implemented between 2016 and 2018, and it included community engagement, capacity building, and district ownership and accountability. A pragmatic trial comparing 26 districts that received the intervention with 26 districts that did not found no evidence to suggest that the intervention increased utilisation of services. Here we used mixed methods to explore how the intervention was implemented. A fidelity analysis of each 31 intervention activities was performed, separately for the first phase and for the entire implementation period, to assess the extent to which what was planned was carried out. Qualitative interviews were undertaken with 39 implementers, to explore the successes and challenges of the implementation, and were analysed by using thematic analysis. Our findings show that the implementation was delayed, with only 19% (n = 6/31) activities having high fidelity in the first phase. Key challenges that presented barriers to timely implementation included the following: complexity both of the intervention itself and of administrative systems; inconsistent support from district health offices, partly due to competing priorities, such as the management of disease outbreaks; and infrequent supervision of health extension workers at the grassroots level. We conclude that, for sustainability, evidence-based interventions must be aligned with national health priorities and delivered within an existing health system. Strategies to overcome the resulting complexity include a realistic time frame and investment in district health teams, to support implementation at grassroots level.

SUBMITTER: Okwaraji YB

PROVIDER: S-EPMC7459764 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Implementation of the 'Optimising the Health Extension Program' Intervention in Ethiopia: A Process Evaluation Using Mixed Methods.

Okwaraji Yemisrach B YB Hill Zelee Z Defar Atkure A Berhanu Della D Wolassa Desta D Persson Lars Åke LÅ Gonfa Geremew G Schellenberg Joanna A JA

International journal of environmental research and public health 20200811 16

An intervention called 'Optimising the Health Extension Program', aiming to increase care-seeking for childhood illnesses in four regions of Ethiopia, was implemented between 2016 and 2018, and it included community engagement, capacity building, and district ownership and accountability. A pragmatic trial comparing 26 districts that received the intervention with 26 districts that did not found no evidence to suggest that the intervention increased utilisation of services. Here we used mixed me ...[more]

PMID: 32796574

Similar Datasets

Project description:IntroductionThe African Federation for Emergency Medicine Trauma Data Project (AFEM-TDP) has created a protocol for trauma data collection in resource-limited settings using a clinical chart with embedded standardized data points that facilitates a systematic approach to injured patients. We performed a process evaluation of the protocol's implementation at Tikur Anbessa Specialized Hospital in Addis Ababa, Ethiopia to provide insights for adapting the protocol to our setting.MethodsDuring the pilot implementation period, the quality of collected data was assessed. Structured key informant interviews about participant experiences and perceptions of the protocol implementation were then conducted. Interviews were analysed using a SWOT model.ResultsDuring pilot data collection, the overall capture rate was 21%. Variables collected with high frequency included demographics, vital signs and ED diagnosis, while mechanism of injury and ED disposition were often missed. Key informant interviews identified Strengths, Weaknesses, Opportunities and Threats to the protocol. Strengths included improved patient care, enhanced training for junior providers and facilitated data collection. Weaknesses included inadequate supervision and challenges relating to the physical size of the form, which resulted in missing data. Opportunities included retrospective research and quality improvement work. Threats included perceived lack of a local champion, poor buy-in from other hospital departments and need for ongoing financial support.ConclusionA mixed methods process evaluation is an invaluable tool when implementing novel data collection protocols, especially in resource-limited settings. We determined early successes and challenges of the implementation of the AFEM-TDP protocol and generated strategies to adapt the protocol to better suit our setting. Lessons from this process evaluation may be informative for other researchers designing and implementing similar data collection protocols.

Project description:BackgroundThe burden of obesity is high among US veterans, yet many face barriers to engaging in in-person, facility-based treatment programs. To improve access to weight-management services, the Veterans Health Administration (VHA) developed TeleMOVE, a home-based, 82-day curriculum that utilizes in-home messaging devices to promote weight loss in VHA patients facing barriers to accessing facility-based services.ObjectiveThe primary aim was to establish preliminary evidence for the program by comparing outcomes for TeleMOVE with standard, facility-based MOVE weight-management services (group, individual modalities) over the evaluation period based on the number of patients enrolled per site and the program's clinical effectiveness, as demonstrated by average weight lost per patient. The secondary aim was to understand factors influencing TeleMOVE implementation variability across demonstration sites to develop recommendations to improve national program dissemination.MethodsWe employed a formative mixed-methods design to evaluate the phased implementation of TeleMOVE at 9 demonstration sites and compare patient- and site-level measures of program uptake. Data were collected between October 1, 2009 and September 30, 2011. Patient-level program outcomes were extracted from VHA patient care databases to evaluate program enrollment rates and clinical outcomes. To assess preliminary clinical effectiveness, weight loss outcomes for veterans who enrolled in TeleMOVE were compared with outcomes for veterans enrolled in standard MOVE! at each demonstration site, as well as with national averages during the first 2 years of program implementation. For the secondary aim, we invited program stakeholders to participate in 2 rounds of semistructured interviews about aspects of TeleMOVE implementation processes, site-level contextual factors, and program delivery. Twenty-eight stakeholders participated in audio-recorded interviews.ResultsAlthough stakeholders at 3 sites declined to be interviewed, objective program uptake was high at 2 sites, delayed-high at 2 sites, and low at 5 sites. At 6 months post enrollment, the mean weight loss was comparable for TeleMOVE (n=417) and MOVE! (n=1543) participants at -5.2 lb (SD 14.4) and -5.1 lb (SD 12.2), respectively (P=.91). All sites reported high program complexity because TeleMOVE required more staff time per participant than MOVE! due to logistical and technical assistance issues related to the devices. High-uptake sites overcame implementation challenges by leveraging communication networks with stakeholders, adapting the program to patient needs whenever possible, setting programmatic goals and monitoring feedback of results, and taking time to reflect and evaluate on delivery to foster incremental delivery improvements, whereas low-uptake sites reported less leadership support and effective communication among stakeholders.ConclusionsThis implementation evaluation of a clinical telehealth program demonstrated the value of partnership-based research in which researchers not only provided operational leaders with feedback regarding the effectiveness of a new program but also relevant feedback into contextual factors related to program implementation to enable adaptations for national deployment efforts.

Project description:Background: There is a lack of evidence concerning the effective implementation of strategies for stroke prevention and management, particularly in resource-limited settings. A primary-care-based integrated mobile health intervention (SINEMA intervention) has been implemented and evaluated via a 1-year-long cluster-randomized controlled trial. This study reports the findings from the trial implementation and process evaluation that investigate the implementation of the intervention and inform factors that may influence the wider implementation of the intervention in the future. Methods: We developed an evaluation framework by employing both the RE-AIM framework and the MRC process evaluation framework to describe the implementation indicators, related enablers and barriers, and illustrate some potential impact pathways that may influence the effectiveness of the intervention in the trial. Quantitative data were collected from surveys and extracted from digital health monitoring systems. In addition, we conducted quarterly in-depth interviews with stakeholders in order to understand barriers and enablers of program implementation and effectiveness. Quantitative data analysis and thematic qualitative data analysis were applied, and the findings were synthesized based on the evaluation framework. Results: The SINEMA intervention was successfully implemented in 25 rural villages, reached 637 patients with stroke in rural Northern China during the 12 months of the trial. Almost 90% of the participants received all follow-up visits per protocol, and about half of the participants received daily voice messages. The majority of the intervention components were adopted by village doctors with some adaptation made. The interaction between human-delivered and technology-enabled components reinforced the program implementation and effectiveness. However, characteristics of the participants, doctor-patient relationships, and the healthcare system context attributed to the variation of program implementation and effectiveness. Conclusion: A comprehensive evaluation of program implementation demonstrates that the SINEMA program was well implemented in rural China. Findings from this research provide additional information for program adaptation, which shed light on the future program scale-up. The study also demonstrates the feasibility of combining RE-AIM and MRC process evaluation frameworks in process and implementation evaluation in trials. Clinical Trial Registration: www.ClinicalTrials.gov, identifier: NCT03185858.

Project description:ObjectivesDuring a cluster randomised trial, (the 3D study) of an intervention enacting recommended care for people with multimorbidity, including continuity of care and comprehensive biennial reviews, we examined implementation fidelity to interpret the trial outcome and inform future implementation decisions.DesignMixed-methods process evaluation using cross-trial data and a sample of practices, clinicians, administrators and patients. Interviews, focus groups and review observations were analysed thematically and integrated with quantitative data about implementation. Analysis was blind to trial outcomes and examined context, intervention adoption, reach and maintenance, and delivery of reviews to patients.SettingThirty-three UK general practices in three areas.ParticipantsThe trial included 1546 people with multimorbidity. 11 general practitioners, 14 nurses, 7 administrators and 38 patients from 9 of 16 intervention practices were sampled for an interview.ResultsStaff loss, practice size and different administrative strategies influenced implementation fidelity. Practices with whole administrative team involvement and good alignment between the intervention and usual care generally implemented better. Fewer reviews than intended were delivered (49% of patients receiving both intended reviews, 30% partially reviewed). In completed reviews >90% of intended components were delivered, but review observations and interviews with patients and clinicians found variation in style of component delivery, from 'tick-box' to patient-centred approaches. Implementation barriers included inadequate skills training to implement patient-centred care planning, but patients reported increased patient-centredness due to comprehensive reviews, extra time and being asked about their health concerns.ConclusionsImplementation failure contributed to lack of impact of the 3D intervention on the trial primary outcome (quality of life), but so did intervention failure since modifiable elements of intervention design were partially responsible. When a decisive distinction between implementation failure and intervention failure cannot be made, identifying potentially modifiable reasons for suboptimal implementation is important to enhance potential for impact and effectiveness of a redesigned intervention.Trial registration numberISRCTN06180958.

Project description:ObjectivesWe report the results of a mixed-methods process evaluation that aimed to provide insight on the Afya conditional cash transfer (CCT) intervention fidelity and acceptability.Intervention, setting and participantsThe Afya CCT intervention aimed to retain women in the continuum of maternal healthcare including antenatal care (ANC), delivery at facility and postnatal care (PNC) in Siaya County, Kenya. The cash transfers were delivered using an electronic card reader system at health facilities. It was evaluated in a trial that randomised 48 health facilities to intervention or control, and which found modest increases in attendance for ANC and immunisation appointments, but little effect on delivery at facility and PNC visits.DesignA mixed-methods process evaluation was conducted. We used the Afya electronic portal with recorded visits and payments, and reports on use of the electronic card reader system from each healthcare facility to assess fidelity. Focus group interviews with participants (N=5) and one-on-one interviews with participants (N=10) and healthcare staff (N=15) were conducted to assess the acceptability of the intervention. Data analyses were conducted using descriptive statistics and qualitative content analysis, as appropriate.ResultsDelivery of the Afya CCT intervention was negatively affected by problems with the electronic card reader system and a decrease in adherence to its use over the intervention period by healthcare staff, resulting in low implementation fidelity. Acceptability of cash transfers in the form of mobile transfers was high for participants. Initially, the intervention was acceptable to healthcare staff, especially with respect to improvements in attaining facility targets for ANC visits. However, acceptability was negatively affected by significant delays linked to the card reader system.ConclusionsThe findings highlight operational challenges in delivering the Afya CCT intervention using the Afya electronic card reader system, and the need for greater technology readiness before further scale-up.Trial registration numberNCT03021070.

Project description:BackgroundManagers and professionals in health and social care are required to implement evidence-based methods. Despite this, they generally lack training in implementation. In clinical settings, implementation is often a team effort, so it calls for team training. The aim of this study was to evaluate the effects of the Building Implementation Capacity (BIC) intervention that targets teams of professionals, including their managers.MethodsA non-randomized design was used, with two intervention cases (each consisting of two groups). The longitudinal, mixed-methods evaluation included pre-post and workshop-evaluation questionnaires, and interviews following Kirkpatrick's four-level evaluation framework. The intervention was delivered in five workshops, using a systematic implementation method with exercises and practical working materials. To improve transfer of training, the teams' managers were included. Practical experiences were combined with theoretical knowledge, social interactions, reflections, and peer support.ResultsOverall, the participants were satisfied with the intervention (first level), and all groups increased their self-rated implementation knowledge (second level). The qualitative results indicated that most participants applied what they had learned by enacting new implementation behaviors (third level). However, they only partially applied the implementation method, as they did not use the planned systematic approach. A few changes in organizational results occurred (fourth level).ConclusionsThe intervention had positive effects with regard to the first two levels of the evaluation model; that is, the participants were satisfied with the intervention and improved their knowledge and skills. Some positive changes also occurred on the third level (behaviors) and fourth level (organizational results), but these were not as clear as the results for the first two levels. This highlights the fact that further optimization is needed to improve transfer of training when building teams' implementation capacity. In addition to considering the design of such interventions, the organizational context and the participants' characteristics may also need to be considered to maximize the chances that the learned skills will be successfully transferred to behaviors.

Project description:BackgroundCommunity-based educational programs can complement clinical strategies to increase cancer screenings and encourage healthier lifestyles to reduce cancer burden. However, implementation quality can influence program outcomes and is rarely formally evaluated in community settings. This mixed-methods study aimed to characterize implementation of a community-based cancer prevention program using the Consolidated Framework for Implementation Research (CFIR), determine if implementation was related to participant outcomes, and identify barriers and facilitators to implementation that could be addressed.MethodsThis study utilized quantitative participant evaluation data (n = 115) and quantitative and qualitative data from semi-structured interviews with program instructors (N = 13). At the participant level, demographic data (age, sex, insurance status) and behavior change intention were captured. Instructor data included implementation of program components and program attendance to create a 7-point implementation score of fidelity and reach variables. Degree of program implementation (high and low) was operationalized based on these variables (low: 0-4, high: 5-7). Relationships among degree of implementation, participant demographics, and participant outcomes (e.g., intent to be physically active or limit alcohol) were assessed using linear or ordinal logistic mixed effects models as appropriate. Interview data were transcribed and coded deductively for CFIR constructs, and constructs were then rated for magnitude and valence. Patterns between ratings of high and low implementation programs were used to determine constructs that manifested as barriers or facilitators.ResultsProgram implementation varied with scores ranging from 4 to 7. High implementation was related to greater improvements in intention to be physically active (p < 0.05), achieve a healthy weight (p < 0.05), and limit alcohol (p < 0.01). Eight constructs distinguished between high and low implementation programs. Design quality and packaging, compatibility, external change agents, access to knowledge and information, and experience were facilitators of implementation and formally appointed internal implementation leaders was a barrier to implementation.ConclusionsAs higher implementation was related to improved participant outcomes, program administrators should emphasize the importance of fidelity in training for program instructors. The CFIR can be used to identify barriers and/or facilitators to implementation in community interventions, but results may be unique from clinical contexts.

Project description:ObjectivesParent carers of children with special educational needs or disability are at risk of poorer mental and physical health. In response to these needs, we codeveloped the 'Healthy Parent Carers' (HPC) programme. This study examined the views and experiences of participants in the HPC feasibility trial to inform programme refinement.Intervention, setting and participantsHPC is a peer-led group-based intervention (supported by online materials) for primary carers of disabled children, encouraging behaviours linked with health and well-being. It was delivered by two lead and six assistant peer facilitators in six community sites (one lead and one assistant per group) in South West England over six or 12 sessions. Control participants had online materials only. The trial involved 47 intervention and 45 control parent carers (97% female and 97% white) and eight facilitators (one male).DesignA preplanned mixed methods process evaluation using questionnaires and checklists (during and after the intervention), qualitative interviews with participants after intervention (n=18) and a focus group with facilitators after trial.ResultsHPC was highly acceptable to participants and facilitators and experiences were very positive. Participants reported that the programme increased awareness of what parent carers could and could not change and their self-efficacy to engage in health-promoting behaviours. The intended mechanisms of action (social identification and peer support) matched participants' expectations and experiences. Control participants found the online-only programme flexible but isolating, as there were no opportunities to share ideas and problem solve with peers, the key function of the programme. Areas for improvement were identified for programme content, facilitator training and delivery.ConclusionHPC was acceptable, well received and offers considerable potential to improve the health of parent carers. Under the pandemic, the challenge going forward is how best to maintain reach and fidelity to function while delivering a more virtual programme.Trial registration numberISRCTN151144652.

Dataset Information

Implementation of the 'Optimising the Health Extension Program' Intervention in Ethiopia: A Process Evaluation Using Mixed Methods.

Publications

Implementation of the 'Optimising the Health Extension Program' Intervention in Ethiopia: A Process Evaluation Using Mixed Methods.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets