Dataset Information

A proposed model to conduct process and outcome evaluations and implementation research of child health programs in Africa using integrated community case management as an example.

ABSTRACT: AIM: To use a newly devised set of criteria to review the study design and scope of collection of process, outcomes and contextual data for evaluations and implementation research of integrated community case management (iCCM) in Sub-Saharan African. METHODS: We examined 24 program evaluations and implementation research studies of iCCM in sub-Saharan Africa conducted in the last 5 years (2008-2013), assessed the design used and categorized them according to whether or not they collected sufficient information to conduct process and outcome evaluations. RESULTS: Five of the 24 studies used a stepped wedge design and two were randomized control trials. The remaining 17 were quasi-experimental of which 10 had comparison areas; however, not all comparison areas had a pre and post household survey. With regard to process data, 22 of the studies collected sufficient information to report on implementation strength, and all, except one, could report on program implementation. Most common missing data elements were health facility treatments, service costs, and qualitative data to assess demand. For the measurement of program outcomes, 7 of the 24 studies had a year or less of implementation at scale before the endline survey, 6 of the household surveys did not collect point of service, 10 did not collect timeliness (care seeking within 24 hours of symptoms) and 12 did not have socioeconomic (SES) information. Among the 16 studies with comparison areas, only 5 randomly selected comparison areas, while 10 had appropriate comparison areas. CONCLUSIONS: Several evaluations were done too soon after implementation, lacked information on health facility treatments, costs, demand, timeliness or SES and/or did not have a counterfactual. We propose several study designs and minimal data elements to be collected to provide sufficient information to assess whether iCCM increased timely coverage of treatment for the neediest children in a cost-efficient manner.

SUBMITTER: Diaz T

PROVIDER: S-EPMC4267085 | biostudies-other | 2014 Dec

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

A proposed model to conduct process and outcome evaluations and implementation research of child health programs in Africa using integrated community case management as an example.

Diaz Theresa T Guenther Tanya T Oliphant Nicholas P NP Muñiz Maria M

Journal of global health 20141201 2

<h4>Aim</h4>To use a newly devised set of criteria to review the study design and scope of collection of process, outcomes and contextual data for evaluations and implementation research of integrated community case management (iCCM) in Sub-Saharan African.<h4>Methods</h4>We examined 24 program evaluations and implementation research studies of iCCM in sub-Saharan Africa conducted in the last 5 years (2008-2013), assessed the design used and categorized them according to whether or not they coll ...[more]

PMID: 25520799

Similar Datasets

Project description:BACKGROUND:The Integrated Chronic Disease Management (ICDM) model has been implemented in South Africa to enhance quality of clinical services in Primary Healthcare (PHC) clinics in a context of a high prevalence of chronic conditions and multi-morbidity. This study aimed to assess the implementation fidelity (adherence to guidelines) of the ICDM model. METHODS:A cross-sectional study in 16 PHC clinics in two health districts in South Africa: Dr. Kenneth Kaunda (DKK) and West Rand (WR). A fidelity assessment tool with 89 activities and maximum score of 158 was developed from the four interrelated ICDM model components: facility re-organization, clinical supportive management, assisted self-management and strengthening of support systems. Value stream mapping of patient flow was conducted to analyse waiting time and identify operational inefficiencies. ICDM items were scored based on structured observations, facility document reviews and structured questionnaires completed by healthcare workers. Fidelity scores were summarized using medians and proportions and compared by facilities and districts using Chi-Square and Kruskal Wallis test. RESULTS:The monthly patient headcount over a six-month period in these 16 PHC clinics was a median of 2430 (IQR: 1685-2942) individuals over 20?years. The DKK district had more newly diagnosed TB patients per month [median 5.5 (IQR: 4.00-9.33) vs 2.0 (IQR: 1.67-2.92)], and fewer medical officers per clinic [median 1 (IQR: 1-1) vs 3.5 (IQR:2-4.5)] compared to WR district. The median fidelity scores in both districts for facility re-organization, clinical supportive management, assisted self-management and strengthening of support systems were 78% [29/37, IQR: 27-31)]; 77% [30/39 (IQR: 27-34)]; 77% [30/39 (IQR: 28-34)]; and 80% [35/44 (IQR: 30-37)], respectively. The overall median implementation fidelity of the ICDM model was 79% (125/158, IQR, 117-132); WR was 80% (126/158, IQR, 123-132) while DKK was 74% (117/158, IQR, 106-130), p =?0.1409. The lowest clinic fidelity score was 66% (104/158), while the highest was 86% (136/158). A patient flow analysis showed long (2-5?h) waiting times and one stream of care for acute and chronic services. CONCLUSION:There was some variability of scores on components of the ICDM model by PHC clinics. More research is needed on contextual adaptations of the model.

Project description:BACKGROUND: Numerous worksite health promotion program (WHPPs) have been implemented the past years to improve employees' health and lifestyle (i.e., physical activity, nutrition, smoking, alcohol use and relaxation). Research primarily focused on the effectiveness of these WHPPs. Whereas process evaluations provide essential information necessary to improve large scale implementation across other settings. Therefore, this review aims to: (1) further our understanding of the quality of process evaluations alongside effect evaluations for WHPPs, (2) identify barriers/facilitators affecting implementation, and (3) explore the relationship between effectiveness and the implementation process. METHODS: Pubmed, EMBASE, PsycINFO, and Cochrane (controlled trials) were searched from 2000 to July 2012 for peer-reviewed (randomized) controlled trials published in English reporting on both the effectiveness and the implementation process of a WHPP focusing on physical activity, smoking cessation, alcohol use, healthy diet and/or relaxation at work, targeting employees aged 18-65 years. RESULTS: Of the 307 effect evaluations identified, twenty-two (7.2%) published an additional process evaluation and were included in this review. The results showed that eight of those studies based their process evaluation on a theoretical framework. The methodological quality of nine process evaluations was good. The most frequently reported process components were dose delivered and dose received. Over 50 different implementation barriers/facilitators were identified. The most frequently reported facilitator was strong management support. Lack of resources was the most frequently reported barrier. Seven studies examined the link between implementation and effectiveness. In general a positive association was found between fidelity, dose and the primary outcome of the program. CONCLUSIONS: Process evaluations are not systematically performed alongside effectiveness studies for WHPPs. The quality of the process evaluations is mostly poor to average, resulting in a lack of systematically measured barriers/facilitators. The narrow focus on implementation makes it difficult to explore the relationship between effectiveness and implementation. Furthermore, the operationalisation of process components varied between studies, indicating a need for consensus about defining and operationalising process components.

Project description:ObjectivesAdapting evidence-based practices to local settings is critical for successful implementation and dissemination. A pre-implementation assessment evaluates local context to inform implementation, but there is little published guidance for clinician-implementers. The rural Transitions Nurse Program (TNP) is a care coordination intervention that facilitates care transitions for rural veterans. In year 1 of TNP, pre-implementation assessments were conducted by a centralized project team through multi-day visits at five sites nationwide. In year 2, we tested if local site TNP nurses could conduct pre-implementation assessments using evidence-based tools and coaching from the TNP team. This required developing a multicomponent pre-implementation strategy bundle to guide data collection and synthesis. We hypothesized that (1) nurses would find the pre-implementation assessment useful for tailoring TNP to local contexts and (2) nurses would identify similar barriers and facilitators to those identified at first year sites.MethodsThe bundle included guides for conducting key informant interviews, brainwriting, process mapping, and reflective journaling. We evaluated TNP nurse satisfaction and perceived utility of the structure and process of the training and bundle through pre-post surveys. To assess the outcome of data collection efforts, we interviewed nurses 4 months after completion of the pre-implementation assessment to determine if and how they used pre-implementation findings to tailor implementation of TNP to local contexts. To further assess outcomes, all data that the nurses collected were analyzed thematically. Themes related to barriers and facilitators were compared across years.FindingsFive nurses at different VA medical centers used the pre-implementation strategy bundle to collect site-level data and completed pre-post surveys. Findings indicated that the pre-implementation assessment was highly recommended, and the bundle provided adequate training. Nurses felt that pre-implementation work oriented them to the local context and illustrated how to integrate TNP into existing processes. Barriers and facilitators identified by nurses were similar to those collected in year 1 by the TNP research team, including communication challenges, need for buy-in, and logistical concerns.ConclusionsThis proof-of-concept study suggests that evidence-based tools can effectively guide clinician-implementers through the process of conducting a pre-implementation assessment. This approach positively informed TNP implementation and oriented nurses to their local context prior to implementation.

Project description:AimTo identify better performing iCCM programs in sub-Saharan Africa (SSA) and identify factors associated with better performance using routine data.MethodsWe examined 15 evaluations or studies of integrated community case management (iCCM) programs in SSA conducted between 2008 and 2013 and with information about the program; routine data on treatments, supervision, and stockouts; and, where available, data from community health worker (CHW) surveys on supervision and stockouts. Analyses included descriptive statistics, Fisher exact test for differences in median treatment rates, the Kruskal-Wallis test for differences in the distribution of treatment rates, and Spearman's correlation by program factors.ResultsThe median percent of annual expected cases treated was 27% (1-74%) for total iCCM, 37% (1-80%) for malaria, 155% (7-552%) for pneumonia, and 27% (1-74%) for diarrhoea. Seven programs had above median total iCCM treatments rates. Four programs had above median treatment rates, above median treatments per active CHW per month, and above median percent of expected cases treated. Larger populations under-five targeted were negatively associated with treatment rates for fever, malaria, diarrhea, and total iCCM. The ratio of CHWs per population was positively associated with diarrhoea treatment rates. Use of rapid diagnostic tests (RDTs) was negatively associated with treatment rates for pneumonia. Treatment rates and percent of annual expected cases treated were equivalent between programs with volunteer CHWs and programs with salaried CHWs.ConclusionsThere is large variation in iCCM program performance in SSA. Four programs appear to be higher performing in terms of treatment rates, treatments per CHW per month, and percent of expected cases treated. Treatment rates for diarrhoea are lower than expected across most programmes. CHWs in many programmes are overtreating pneumonia. Programs targeting larger populations under-five tend to have lower treatment rates. The reasons for lower pneumonia treatment rates where CHWs use RDTs need to be explored. Programs with volunteer CHWs and those with salaried CHWs can achieve similar treatment rates and percent of annual expected cases treated but to do so volunteer programs must manage more CHWs per population and salaried CHWs must provide more treatments per CHW per month.

Dataset Information

A proposed model to conduct process and outcome evaluations and implementation research of child health programs in Africa using integrated community case management as an example.

Publications

A proposed model to conduct process and outcome evaluations and implementation research of child health programs in Africa using integrated community case management as an example.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure