Dataset Information

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the 'Black Box' of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda.

ABSTRACT: Increased attention on "complexity" in health systems evaluation has resulted in many different methodological responses. Theory-driven evaluations and systems thinking are two such responses that aim for better understanding of the mechanisms underlying given outcomes. Here, we studied the implementation of a performance-based financing intervention by the Belgian Technical Cooperation in Western Uganda to illustrate a methodological strategy of combining these two approaches. We utilized a systems dynamics tool called causal loop diagramming (CLD) to generate hypotheses feeding into a theory-driven evaluation. Semi-structured interviews were conducted with 30 health workers from two districts (Kasese and Kyenjojo) and with 16 key informants. After CLD, we identified three relevant hypotheses: "success to the successful", "growth and underinvestment", and "supervision conundrum". The first hypothesis leads to increasing improvements in performance, as better performance leads to more incentives, which in turn leads to better performance. The latter two hypotheses point to potential bottlenecks. Thus, the proposed methodological strategy was a useful tool for identifying hypotheses that can inform a theory-driven evaluation. The hypotheses are represented in a comprehensible way while highlighting the underlying assumptions, and are more easily falsifiable than hypotheses identified without using CLD.

SUBMITTER: Renmans D

PROVIDER: S-EPMC5615544 | biostudies-literature | 2017 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the 'Black Box' of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda.

Renmans Dimitri D Holvoet Nathalie N Criel Bart B

International journal of environmental research and public health 20170903 9

Increased attention on "complexity" in health systems evaluation has resulted in many different methodological responses. Theory-driven evaluations and systems thinking are two such responses that aim for better understanding of the mechanisms underlying given outcomes. Here, we studied the implementation of a performance-based financing intervention by the Belgian Technical Cooperation in Western Uganda to illustrate a methodological strategy of combining these two approaches. We utilized a sys ...[more]

PMID: 28869518

Similar Datasets

Project description:BackgroundDemand for high-quality surveillance data for malaria, and other diseases, is greater than ever before. In Uganda, the primary source of malaria surveillance data is the Health Management Information System (HMIS). However, HMIS data may be incomplete, inaccurate or delayed. Collaborative improvement (CI) is a quality improvement intervention developed in high-income countries, which has been advocated for low-resource settings. In Kayunga, Uganda, a pilot study of CI was conducted in five public health centres, documenting a positive effect on the quality of HMIS and malaria surveillance data. A qualitative evaluation was conducted concurrently to investigate the mechanisms of effect and unintended consequences of the intervention, aiming to inform future implementation of CI.MethodsThe study intervention targeted health workers, including brief in-service training, plus CI with 'plan-do-study-act' (PDSA) cycles emphasizing self-reflection and group action, periodic learning sessions, and coaching from a CI mentor. Health workers collected data on standard HMIS out-patient registers. The qualitative evaluation (July 2015 to September 2016) included ethnographic observations at each health centre (over 12-14 weeks), in-depth interviews with health workers and stakeholders (n = 20), and focus group discussions with health workers (n = 6).ResultsThe results suggest that the intervention did facilitate improvement in data quality, but through unexpected mechanisms. The CI intervention was implemented as planned, but the PDSA cycles were driven largely by the CI mentor, not the health workers. In this context, characterized by a rigid hierarchy within the health system of limited culture of self-reflection and inadequate training and supervision, CI became an effective form of high-quality training with frequent supervisory visits. Health workers appeared motivated to improve data collection habits by their loyalty to the CI mentor and the potential for economic benefits, rather than a desire for self-improvement.ConclusionsCI is a promising method of quality improvement and could have a positive impact on malaria surveillance data. However, successful scale-up of CI in similar settings may require deployment of highly skilled mentors. Further research, focusing on the effectiveness of 'real world' mentors using robust study designs, will be required to determine whether CI can be translated effectively and sustainably to low-resource settings.

Project description:BACKGROUND:Malaria is a leading cause of paediatric morbidity and mortality in Uganda. More than half of febrile children in rural areas initially seek care at private clinics and drug shops. These shops are generally unregulated and the quality of clinical care is variable, with the potential for misdiagnosis and the development of drug resistance. There is thus an urgent need to identify rural drug shops and coordinate their malaria treatment efforts with those of the public sector. The objective of the study was to identify all drug shops in the Bugoye sub-county of Western Uganda and assess their anti-malarial dispensing practices. METHODS:This study is a cross-sectional survey of drug shops in a rural sub-county of Western Uganda. In the first phase, shop locations, licensing and shopkeeper's qualifications, and supply and pricing of anti-malarials were characterized. In the second phase, the proportion of anti-malarials dispensed by private drug shops was compared to public health facilities. RESULTS:A total of 48 drug shops were identified. Only one drug shop (1 of 48, 2%) was licensed with the sub-county's records office. The drug shops stocked a variety of anti-malarials, including first-line therapies and less effective agents (e.g., sulfadoxine/pyrimethamine). Almost all drug shops (45 of 48, 94%) provided parenteral anti-malarials. Of the 3900 individuals who received anti-malarials during the study, 2080 (53.3%) purchased anti-malarials through the private sector compared to 1820 (46.7%) who obtained anti-malarials through the public sector. Drug shops were the primary source of parenteral anti-malarials. Inadequate dosing of anti-malarials was more common in drug shops. CONCLUSIONS:Drug shops are major sources of parenteral anti-malarials, which should be reserved for cases of severe malaria. Strengthening malaria case management and incorporating drug shops in future interventions is necessary to optimize malaria control efforts in the sub-county, and in similarly endemic regions.

Dataset Information

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the 'Black Box' of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda.

Publications

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the 'Black Box' of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets