Dataset Information

Can routine health facility data be used to monitor subnational coverage of maternal, newborn and child health services in Uganda?

ABSTRACT:

Background

Routine health facility data are a critical source of local monitoring of progress and performance at the subnational level. Uganda has been using district health statistics from facility data for many years. We aimed to systematically assess data quality and examine different methods to obtain plausible subnational estimates of coverage for maternal, newborn and child health interventions.

Methods

Annual data from the Uganda routine health facility information system 2015-2019 for all 135 districts were used, as well as national surveys for external comparison and the identification of near-universal coverage interventions. The quality of reported data on antenatal and delivery care and child immunization was assessed through completeness of facility reporting, presence of extreme outliers and internal data consistencies. Adjustments were made when necessary. The denominators for the coverage indicators were derived from population projections and health facility data on near-universal coverage interventions. The coverage results with different denominators were compared with the results from household surveys.

Results

Uganda's completeness of reporting by facilities was near 100% and extreme outliers were rare. Inconsistencies in reported events, measured by annual fluctuations and between intervention consistency, were common and more among the 135 districts than the 15 subregions. The reported numbers of vaccinations were improbably high compared to the projected population of births or first antenatal visits - and especially so in 2015-2016. There were also inconsistencies between the population projections and the expected target population based on reported numbers of antenatal visits or immunizations. An alternative approach with denominators derived from facility data gave results that were more plausible and more consistent with survey results than based on population projections, although inconsistent results remained for substantive number of subregions and districts.

Conclusion

Our systematic assessment of the quality of routine reports of key events and denominators shows that computation of district health statistics is possible with transparent adjustments and methods, providing a general idea of levels and trends for most districts and subregions, but that improvements in data quality are essential to obtain more accurate monitoring.

SUBMITTER: Agiraembabazi G

PROVIDER: S-EPMC8436491 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThere are limited existing approaches to generate estimates from Routine Health Information Systems (RHIS) data, despite the growing interest to these data. We calculated and assessed the consistency of maternal and child health service coverage estimates from RHIS data, using census-based and health service-based denominators in Sierra Leone.MethodsWe used Sierra Leone 2016 RHIS data to calculate coverage of first antenatal care contact (ANC1), institutional delivery and diphtheria-pertussis-tetanus 3 (DPT3) immunization service provision. For each indicator, national and district level coverages were calculated using denominators derived from two census-based and three health service-based methods. We compared the coverage estimates from RHIS data to estimates from MICS 2017. We considered the agreement adequate when estimates from RHIS fell within the 95% confidence interval of the survey estimate.ResultsWe found an overall poor consistency of the coverage estimates calculated from the census-based methods. ANC1 and institutional delivery coverage estimates from these methods were greater than 100% in about half of the fourteen districts, and only 3 of the 14 districts had estimates consistent with the survey data. Health service-based methods generated better estimates. For institutional delivery coverage, five districts met the agreement criteria using BCG service-based method. We found better agreement for DPT3 coverage estimates using DPT1 service-based method as national coverage was close to survey data, and estimates were consistent for 8 out of 14 districts. DPT3 estimates were consistent in almost half of the districts (6/14) using ANC1 service-based method.ConclusionThe study highlighted the challenge in determining an appropriate denominator for RHIS-based coverage estimates. Systematic and transparent data quality check and correction, as well as rigorous approaches to determining denominators are key considerations to generate accurate coverage statistics using RHIS data.

Project description:BackgroundAccurate measures of malaria incidence are essential to track progress and target high-risk populations. While health management information system (HMIS) data provide counts of malaria cases, quantifying the denominator for incidence using these data is challenging because catchment areas and care-seeking behaviours are not well defined. This study's aim was to estimate malaria incidence using HMIS data by adjusting the population denominator accounting for travel time to the health facility.MethodsOutpatient data from two public health facilities in Uganda (Kihihi and Nagongera) over a 3-year period (2011-2014) were used to model the relationship between travel time from patient village of residence (available for each individual) to the facility and the relative probability of attendance using Poisson generalized additive models. Outputs from the model were used to generate a weighted population denominator for each health facility and estimate malaria incidence. Among children aged 6 months to 11 years, monthly HMIS-derived incidence estimates, with and without population denominators weighted by probability of attendance, were compared with gold standard measures of malaria incidence measured in prospective cohorts.ResultsA total of 48,898 outpatient visits were recorded across the two sites over the study period. HMIS incidence correlated with cohort incidence over time at both study sites (correlation in Kihihi = 0.64, p < 0.001; correlation in Nagongera = 0.34, p = 0.045). HMIS incidence measures with denominators unweighted by probability of attendance underestimated cohort incidence aggregated over the 3 years in Kihihi (0.5 cases per person-year (PPY) vs 1.7 cases PPY) and Nagongera (0.3 cases PPY vs 3.0 cases PPY). HMIS incidence measures with denominators weighted by probability of attendance were closer to cohort incidence, but remained underestimates (1.1 cases PPY in Kihihi and 1.4 cases PPY in Nagongera).ConclusionsAlthough malaria incidence measured using HMIS underestimated incidence measured in cohorts, even when adjusting for probability of attendance, HMIS surveillance data are a promising and scalable source for tracking relative changes in malaria incidence over time, particularly when the population denominator can be estimated by incorporating information on village of residence.

Project description:BackgroundNationally representative household surveys are the gold standard for tracking progress in coverage of life-saving maternal and child interventions, but often do not provide timely information on coverage at the local and health facility level. Electronic routine health information system (RHIS) data could help provide this information, but there are currently concerns about data quality. This analysis seeks to improve the usability of and confidence in electronic RHIS data by using adjustments to calculate more accurate numerators and denominators for essential interventions.MethodsData from three sources (Ugandan Demographic and Health (UDHS) survey, electronic RHIS, and census) were used to provide estimates of essential maternal (> 4 antenatal care visits (ANC), skilled delivery, and postnatal care visit (PNC)) and child health interventions (diphtheria, pertussis, tetanus, and hepatitis B and Haemophilus influenzae type b and polio vaccination series, measles vaccination, and vitamin A). Electronic RHIS data was checked for quality and both numerators and denominators were adjusted to improve accuracy. Estimates were compared between the three sources.ResultsEstimates of maternal health interventions from adjusted electronic RHIS data were lower than those of the UDHS, while child intervention estimates were typically higher. Adjustment of electronic RHIS data generally improved accuracy compared with no adjustment. There was considerable agreement between estimates from adjusted, electronic RHIS data, and UDHS for skilled delivery and first dose of childhood vaccination series, but lesser agreement for ANC visits and second and third doses of childhood vaccinations.ConclusionsNationally representative household surveys will likely continue being the gold standard of coverage estimates of maternal and child health interventions, but this analysis shows that current approaches to adjusting health facility estimate works better for some indications than others. Further efforts to improve accuracy of estimates from RHIS sources are needed.

Project description:BackgroundCurrently many measures of intervention coverage obtained from household surveys do not measure actual health intervention/service delivery, resulting in a need for linking reports of care-seeking with assessments of the service environment in order to improve measurements. This systematic review aims to identify evidence of different methods used to link household surveys and service provision assessments, with a focus on reproductive, maternal, newborn and child health care, in low- and middle-income countries.MethodsUsing pre-defined search terms, articles published in peer-reviewed journals and the grey literature after 1990 were identified, their reference lists scanned and linking methods synthesized.FindingsA total of 59 articles and conference presentations were carefully reviewed and categorized into two groups based on the linking method used: 1) indirect/ecological linking that included studies in which health care-seeking behavior was linked to all or the nearest facilities or providers of certain types within a geographical area, and 2) direct linking/exact matching where individuals were linked with the exact provider or facility where they sought care. The former approach was employed in 51 of 59 included studies, and was particularly common among studies that were based on independent sources of household and facility data that were nationally representative. Only eight of the 59 reviewed studies employed direct linking methods, which were typically done at the sub-national level (eg, district level) and often in rural areas, where the number of providers was more limited compared to urban areas.ConclusionsDifferent linking methods have been reported in the literature, each category has its own set of advantages and limitations, in terms of both methodology and practicality for scale-up. Future studies that link household and provider/facility data should also take into account factors such as sources of data, the timing of surveys, the temporality of data points, the type of services and interventions, and the scale of the study in order to produce valid and reliable results.

Project description:Poor quality of health services and socio-cultural dynamics may severely limit utilization of health services. Facility health committees were established in several states in northern Nigeria to reduce these barriers. The committees were charged with mobilizing communities, improving quality of health services, and promoting utilization of maternal and child health services. This study assessed this intervention.To obtain a comprehensive picture of facility health committees' influence on maternal and child health services, we selected 33 facilities in three states in northern Nigeria (Jigawa, Kaduna, Kano) where the intervention was active. For each of these facilities we interviewed committee members (n =?399), conducted focus group discussions with a subset of committee members (18 focus groups), interviewed facility health providers (two providers from each facility), and conducted client exit interviews (n =?501).Facility health committees appear to have a positive influence on quality of maternal and child health services in the selected facilities. Committee members, health providers, and facility clients all agree that the committees have a tangible positive effect. The most important roles of the committees are to mobilize the community and increase demand for maternal and child health services, in a region where demand is very low. Committee activities further improve health services in many ways, including advocacy, community-facility coordination, fund raising, money donation, and problem mitigation.Facility health committees can be invaluable in contributing to improved demand for and access to quality maternal and child health services in health facilities in northern Nigeria. They provide strong linkages between community members and the health facilities, directly work to increase demand for services, and address supply-side challenges that often limit utilization of services in health facilities. The intervention can be improved by more broadly communicating committee activities in the community, and by incentivizing facility health committee members.

Project description:BackgroundLatin America (LA) has experienced constant economic and political crises that coincide with periods of greater inequality. Between 1996 and 2007 Ecuador went through one of the greatest political and socio-economic crises in Latin America, a product of neo-liberal economic growth strategies. Between 2007 and 2012 it regained political stability, promoted redistributive policies, and initiated greater social spending. To understand the possible influence on the political and economic context, we analyzed the coverage and inequalities in five Reproductive, Maternal, and Child Health (RMNCH) and two water and sanitation interventions using survey data from a broad time window (1994-2012), at a national and subnational level.MethodsThe series cross-sectional study used data from four representative national health surveys (1994, 1999, 2004 and 2012). Coverage of RMNCH and sanitary interventions were stratified by wealth quintiles (as a measure of the socio-economic level), urban-rural residence and the coverage for each province was mapped. Mean difference, Theil index and Variance-weighted least squares regression were calculated to indicate subnational and temporal changes.ResultsFrom 1994 to 2004, Ecuador evidenced large inequalities whose reduction becomes more evident in 2012. Coverage in RMNCH health service-related interventions showed a rather unequal distribution among the socioeconomic status and across provinces in 1994 and 2004, compared to 2012. Sanitary interventions on the contrary, showed the most unequal interventions, and failed to improve or even worsened in several provinces. While there is a temporary improvement also at the subnational level, in 2012 several provinces maintain low levels of coverage.ConclusionsThe remarkable reduction of inequalities in coverage of RMNCH interventions in 2012 clearly coincides with periods of regained political stability, promoted redistributive policies, and greater social spending, different from the former neo-liberal reforms which is consistent with observations made in other Latin American countries. Territorial heterogeneity and great inequalities specially related with sanitation interventions persists. It is necessary to obtain high quality information with sharper geographic desegregation that allows to identify and understand local changes over time. This would help to prioritize intervention strategies, introduce multisectoral policies and investments that support local governments.

Project description:BackgroundHealth facility characteristics associated with effective prevention of mother-to-child transmission of HIV (PMTCT) coverage in sub-Saharan are poorly understood.Methodology/principal findingsWe conducted surveys in health facilities with active PMTCT services in Cameroon, Cote d'Ivoire, South Africa, and Zambia. Data was compiled via direct observation and exit interviews. We constructed composite scores to describe provision of PMTCT services across seven topical areas: antenatal quality, PMTCT quality, supplies available, patient satisfaction, patient understanding of medication, and infrastructure quality. Pearson correlations and Generalized Estimating Equations (GEE) to account for clustering of facilities within countries were used to evaluate the relationship between the composite scores, total time of visit and select individual variables with PMTCT coverage among women delivering. Between July 2008 and May 2009, we collected data from 32 facilities; 78% were managed by the government health system. An opt-out approach for HIV testing was used in 100% of facilities in Zambia, 63% in Cameroon, and none in Côte d'Ivoire or South Africa. Using Pearson correlations, PMTCT coverage (median of 55%, (IQR: 33-68) was correlated with PMTCT quality score (rho?=?0.51; p?=?0.003); infrastructure quality score (rho?=?0.43; p?=?0.017); time spent at clinic (rho?=?0.47; p?=?0.013); patient understanding of medications score (rho?=?0.51; p?=?0.006); and patient satisfaction quality score (rho?=?0.38; p?=?0.031). PMTCT coverage was marginally correlated with the antenatal quality score (rho?=?0.304; p?=?0.091). Using GEE adjustment for clustering, the, antenatal quality score became more strongly associated with PMTCT coverage (p<0.001) and the PMTCT quality score and patient understanding of medications remained marginally significant.Conclusions/resultsWe observed a positive relationship between an antenatal quality score and PMTCT coverage but did not identify a consistent set of variables that predicted PMTCT coverage.

Project description:IntroductionOperationalizing effective subnational veterinary services as major contributor to disease surveillance, reporting, diagnoses and One Health requires resources and mindset change. Here we describe workforce capacity building in animal health in Kenya and an approach that can be used to skill-up this workforce to respond beyond animal health challenges to emergent One Health realities and public health emergencies. Furthermore, triggering a paradigm shift has been identified for impactful delivery of health services, thus mindset change are important for learning new skills, but they also affect the way that we think about everything, for instance training in field epidemiology. Emphasis was therefore placed on skills, beliefs, and mindset shift.MethodsContextualized within the Kenyan environment, this description identifies problems likely to be found elsewhere: They are (a) The limited programs that offer structured and routine on-the-job training for animal health workers; (b) Unequal distribution and inadequate quantity and quality of highly skilled workforce with appropriate technical training and scientific skills to combat public (and animal) health challenges at the frontline; (c) Health challenges occasioned by climate change and drought, including feed, and water scarcity; and (d) Inadequate contingency, preparedness, and response planning for effective deployment of ready-to-trigger workforce capacity. In-Service Applied Veterinary Epidemiology Training (ISAVET) is a four-month long training program targeted at capacity building of frontline animal health professionals. The training, which is currently implemented in 17 African countries, is innovative and a customized field epidemiology program, which responds to specific needs in animal health and contribute to approaches utilizing One Health.ResultsSeveral trainees have marked mindset change as shown in the outputs and outcomes. Positive attitudes towards improving animal health surveillance were noted during the evaluation process.Discussion and conclusionMost existing workforce capacities in the animal and public health systems were built for specific fields, and hardly respond optimally for cross-sectoral purposes. We proposed customised in-service applied veterinary epidemiology training that bypasses narrow-scoped workforce development but meets multifunctional, multidisciplinary and multisectoral needs before and during emergencies.