Dataset Information

Can routine health facility data be used to monitor subnational coverage of maternal, newborn and child health services in Uganda?

ABSTRACT:

Background

Routine health facility data are a critical source of local monitoring of progress and performance at the subnational level. Uganda has been using district health statistics from facility data for many years. We aimed to systematically assess data quality and examine different methods to obtain plausible subnational estimates of coverage for maternal, newborn and child health interventions.

Methods

Annual data from the Uganda routine health facility information system 2015-2019 for all 135 districts were used, as well as national surveys for external comparison and the identification of near-universal coverage interventions. The quality of reported data on antenatal and delivery care and child immunization was assessed through completeness of facility reporting, presence of extreme outliers and internal data consistencies. Adjustments were made when necessary. The denominators for the coverage indicators were derived from population projections and health facility data on near-universal coverage interventions. The coverage results with different denominators were compared with the results from household surveys.

Results

Uganda's completeness of reporting by facilities was near 100% and extreme outliers were rare. Inconsistencies in reported events, measured by annual fluctuations and between intervention consistency, were common and more among the 135 districts than the 15 subregions. The reported numbers of vaccinations were improbably high compared to the projected population of births or first antenatal visits - and especially so in 2015-2016. There were also inconsistencies between the population projections and the expected target population based on reported numbers of antenatal visits or immunizations. An alternative approach with denominators derived from facility data gave results that were more plausible and more consistent with survey results than based on population projections, although inconsistent results remained for substantive number of subregions and districts.

Conclusion

Our systematic assessment of the quality of routine reports of key events and denominators shows that computation of district health statistics is possible with transparent adjustments and methods, providing a general idea of levels and trends for most districts and subregions, but that improvements in data quality are essential to obtain more accurate monitoring.

SUBMITTER: Agiraembabazi G

PROVIDER: S-EPMC8436491 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThere are limited existing approaches to generate estimates from Routine Health Information Systems (RHIS) data, despite the growing interest to these data. We calculated and assessed the consistency of maternal and child health service coverage estimates from RHIS data, using census-based and health service-based denominators in Sierra Leone.MethodsWe used Sierra Leone 2016 RHIS data to calculate coverage of first antenatal care contact (ANC1), institutional delivery and diphtheria-pertussis-tetanus 3 (DPT3) immunization service provision. For each indicator, national and district level coverages were calculated using denominators derived from two census-based and three health service-based methods. We compared the coverage estimates from RHIS data to estimates from MICS 2017. We considered the agreement adequate when estimates from RHIS fell within the 95% confidence interval of the survey estimate.ResultsWe found an overall poor consistency of the coverage estimates calculated from the census-based methods. ANC1 and institutional delivery coverage estimates from these methods were greater than 100% in about half of the fourteen districts, and only 3 of the 14 districts had estimates consistent with the survey data. Health service-based methods generated better estimates. For institutional delivery coverage, five districts met the agreement criteria using BCG service-based method. We found better agreement for DPT3 coverage estimates using DPT1 service-based method as national coverage was close to survey data, and estimates were consistent for 8 out of 14 districts. DPT3 estimates were consistent in almost half of the districts (6/14) using ANC1 service-based method.ConclusionThe study highlighted the challenge in determining an appropriate denominator for RHIS-based coverage estimates. Systematic and transparent data quality check and correction, as well as rigorous approaches to determining denominators are key considerations to generate accurate coverage statistics using RHIS data.

Project description:Access to and utilisation of routine maternal and newborn health (MNH) services, such as antenatal care (ANC), and perinatal services, has increased over the last two decades in Nepal. The availability, delivery, and utilisation of quality health services during routine MNH visits can significantly impact the survival of mothers and newborns. Capacity of health facility is critical for the delivery of quality health services. However, little is known about health system readiness (structural quality) of health facilities for routine MNH services and associated determinants in Nepal. Data were derived from the Nepal Health Facility Survey (NHFS) 2015. Total of 901 health facilities were assessed for structural quality of ANC services, and 454 health facilities were assessed for perinatal services. Adapting the World Health Organization's Service Availability and Readiness Assessment manual, we estimated structural quality scores of health facilities for MNH services based on the availability and readiness of related subdomain-specific items. Several health facility-level characteristics were considered as independent variables. Logistic regression analyses were conducted, and the odds ratio (OR) was reported with 95% confidence intervals (CIs). The significance level was set at p-value of <0.05. The mean score of the structural quality of health facilities for ANC, and perinatal services was 0.62, and 0.67, respectively. The average score for the availability of staff (e.g., training) and guidelines-related items in health facilities was the lowest (0.37) compared to other four subdomains. The odds of optimal structural quality of health facilities for ANC services were higher in private health facilities (adjusted odds ratio (aOR) = 2.65, 95% CI: 1.48, 4.74), and health facilities supervised by higher authority (aOR = 1.96; CI: 1.22, 3.13) while peripheral health facilities had lower odds (aOR = 0.13; CI: 0.09, 0.18) compared to their reference groups. Private facilities were more likely (aOR = 1.69; CI:1.25, 3.40) to have optimal structural quality for perinatal services. Health facilities of Karnali (aOR = 0.29; CI: 0.09, 0.99) and peripheral areas had less likelihood (aOR = 0.16; CI: 0.10, 0.27) to have optimal structural quality for perinatal services. Provincial and local governments should focus on improving the health system readiness in peripheral and public facilities to deliver quality MNH services. Provision of trained staff and guidelines, and supply of laboratory equipment in health facilities could potentially equip facilities for optimal quality health services delivery. In addition, supervision of health staff and facilities and onsite coaching at peripheral areas from higher-level authorities could improve the health management functions and technical capacity for delivering quality MNH services. Local governments can prioritise inputs, including providing a trained workforce, supplying equipment for laboratory services, and essential medicine to improve the quality of MNH services in their catchment.

Project description:BackgroundAccurate measures of malaria incidence are essential to track progress and target high-risk populations. While health management information system (HMIS) data provide counts of malaria cases, quantifying the denominator for incidence using these data is challenging because catchment areas and care-seeking behaviours are not well defined. This study's aim was to estimate malaria incidence using HMIS data by adjusting the population denominator accounting for travel time to the health facility.MethodsOutpatient data from two public health facilities in Uganda (Kihihi and Nagongera) over a 3-year period (2011-2014) were used to model the relationship between travel time from patient village of residence (available for each individual) to the facility and the relative probability of attendance using Poisson generalized additive models. Outputs from the model were used to generate a weighted population denominator for each health facility and estimate malaria incidence. Among children aged 6 months to 11 years, monthly HMIS-derived incidence estimates, with and without population denominators weighted by probability of attendance, were compared with gold standard measures of malaria incidence measured in prospective cohorts.ResultsA total of 48,898 outpatient visits were recorded across the two sites over the study period. HMIS incidence correlated with cohort incidence over time at both study sites (correlation in Kihihi = 0.64, p < 0.001; correlation in Nagongera = 0.34, p = 0.045). HMIS incidence measures with denominators unweighted by probability of attendance underestimated cohort incidence aggregated over the 3 years in Kihihi (0.5 cases per person-year (PPY) vs 1.7 cases PPY) and Nagongera (0.3 cases PPY vs 3.0 cases PPY). HMIS incidence measures with denominators weighted by probability of attendance were closer to cohort incidence, but remained underestimates (1.1 cases PPY in Kihihi and 1.4 cases PPY in Nagongera).ConclusionsAlthough malaria incidence measured using HMIS underestimated incidence measured in cohorts, even when adjusting for probability of attendance, HMIS surveillance data are a promising and scalable source for tracking relative changes in malaria incidence over time, particularly when the population denominator can be estimated by incorporating information on village of residence.

Project description:BackgroundNationally representative household surveys are the gold standard for tracking progress in coverage of life-saving maternal and child interventions, but often do not provide timely information on coverage at the local and health facility level. Electronic routine health information system (RHIS) data could help provide this information, but there are currently concerns about data quality. This analysis seeks to improve the usability of and confidence in electronic RHIS data by using adjustments to calculate more accurate numerators and denominators for essential interventions.MethodsData from three sources (Ugandan Demographic and Health (UDHS) survey, electronic RHIS, and census) were used to provide estimates of essential maternal (> 4 antenatal care visits (ANC), skilled delivery, and postnatal care visit (PNC)) and child health interventions (diphtheria, pertussis, tetanus, and hepatitis B and Haemophilus influenzae type b and polio vaccination series, measles vaccination, and vitamin A). Electronic RHIS data was checked for quality and both numerators and denominators were adjusted to improve accuracy. Estimates were compared between the three sources.ResultsEstimates of maternal health interventions from adjusted electronic RHIS data were lower than those of the UDHS, while child intervention estimates were typically higher. Adjustment of electronic RHIS data generally improved accuracy compared with no adjustment. There was considerable agreement between estimates from adjusted, electronic RHIS data, and UDHS for skilled delivery and first dose of childhood vaccination series, but lesser agreement for ANC visits and second and third doses of childhood vaccinations.ConclusionsNationally representative household surveys will likely continue being the gold standard of coverage estimates of maternal and child health interventions, but this analysis shows that current approaches to adjusting health facility estimate works better for some indications than others. Further efforts to improve accuracy of estimates from RHIS sources are needed.

Project description:BackgroundMaternal and neonatal mortality in Uganda remain persistently high. While utilisation of maternal health services has been shown to reduce the risk of maternal death, little is known about the inequalities in utilisation of maternal health services in Uganda. This study examined the inequalities in utilisation of maternal health services between 2006 and 2016 to draw implications for achieving universal health coverage.MethodsWe used the Uganda Demographic Health Survey 2006, 2011 and 2016 to analyse inequalities in utilisation of antenatal care (ANC4+), skilled birth attendance (SBA), postnatal care (PNC) and a package of maternal health services. Equity ratios, concentration curves, concentration indices and regression analysis were used in the estimations.ResultsInequalities in utilization of single and a package of maternal health services reduced between 2005 and 2016, but remained pro-rich. Inequalities in utilisation of package of maternal health services were greater than for a single service. Women from the richest quintile were 4 times more likely to receive a package of care compared to the poorest women, but were just 1.5 times more likely to receive ANC4 + than those in the poorest quintile. In 2006 women in urban areas were 2.6 times more likely to receive a package of all three maternal health services than their rural counterpart and they had a relative advantage of 23.4% to utilize skilled birth delivery than the poorest women. Each additional year of schooling and living in urban areas was associated with 1.2 and 1.6% point increase in utilisation of a package of care respectively. Wealth, education and living in urban areas were positively associated with utilisation of all maternal healthcare.ConclusionDeclining inequalities in utilisation of maternal healthcare reflect a move towards achieving universal health coverage in Uganda. Pro-rich, education and urban-biased inequalities, imply the need for targeted interventions for the poor, less educated and rural women. Targeted voucher schemes, free distribution of birth kits for poorer and rural women, community-level mobilization to improve uptake of postnatal care, and promoting women's education and incomes are feasible interventions to improve utilisation of maternal health services and equity.

Project description:Background Cervical cancer is ranked globally in the top three cancers for women younger than 45 years, with the average age of death at 59 years of age. The highest burden of disease is in low-to-middle income countries (LMICs), responsible for 90% of the 311,000 cervical cancer deaths in 2018. This growing health disparity is due to the lack of quality screening and treatment programs, low human papillomavirus (HPV) vaccination rates, and high human immunodeficiency virus (HIV) co-infection rates. To address these gaps in care, we need to develop a clear understanding of the resources and capabilities of LMICs’ health care facilities to provide prevention, early diagnosis through screening, and treatment for cervical cancer. Objectives This project aimed to assess baseline available cervical cancer prevention, early diagnosis, and treatment resources, at facilities designated as Health Center III or above, in Gulu, Uganda. Methods We adapted the World Health Organization’s Harmonized Health Facility Assessment for our own HFA and grading scale, deploying it in October 2021 for a cross-sectional analysis of 21 health facilities in Gulu. Results Grading of Health Center IIIs (n = 16) concluded that 37% had “excellent” or “good” resources available, and 63% of facilities had “poor” or “fair” resources available. Grading of Health Center IVs and above (n = 5) concluded that 60% of facilities had “excellent” or “good” resources, and 40% had “fair” resources available. Discussion The analysis of health facilities in Gulu demonstrated subpar resources available for cervical cancer prevention, early diagnosis, and treatment. Focused efforts are needed to expand health centers’ resources and capability to address rising cervical cancer rates and related health disparities in LMICs. The development process for this project’s HFA can be applied to global cervical cancer programming to determine gaps in resources and indicate areas to target improved health equity.

Project description:BackgroundAntenatal care (ANC) visits, institutional delivery, and postnatal care (PNC) visits are vital to improve the health of mothers and newborns. Despite improved access to these routine maternal and newborn health (MNH) services in Nepal, little is known about the cascade of health service coverage, particularly contact coverage, intervention-specific coverage, and quality-adjusted coverage of MNH services. This study examined the cascade of MNH services coverage, as well as social determinants associated with uptake of quality MNH services in Nepal.MethodsWe conducted a secondary analysis of data derived from the Nepal Demographic and Health Survey (NDHS) 2016, taking 1978 women aged 15-49 years who had a live birth in the 2 years preceding the survey. Three outcome variables were (i) four or more (4+) ANC visits, (ii) institutional delivery, and (iii) first PNC visit for mothers and newborns within 48 h of childbirth. We applied a cascade of health services coverage, including contact coverage, intervention-specific and quality-adjusted coverage, using a list of specific intervention components for each outcome variable. Several social determinants of health were included as independent variables to identify determinants of uptake of quality MNH services. We generated a quality score for each outcome variable and dichotomised the scores into two categories of "poor" and "optimal" quality, considering > 0.8 as a cut-off point. Binomial logistic regression was conducted and odds ratios (OR) were reported with 95% confidence intervals (CIs) at the significance level of p < 0.05 (two-tailed).ResultsContact coverage was higher than intervention-specific coverage and quality-adjusted coverage across all MNH services. Women with advantaged ethnicities or who had access to bank accounts had higher odds of receiving optimal quality MNH services, while women who speak the Maithili language and who had high birth order (≥ 4) had lower odds of receiving optimal quality ANC services. Women who received better quality ANC services had higher odds of receiving optimal quality institutional delivery. Women received poor quality PNC services if they were from remote provinces, had higher birth order and perceived problems when not having access to female providers.ConclusionsWomen experiencing ethnic and social disadvantages, and from remote provinces received poor quality MNH services. The quality-adjusted coverage can be estimated using household survey data, such as demographic and health surveys, especially in countries with limited routine data. Policies and programs should focus on increasing quality of MNH services and targeting disadvantaged populations and those living in remote areas. Ensuring access to female health providers and improving the quality of earlier maternity visits could improve the quality of health care during the pregnancy-delivery-postnatal period.

Project description:BackgroundCurrently many measures of intervention coverage obtained from household surveys do not measure actual health intervention/service delivery, resulting in a need for linking reports of care-seeking with assessments of the service environment in order to improve measurements. This systematic review aims to identify evidence of different methods used to link household surveys and service provision assessments, with a focus on reproductive, maternal, newborn and child health care, in low- and middle-income countries.MethodsUsing pre-defined search terms, articles published in peer-reviewed journals and the grey literature after 1990 were identified, their reference lists scanned and linking methods synthesized.FindingsA total of 59 articles and conference presentations were carefully reviewed and categorized into two groups based on the linking method used: 1) indirect/ecological linking that included studies in which health care-seeking behavior was linked to all or the nearest facilities or providers of certain types within a geographical area, and 2) direct linking/exact matching where individuals were linked with the exact provider or facility where they sought care. The former approach was employed in 51 of 59 included studies, and was particularly common among studies that were based on independent sources of household and facility data that were nationally representative. Only eight of the 59 reviewed studies employed direct linking methods, which were typically done at the sub-national level (eg, district level) and often in rural areas, where the number of providers was more limited compared to urban areas.ConclusionsDifferent linking methods have been reported in the literature, each category has its own set of advantages and limitations, in terms of both methodology and practicality for scale-up. Future studies that link household and provider/facility data should also take into account factors such as sources of data, the timing of surveys, the temporality of data points, the type of services and interventions, and the scale of the study in order to produce valid and reliable results.

Project description:Poor quality of health services and socio-cultural dynamics may severely limit utilization of health services. Facility health committees were established in several states in northern Nigeria to reduce these barriers. The committees were charged with mobilizing communities, improving quality of health services, and promoting utilization of maternal and child health services. This study assessed this intervention.To obtain a comprehensive picture of facility health committees' influence on maternal and child health services, we selected 33 facilities in three states in northern Nigeria (Jigawa, Kaduna, Kano) where the intervention was active. For each of these facilities we interviewed committee members (n =?399), conducted focus group discussions with a subset of committee members (18 focus groups), interviewed facility health providers (two providers from each facility), and conducted client exit interviews (n =?501).Facility health committees appear to have a positive influence on quality of maternal and child health services in the selected facilities. Committee members, health providers, and facility clients all agree that the committees have a tangible positive effect. The most important roles of the committees are to mobilize the community and increase demand for maternal and child health services, in a region where demand is very low. Committee activities further improve health services in many ways, including advocacy, community-facility coordination, fund raising, money donation, and problem mitigation.Facility health committees can be invaluable in contributing to improved demand for and access to quality maternal and child health services in health facilities in northern Nigeria. They provide strong linkages between community members and the health facilities, directly work to increase demand for services, and address supply-side challenges that often limit utilization of services in health facilities. The intervention can be improved by more broadly communicating committee activities in the community, and by incentivizing facility health committee members.