Dataset Information

Linking household and facility data for better coverage measures in reproductive, maternal, newborn, and child health care: systematic review.

ABSTRACT:

Background

Currently many measures of intervention coverage obtained from household surveys do not measure actual health intervention/service delivery, resulting in a need for linking reports of care-seeking with assessments of the service environment in order to improve measurements. This systematic review aims to identify evidence of different methods used to link household surveys and service provision assessments, with a focus on reproductive, maternal, newborn and child health care, in low- and middle-income countries.

Methods

Using pre-defined search terms, articles published in peer-reviewed journals and the grey literature after 1990 were identified, their reference lists scanned and linking methods synthesized.

Findings

A total of 59 articles and conference presentations were carefully reviewed and categorized into two groups based on the linking method used: 1) indirect/ecological linking that included studies in which health care-seeking behavior was linked to all or the nearest facilities or providers of certain types within a geographical area, and 2) direct linking/exact matching where individuals were linked with the exact provider or facility where they sought care. The former approach was employed in 51 of 59 included studies, and was particularly common among studies that were based on independent sources of household and facility data that were nationally representative. Only eight of the 59 reviewed studies employed direct linking methods, which were typically done at the sub-national level (eg, district level) and often in rural areas, where the number of providers was more limited compared to urban areas.

Conclusions

Different linking methods have been reported in the literature, each category has its own set of advantages and limitations, in terms of both methodology and practicality for scale-up. Future studies that link household and provider/facility data should also take into account factors such as sources of data, the timing of surveys, the temporality of data points, the type of services and interventions, and the scale of the study in order to produce valid and reliable results.

SUBMITTER: Do M

PROVIDER: S-EPMC5012234 | biostudies-literature | 2016 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Linking household and facility data for better coverage measures in reproductive, maternal, newborn, and child health care: systematic review.

Do Mai M Micah Angela A Brondi Luciana L Campbell Harry H Marchant Tanya T Eisele Thomas T Munos Melinda M

Journal of global health 20161201 2

<h4>Background</h4>Currently many measures of intervention coverage obtained from household surveys do not measure actual health intervention/service delivery, resulting in a need for linking reports of care-seeking with assessments of the service environment in order to improve measurements. This systematic review aims to identify evidence of different methods used to link household surveys and service provision assessments, with a focus on reproductive, maternal, newborn and child health care, ...[more]

PMID: 27606060

Similar Datasets

Project description:BACKGROUND:Monitoring universal health coverage in reproductive, maternal and child health requires appropriate indicators for assessing coverage and equity. In 2008, the composite coverage index (CCI)-a weighted average of eight indicators reflecting family planning, antenatal and delivery care, immunizations and management of childhood illnesses-was proposed. In 2017, the CCI formula was revised to update the family planning and diarrhea management indicators. We explored the implications of adding new indicators to the CCI. METHODS:We analysed nationally representative surveys to investigate how addition of early breastfeeding initiation (EIBF), tetanus toxoid during pregnancy and post-natal care for babies affected CCI levels and the magnitude of wealth-related inequalities. We used Pearson's correlation coefficient to compare different formulations, and the slope index of inequalities [SII] and concentration index [CIX] to assess absolute and relative inequalities, respectively. RESULTS:47 national surveys since 2010 had data on the eight variables needed for the original and revised formulations, and on EIBF, tetanus vaccine and postnatal care, related to newborn care. The original CCI showed the highest average value (65.5%), which fell to 56.9% when all 11 indicators were included. Correlation coefficients between pairs of all formulations ranged from 0.93 to 0.99. When analysed separately, 10 indicators showed higher coverage with increasing wealth; the exception was EIBF (SII = -2.1; CIX = -0.5). Inequalities decreased when other indicators were added, especially EIBF-the SII fell from 24.8 pp. to 19.2 pp.; CIX from 7.6 to 6.1. The number of countries with data from two or more surveys since 2010 was 30 for the original and revised formulations and 15 when all the 11 indicators were included. CONCLUSIONS:Given the growing importance of newborn mortality, it would be desirable to include relevant coverage indicators in the CCI, but this would lead a reduction in data availability, and an underestimation of coverage inequalities. We propose that the 2017 version of the revised CCI should continue to be used.

Project description:ImportancePrevious work has underscored subnational inequalities that could impede additional health gains in Kenya.ObjectiveTo provide a comprehensive assessment of the burden, distribution, and change in inequalities in reproductive, maternal, newborn, child, and adolescent health (RMNCAH) interventions in Kenya from 2003 to 2014.Design, setting, and participantsThis population-based cross-sectional study used data from the 2003, 2008, and 2014 Kenya Demographic and Health Surveys. The study included women of reproductive age (ages 15-49 years) and children younger than years, with national, regional, county, and subcounty level representation. Data analysis was conducted from April 2018 to November 2018.ExposuresSocioeconomic position that was derived from asset indices and presented as wealth quintiles. Urban and rural residence and regions of Kenya were also considered.Main outcomes and measuresAbsolute and relative measures of inequality in coverage of RMNCAH interventions.ResultsFor this analysis, representative samples of 31 380 women of reproductive age and 29 743 children younger than 5 years from across Kenya were included. The RMNCAH interventions examined demonstrated pro-rich and bottom inequality patterns. The most inequitable interventions were skilled birth attendance, family planning needs satisfied, and 4 or more antenatal care visits, whereby the absolute difference in coverage between the wealthiest (quintile 5) and poorest quintiles (quintile 1) was 61.6% (95% CI, 60.1%-63.1%), 33.4% (95% CI, 31.9%-34.9%), and 31.0% (95% CI, 30.5%-31.6%), respectively. The most equitable intervention was early initiation of breastfeeding, with an absolute difference (quintile 5 minus quintile 1) of -7.9% (95% CI, -11.1% to -4.8%), although antenatal care (1 visit) and diphtheria-tetanus-pertussis immunization (3 doses) demonstrated the best combination of high coverage and low inequalities. Our geospatial analysis revealed significant socioeconomic disparities in the northern and eastern regions of Kenya that have translated to suboptimal intervention coverage. A significant gap remains for rural, disadvantaged populations.Conclusions and relevanceCoverage of RMNCAH interventions has improved over time, but wealth and geospatial inequalities in Kenya are persistent. Policy and programming efforts should place more emphasis on improving the accessibility of health facility-based interventions, which generally demonstrate poor coverage and high inequalities, and focus on integrated approaches to maternal health service delivery at the community level when access is poor. Scaling up of health services for the urban and, in particular, rural poor areas and those residing in Kenya's former north eastern province will contribute toward achievement of universal health coverage.

Project description:BackgroundRoutine health facility data are a critical source of local monitoring of progress and performance at the subnational level. Uganda has been using district health statistics from facility data for many years. We aimed to systematically assess data quality and examine different methods to obtain plausible subnational estimates of coverage for maternal, newborn and child health interventions.MethodsAnnual data from the Uganda routine health facility information system 2015-2019 for all 135 districts were used, as well as national surveys for external comparison and the identification of near-universal coverage interventions. The quality of reported data on antenatal and delivery care and child immunization was assessed through completeness of facility reporting, presence of extreme outliers and internal data consistencies. Adjustments were made when necessary. The denominators for the coverage indicators were derived from population projections and health facility data on near-universal coverage interventions. The coverage results with different denominators were compared with the results from household surveys.ResultsUganda's completeness of reporting by facilities was near 100% and extreme outliers were rare. Inconsistencies in reported events, measured by annual fluctuations and between intervention consistency, were common and more among the 135 districts than the 15 subregions. The reported numbers of vaccinations were improbably high compared to the projected population of births or first antenatal visits - and especially so in 2015-2016. There were also inconsistencies between the population projections and the expected target population based on reported numbers of antenatal visits or immunizations. An alternative approach with denominators derived from facility data gave results that were more plausible and more consistent with survey results than based on population projections, although inconsistent results remained for substantive number of subregions and districts.ConclusionOur systematic assessment of the quality of routine reports of key events and denominators shows that computation of district health statistics is possible with transparent adjustments and methods, providing a general idea of levels and trends for most districts and subregions, but that improvements in data quality are essential to obtain more accurate monitoring.

Project description:BackgroundAccurate data on coverage of key maternal, newborn, and child health (MNCH) interventions are crucial for monitoring progress toward the Millennium Development Goals 4 and 5. Coverage estimates are primarily obtained from routine population surveys through self-reporting, the validity of which is not well understood. We aimed to examine the validity of the coverage of selected MNCH interventions in Gongcheng County, China.Method and findingsWe conducted a validation study by comparing women's self-reported coverage of MNCH interventions relating to antenatal and postnatal care, mode of delivery, and child vaccinations in a community survey with their paper- and electronic-based health care records, treating the health care records as the reference standard. Of 936 women recruited, 914 (97.6%) completed the survey. Results show that self-reported coverage of these interventions had moderate to high sensitivity (0.57 [95% confidence interval (CI): 0.50-0.63] to 0.99 [95% CI: 0.98-1.00]) and low to high specificity (0 to 0.83 [95% CI: 0.80-0.86]). Despite varying overall validity, with the area under the receiver operating characteristic curve (AUC) ranging between 0.49 [95% CI: 0.39-0.57] and 0.90 [95% CI: 0.88-0.92], bias in the coverage estimates at the population level was small to moderate, with the test to actual positive (TAP) ratio ranging between 0.8 and 1.5 for 24 of the 28 indicators examined. Our ability to accurately estimate validity was affected by several caveats associated with the reference standard. Caution should be exercised when generalizing the results to other settings.ConclusionsThe overall validity of self-reported coverage was moderate across selected MNCH indicators. However, at the population level, self-reported coverage appears to have small to moderate degree of bias. Accuracy of the coverage was particularly high for indicators with high recorded coverage or low recorded coverage but high specificity. The study provides insights into the accuracy of self-reports based on a population survey in low- and middle-income countries. Similar studies applying an improved reference standard are warranted in the future.

Project description:BackgroundPopulation-based measures of intervention coverage are used in low- and middle-income countries for program planning, prioritization, and evaluation. There is increased interest in effective coverage, which integrates information about service quality or health outcomes. Approaches proposed for quality-adjusted effective coverage include linking data on need and service contact from population-based surveys with data on service quality from health facility surveys. However, there is limited evidence about the validity of different linking methods for effective coverage estimation.MethodsWe collaborated with the 2016 Côte d'Ivoire Multiple Indicator Cluster Survey (MICS) to link data from a health provider assessment to care-seeking data collected by the MICS in the Savanes region of Côte d'Ivoire. The provider assessment was conducted in a census of public and non-public health facilities and pharmacies in Savanes in May-June 2016. We also included community health workers managing sick children who served the clusters sampled for the MICS. The provider assessment collected information on structural and process quality for antenatal care, delivery and immediate newborn care, postnatal care, and sick child care. We linked the MICS and provider data using exact-match and ecological linking methods, including aggregate linking and geolinking methods. We compared the results obtained from exact-match and ecological methods.ResultsWe linked 731 of 786 care-seeking episodes (93%) from the MICS to a structural quality score for the provider named by the respondent. Effective coverage estimates computed using exact-match methods were 13%-63% lower than the care-seeking estimates from the MICS. Absolute differences between exact match and ecological linking methods were ±7 percentage points for all ecological methods. Incorporating adjustments for provider category and weighting by service-specific utilization into the ecological methods generally resulted in better agreement between ecological and exact match estimates.ConclusionsEcological linking may be a feasible and valid approach for estimating quality-adjusted effective coverage when a census of providers is used. Adjusting for provider type and caseload may improve agreement with exact match results. There remain methodological questions to be addressed to develop guidance on using linking methods for estimating quality-adjusted effective coverage, including the effect of facility sampling and time displacement.

Project description:Calls have been made for improved measurement of coverage for maternal, newborn and child health interventions. Recently, methods linking household and health facility surveys have been used to improve estimation of intervention coverage. However, linking methods rely the availability of household and health facility surveys which are temporally matched. Because nationally representative health facility assessments are not yet routinely conducted in many low and middle income countries, estimates of intervention coverage based on linking methods can be produced for only a subset of countries. Estimates of intervention coverage are a critical input for modelling the health impact of intervention scale-up in the Lives Saved Tool (LiST). The purpose of this study was to develop a data-driven approach to estimate coverage for a subset of antenatal care interventions modeled in LiST.Using a five-step process, estimates of population level coverage for syphilis detection and treatment, case management of diabetes, malaria infection, hypertensive disorders, and pre-eclampsia, were computed by linking household and health facility surveys. Based on data characterizing antenatal care and estimates of coverage derived from the linking approach, predictive models for intervention coverage were developed. Updated estimates of coverage based on the predictive models were compared, first with current default proxies, then with estimates based on the linking approach. Model fit and accuracy were assessed using three measures: the coefficient of determination, Pearson's correlation coefficient, and the root mean square error (RMSE).The ability to predict intervention coverage was fairly accurate across all interventions considered. Predictive models accounted for 20-63% of the variance in intervention coverages, and correlation coefficients ranged from 0.5 to 0.83. The predictive model used to estimate coverage of management of pre-eclampsia performed relatively better (RMSE = 0.11) than the model estimating coverage of diabetes case management (RMSE = 0.19).The new approach to estimate coverage represents an improvement over current default proxies in LiST. As the availability of reliable coverage data improves, impact estimates generated by LiST will improve. This study underscores the need for continued efforts to improve coverage measurement, while bringing to the fore the importance of health facility assessments as complementary data sources.

Project description:BackgroundNationally representative household surveys are the gold standard for tracking progress in coverage of life-saving maternal and child interventions, but often do not provide timely information on coverage at the local and health facility level. Electronic routine health information system (RHIS) data could help provide this information, but there are currently concerns about data quality. This analysis seeks to improve the usability of and confidence in electronic RHIS data by using adjustments to calculate more accurate numerators and denominators for essential interventions.MethodsData from three sources (Ugandan Demographic and Health (UDHS) survey, electronic RHIS, and census) were used to provide estimates of essential maternal (> 4 antenatal care visits (ANC), skilled delivery, and postnatal care visit (PNC)) and child health interventions (diphtheria, pertussis, tetanus, and hepatitis B and Haemophilus influenzae type b and polio vaccination series, measles vaccination, and vitamin A). Electronic RHIS data was checked for quality and both numerators and denominators were adjusted to improve accuracy. Estimates were compared between the three sources.ResultsEstimates of maternal health interventions from adjusted electronic RHIS data were lower than those of the UDHS, while child intervention estimates were typically higher. Adjustment of electronic RHIS data generally improved accuracy compared with no adjustment. There was considerable agreement between estimates from adjusted, electronic RHIS data, and UDHS for skilled delivery and first dose of childhood vaccination series, but lesser agreement for ANC visits and second and third doses of childhood vaccinations.ConclusionsNationally representative household surveys will likely continue being the gold standard of coverage estimates of maternal and child health interventions, but this analysis shows that current approaches to adjusting health facility estimate works better for some indications than others. Further efforts to improve accuracy of estimates from RHIS sources are needed.

Dataset Information

Linking household and facility data for better coverage measures in reproductive, maternal, newborn, and child health care: systematic review.

Background

Methods

Findings

Conclusions

Publications

Linking household and facility data for better coverage measures in reproductive, maternal, newborn, and child health care: systematic review.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets