Dataset Information

Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring.

ABSTRACT: Global monitoring of intervention coverage is a cornerstone of international efforts to improve reproductive, maternal, newborn, and child health. In this review, we examine the process and implications of selecting a core set of coverage indicators for global monitoring, using as examples the processes used by the Countdown to 2015 for Maternal, Newborn and Child Survival and the Commission on Accountability for Women's and Children's Health. We describe how the generation of data for global monitoring involves five iterative steps: development of standard indicator definitions and measurement approaches to ensure comparability across countries; collection of high-quality data at the country level; compilation of country data at the global level; organization of global databases; and rounds of data quality checking. Regular and rigorous technical review processes that involve high-level decision makers and experts familiar with indicator measurement are needed to maximize uptake and to ensure that indicators used for global monitoring are selected on the basis of available evidence of intervention effectiveness, feasibility of measurement, and data availability as well as programmatic relevance. Experience from recent initiatives illustrates the challenges of striking this balance as well as strategies for reducing the tensions inherent in the indicator selection process. We conclude that more attention and continued investment need to be directed to global monitoring, to support both the process of global database development and the selection of sets of coverage indicators to promote accountability. The stakes are high, because these indicators can drive policy and program development at the country and global level, and ultimately impact the health of women and children and the communities where they live.

SUBMITTER: Requejo JH

PROVIDER: S-EPMC3646210 | biostudies-literature | 2013

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring.

Requejo Jennifer Harris JH Newby Holly H Bryce Jennifer J

PLoS medicine 20130507 5

Global monitoring of intervention coverage is a cornerstone of international efforts to improve reproductive, maternal, newborn, and child health. In this review, we examine the process and implications of selecting a core set of coverage indicators for global monitoring, using as examples the processes used by the Countdown to 2015 for Maternal, Newborn and Child Survival and the Commission on Accountability for Women's and Children's Health. We describe how the generation of data for global mo ...[more]

PMID: 23667336

Similar Datasets

Project description:BackgroundAntibiotic treatment for pneumonia as measured by Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) is a key indicator for tracking progress in achieving Millennium Development Goal 4. Concerns about the validity of this indicator led us to perform an evaluation in urban and rural settings in Pakistan and Bangladesh.Methods and findingsCaregivers of 950 children under 5 y with pneumonia and 980 with "no pneumonia" were identified in urban and rural settings and allocated for DHS/MICS questions 2 or 4 wk later. Study physicians assigned a diagnosis of pneumonia as reference standard; the predictive ability of DHS/MICS questions and additional measurement tools to identify pneumonia versus non-pneumonia cases was evaluated. Results at both sites showed suboptimal discriminative power, with no difference between 2- or 4-wk recall. Individual patterns of sensitivity and specificity varied substantially across study sites (sensitivity 66.9% and 45.5%, and specificity 68.8% and 69.5%, for DHS in Pakistan and Bangladesh, respectively). Prescribed antibiotics for pneumonia were correctly recalled by about two-thirds of caregivers using DHS questions, increasing to 72% and 82% in Pakistan and Bangladesh, respectively, using a drug chart and detailed enquiry.ConclusionsMonitoring antibiotic treatment of pneumonia is essential for national and global programs. Current (DHS/MICS questions) and proposed new (video and pneumonia score) methods of identifying pneumonia based on maternal recall discriminate poorly between pneumonia and children with cough. Furthermore, these methods have a low yield to identify children who have true pneumonia. Reported antibiotic treatment rates among these children are therefore not a valid proxy indicator of pneumonia treatment rates. These results have important implications for program monitoring and suggest that data in its current format from DHS/MICS surveys should not be used for the purpose of monitoring antibiotic treatment rates in children with pneumonia at the present time.

Project description:BACKGROUND:Monitoring financial protection against catastrophic health expenditures is important to understand how health financing arrangements in a country protect its population against high costs associated with accessing health services. While catastrophic health expenditures are generally defined to be when household expenditures for health exceed a given threshold of household resources, there is no gold standard with several methods applied to define the threshold and household resources. These different approaches to constructing the indicator might give different pictures of a country's progress towards financial protection. In order for monitoring to effectively provide policy insight, it is critical to understand the sensitivity of measurement to these choices. METHODS:This paper examines the impact of varying two methodological choices by analysing household expenditure data from a sample of 47 countries. We assess sensitivity of cross-country comparisons to a range of thresholds by testing for restricted dominance. We further assess sensitivity of comparisons to different methods for defining household resources (i.e. total expenditure, non-food expenditure and non-subsistence expenditure) by conducting correlation tests of country rankings. RESULTS:We found country rankings are robust to the choice of threshold in a tenth to a quarter of comparisons within the 5-85% threshold range and this increases to half of comparisons if the threshold is restricted to 5-40%, following those commonly used in the literature. Furthermore, correlations of country rankings using different methods to define household resources were moderate to high; thus, this choice makes less difference from a measurement perspective than from an ethical perspective as different definitions of available household resources reflect varying concerns for equity. CONCLUSIONS:Interpreting comparisons from global monitoring based on a single threshold should be done with caution as these may not provide reliable insight into relative country progress. We therefore recommend financial protection against catastrophic health expenditures be measured across a range of thresholds using a catastrophic incidence curve as shown in this paper. We further recommend evaluating financial protection in relation to a country's health financing system arrangements in order to better understand the extent of protection and better inform future policy changes.

Project description:BackgroundCesarean section is the only surgery for which we have nearly global population-based data. However, few surveys provide additional data related to cesarean sections. Given weaknesses in many health information systems, health planners in developing countries will likely rely on nationally representative surveys for the foreseeable future. The objective is to validate self-reported data on the emergency status of cesarean sections among women delivering in teaching hospitals in the capitals of two contrasting countries: Accra, Ghana and Santo Domingo, Dominican Republic (DR).Methods and findingsThis study compares hospital-based data, considered the reference standard, against women's self-report for two definitions of emergency cesarean section based on the timing of the decision to operate and the timing of the cesarean section relative to onset of labor. Hospital data were abstracted from individual medical records, and hospital discharge interviews were conducted with women who had undergone cesarean section in two hospitals. The study assessed sensitivity, specificity, and positive predictive value of responses to questions regarding emergency versus non-emergency cesarean section and estimated the percent of emergency cesarean sections that would be obtained from a survey, given the observed prevalence, sensitivity, and specificity from this study. Hospital data were matched with exit interviews for 659 women delivered via cesarean section for Ghana and 1,531 for the Dominican Republic. In Ghana and the Dominican Republic, sensitivity and specificity for emergency cesarean section defined by decision time were 79% and 82%, and 50% and 80%, respectively. The validity of emergency cesarean defined by operation time showed less favorable results than decision time in Ghana and slightly more favorable results in the Dominican Republic.ConclusionsQuestions used in this study to identify emergency cesarean section are promising but insufficient to promote for inclusion in international survey questionnaires. Additional studies which confirm the accuracy of key facility-based indicators in advance of data collection and which use a longer recall period are warranted.

Project description:BackgroundAccurate data on coverage of key maternal, newborn, and child health (MNCH) interventions are crucial for monitoring progress toward the Millennium Development Goals 4 and 5. Coverage estimates are primarily obtained from routine population surveys through self-reporting, the validity of which is not well understood. We aimed to examine the validity of the coverage of selected MNCH interventions in Gongcheng County, China.Method and findingsWe conducted a validation study by comparing women's self-reported coverage of MNCH interventions relating to antenatal and postnatal care, mode of delivery, and child vaccinations in a community survey with their paper- and electronic-based health care records, treating the health care records as the reference standard. Of 936 women recruited, 914 (97.6%) completed the survey. Results show that self-reported coverage of these interventions had moderate to high sensitivity (0.57 [95% confidence interval (CI): 0.50-0.63] to 0.99 [95% CI: 0.98-1.00]) and low to high specificity (0 to 0.83 [95% CI: 0.80-0.86]). Despite varying overall validity, with the area under the receiver operating characteristic curve (AUC) ranging between 0.49 [95% CI: 0.39-0.57] and 0.90 [95% CI: 0.88-0.92], bias in the coverage estimates at the population level was small to moderate, with the test to actual positive (TAP) ratio ranging between 0.8 and 1.5 for 24 of the 28 indicators examined. Our ability to accurately estimate validity was affected by several caveats associated with the reference standard. Caution should be exercised when generalizing the results to other settings.ConclusionsThe overall validity of self-reported coverage was moderate across selected MNCH indicators. However, at the population level, self-reported coverage appears to have small to moderate degree of bias. Accuracy of the coverage was particularly high for indicators with high recorded coverage or low recorded coverage but high specificity. The study provides insights into the accuracy of self-reports based on a population survey in low- and middle-income countries. Similar studies applying an improved reference standard are warranted in the future.

Dataset Information

Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring.

Publications

Measuring coverage in MNCH: challenges and opportunities in the selection of coverage indicators for global monitoring.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure