Dataset Information

Measuring coverage in MNCH: testing the validity of women's self-report of key maternal and newborn health interventions during the peripartum period in Mozambique.

ABSTRACT:

Background

As low-income countries strive to meet targets for Millennium Development Goals 4 and 5, there is growing need to track coverage and quality of high-impact peripartum interventions. At present, nationally representative household surveys conducted in low-income settings primarily measure contact with the health system, shedding little light on content or quality of care. The objective of this study is to validate the ability of women in Mozambique to report on facility-based care they and their newborns received during labor and one hour postpartum.

Methods and findings

The study involved household interviews with women in Mozambique whose births were observed eight to ten months previously as part of a survey of the quality of maternal and newborn care at government health facilities. Of 487 women whose births were observed and who agreed to a follow-up interview, 304 were interviewed (62.4%). The validity of 34 indicators was tested using two measures: area under receiver operator characteristic curve (AUC) and inflation factor (IF); 27 indicators had sufficient numbers for robust analysis, of which four met acceptability criteria for both (AUC >0.6 and 0.75ConclusionsWomen are able to report on some aspects of peripartum care. Larger studies may be able to validate some indicators that this study could not assess due to the sample size. Future qualitative research may assist in improving question formulation for some indicators. Studies of similar design in other low-income settings are needed to confirm these results.

SUBMITTER: Stanton CK

PROVIDER: S-EPMC3646219 | biostudies-literature | 2013

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring coverage in MNCH: testing the validity of women's self-report of key maternal and newborn health interventions during the peripartum period in Mozambique.

Stanton Cynthia K CK Rawlins Barbara B Drake Mary M Dos Anjos Matias M Cantor David D Chongo Lidia L Chavane Leonardo L da Luz Vaz Maria M Ricca Jim J

PloS one 20130507 5

<h4>Background</h4>As low-income countries strive to meet targets for Millennium Development Goals 4 and 5, there is growing need to track coverage and quality of high-impact peripartum interventions. At present, nationally representative household surveys conducted in low-income settings primarily measure contact with the health system, shedding little light on content or quality of care. The objective of this study is to validate the ability of women in Mozambique to report on facility-based c ...[more]

PMID: 23667427

Similar Datasets

Project description:BackgroundCesarean section is the only surgery for which we have nearly global population-based data. However, few surveys provide additional data related to cesarean sections. Given weaknesses in many health information systems, health planners in developing countries will likely rely on nationally representative surveys for the foreseeable future. The objective is to validate self-reported data on the emergency status of cesarean sections among women delivering in teaching hospitals in the capitals of two contrasting countries: Accra, Ghana and Santo Domingo, Dominican Republic (DR).Methods and findingsThis study compares hospital-based data, considered the reference standard, against women's self-report for two definitions of emergency cesarean section based on the timing of the decision to operate and the timing of the cesarean section relative to onset of labor. Hospital data were abstracted from individual medical records, and hospital discharge interviews were conducted with women who had undergone cesarean section in two hospitals. The study assessed sensitivity, specificity, and positive predictive value of responses to questions regarding emergency versus non-emergency cesarean section and estimated the percent of emergency cesarean sections that would be obtained from a survey, given the observed prevalence, sensitivity, and specificity from this study. Hospital data were matched with exit interviews for 659 women delivered via cesarean section for Ghana and 1,531 for the Dominican Republic. In Ghana and the Dominican Republic, sensitivity and specificity for emergency cesarean section defined by decision time were 79% and 82%, and 50% and 80%, respectively. The validity of emergency cesarean defined by operation time showed less favorable results than decision time in Ghana and slightly more favorable results in the Dominican Republic.ConclusionsQuestions used in this study to identify emergency cesarean section are promising but insufficient to promote for inclusion in international survey questionnaires. Additional studies which confirm the accuracy of key facility-based indicators in advance of data collection and which use a longer recall period are warranted.

Project description:BackgroundDespite the concentration of maternal and infant deaths in the early postnatal period, information on the content and quality of postnatal care interventions is not routinely collected in most low and middle-income countries. At present, data on the coverage of postnatal care interventions mostly rely on women's reports collected in household surveys, such as the Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS), which collect limited information. We assessed the validity of a set of postnatal care indicators that reflect a range of recommended interventions for both mother and newborn and have potential to be included in household surveys for monitoring of population-level coverage.MethodsWe compared women's reports in exit interviews on the content of postnatal care received in health facilities located in Kenya and Swaziland against a gold standard of direct observation by a trained third party. We calculated sensitivity, specificity and the area under the receiver operating curve (AUC) to assess individual-level reporting accuracy and the inflation factor (IF) to assess population-level accuracy. We also examined whether women's reporting accuracy varied significantly by her sociodemographic characteristics.Results18 indicators in Kenya and 19 in Swaziland had sufficient sample size for analysis. Of these, 12 indicators in Kenya and five in Swaziland met criteria for acceptable individual and population-level reporting accuracy. Two indicators met acceptability criteria in both Kenya and Swaziland: whether the provider performed a breast exam or an abdominal exam. There was no significant association between women's characteristics and reporting accuracy, across indicators.ConclusionWomen are able to accurately report on multiple aspects of care received during a postnatal visit. Findings inform the recommendation of indicators for tracking progress of critical postnatal care interventions for mothers and newborns. Improved measurement of the coverage of maternal and newborn postnatal care is warranted to monitor progress in maternal and newborn care globally.

Project description:BackgroundAccurate data on coverage of key maternal, newborn, and child health (MNCH) interventions are crucial for monitoring progress toward the Millennium Development Goals 4 and 5. Coverage estimates are primarily obtained from routine population surveys through self-reporting, the validity of which is not well understood. We aimed to examine the validity of the coverage of selected MNCH interventions in Gongcheng County, China.Method and findingsWe conducted a validation study by comparing women's self-reported coverage of MNCH interventions relating to antenatal and postnatal care, mode of delivery, and child vaccinations in a community survey with their paper- and electronic-based health care records, treating the health care records as the reference standard. Of 936 women recruited, 914 (97.6%) completed the survey. Results show that self-reported coverage of these interventions had moderate to high sensitivity (0.57 [95% confidence interval (CI): 0.50-0.63] to 0.99 [95% CI: 0.98-1.00]) and low to high specificity (0 to 0.83 [95% CI: 0.80-0.86]). Despite varying overall validity, with the area under the receiver operating characteristic curve (AUC) ranging between 0.49 [95% CI: 0.39-0.57] and 0.90 [95% CI: 0.88-0.92], bias in the coverage estimates at the population level was small to moderate, with the test to actual positive (TAP) ratio ranging between 0.8 and 1.5 for 24 of the 28 indicators examined. Our ability to accurately estimate validity was affected by several caveats associated with the reference standard. Caution should be exercised when generalizing the results to other settings.ConclusionsThe overall validity of self-reported coverage was moderate across selected MNCH indicators. However, at the population level, self-reported coverage appears to have small to moderate degree of bias. Accuracy of the coverage was particularly high for indicators with high recorded coverage or low recorded coverage but high specificity. The study provides insights into the accuracy of self-reports based on a population survey in low- and middle-income countries. Similar studies applying an improved reference standard are warranted in the future.

Project description:BackgroundAntibiotic treatment for pneumonia as measured by Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) is a key indicator for tracking progress in achieving Millennium Development Goal 4. Concerns about the validity of this indicator led us to perform an evaluation in urban and rural settings in Pakistan and Bangladesh.Methods and findingsCaregivers of 950 children under 5 y with pneumonia and 980 with "no pneumonia" were identified in urban and rural settings and allocated for DHS/MICS questions 2 or 4 wk later. Study physicians assigned a diagnosis of pneumonia as reference standard; the predictive ability of DHS/MICS questions and additional measurement tools to identify pneumonia versus non-pneumonia cases was evaluated. Results at both sites showed suboptimal discriminative power, with no difference between 2- or 4-wk recall. Individual patterns of sensitivity and specificity varied substantially across study sites (sensitivity 66.9% and 45.5%, and specificity 68.8% and 69.5%, for DHS in Pakistan and Bangladesh, respectively). Prescribed antibiotics for pneumonia were correctly recalled by about two-thirds of caregivers using DHS questions, increasing to 72% and 82% in Pakistan and Bangladesh, respectively, using a drug chart and detailed enquiry.ConclusionsMonitoring antibiotic treatment of pneumonia is essential for national and global programs. Current (DHS/MICS questions) and proposed new (video and pneumonia score) methods of identifying pneumonia based on maternal recall discriminate poorly between pneumonia and children with cough. Furthermore, these methods have a low yield to identify children who have true pneumonia. Reported antibiotic treatment rates among these children are therefore not a valid proxy indicator of pneumonia treatment rates. These results have important implications for program monitoring and suggest that data in its current format from DHS/MICS surveys should not be used for the purpose of monitoring antibiotic treatment rates in children with pneumonia at the present time.

Project description:Aside from breastfeeding, there are little data on use of essential newborn care practices, such as thermal protection and hygienic cord care, in high mortality countries. These practices have not typically been measured in national household surveys, often the main source for coverage data in these settings. The Every Newborn Action Plan proposed early breastfeeding as a tracer for essential newborn care due to data availability and evidence for the benefits of breastfeeding. In the past decade, a few national surveys have added questions on other practices, presenting an opportunity to assess the performance of early breastfeeding initiation as a tracer indicator.We identified twelve national surveys between 2005-2014 that included at least one indicator for immediate newborn care in addition to breastfeeding. Because question wording and reference populations varied, we standardized data to the extent possible to estimate coverage of newborn care practices, accounting for strata and multistage survey design. We assessed early breastfeeding as a tracer by: 1) examining associations with other indicators using Pearson correlations; and 2) stratifying by early breastfeeding to determine differences in coverage of other practices for initiators vs non-initiators in each survey, then pooling across surveys for a meta-analysis, using the inverse standard error as the weight for each observation.Associations between pairs of coverage indicators are generally weak, including those with breastfeeding. The exception is drying and wrapping, which have the strongest association of any two interventions in all five surveys where measured; estimated correlations for this range from 0.47 in Bangladesh's 2007 DHS to 0.83 in Nepal's 2006 DHS. The contrast in coverage for other practices by early breastfeeding is generally small; the greatest absolute difference was 6.7%, between coverage of immediate drying for newborns breastfed early compared to those who were not.Early initiation of breastfeeding is not a high performing tracer indicator for essential newborn care practices measured in previous national surveys. To have informative data on whether newborns are getting life-saving services, standardized questions about specific practices, in addition to breastfeeding initiation, need to be added to surveys.

Project description:BACKGROUND:Monitoring universal health coverage in reproductive, maternal and child health requires appropriate indicators for assessing coverage and equity. In 2008, the composite coverage index (CCI)-a weighted average of eight indicators reflecting family planning, antenatal and delivery care, immunizations and management of childhood illnesses-was proposed. In 2017, the CCI formula was revised to update the family planning and diarrhea management indicators. We explored the implications of adding new indicators to the CCI. METHODS:We analysed nationally representative surveys to investigate how addition of early breastfeeding initiation (EIBF), tetanus toxoid during pregnancy and post-natal care for babies affected CCI levels and the magnitude of wealth-related inequalities. We used Pearson's correlation coefficient to compare different formulations, and the slope index of inequalities [SII] and concentration index [CIX] to assess absolute and relative inequalities, respectively. RESULTS:47 national surveys since 2010 had data on the eight variables needed for the original and revised formulations, and on EIBF, tetanus vaccine and postnatal care, related to newborn care. The original CCI showed the highest average value (65.5%), which fell to 56.9% when all 11 indicators were included. Correlation coefficients between pairs of all formulations ranged from 0.93 to 0.99. When analysed separately, 10 indicators showed higher coverage with increasing wealth; the exception was EIBF (SII = -2.1; CIX = -0.5). Inequalities decreased when other indicators were added, especially EIBF-the SII fell from 24.8 pp. to 19.2 pp.; CIX from 7.6 to 6.1. The number of countries with data from two or more surveys since 2010 was 30 for the original and revised formulations and 15 when all the 11 indicators were included. CONCLUSIONS:Given the growing importance of newborn mortality, it would be desirable to include relevant coverage indicators in the CCI, but this would lead a reduction in data availability, and an underestimation of coverage inequalities. We propose that the 2017 version of the revised CCI should continue to be used.

Dataset Information

Measuring coverage in MNCH: testing the validity of women's self-report of key maternal and newborn health interventions during the peripartum period in Mozambique.

Background

Methods and findings

Publications

Measuring coverage in MNCH: testing the validity of women's self-report of key maternal and newborn health interventions during the peripartum period in Mozambique.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure