Dataset Information

Measuring coverage in MNCH: a prospective validation study in Pakistan and Bangladesh on measuring correct treatment of childhood pneumonia.

ABSTRACT:

Background

Antibiotic treatment for pneumonia as measured by Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) is a key indicator for tracking progress in achieving Millennium Development Goal 4. Concerns about the validity of this indicator led us to perform an evaluation in urban and rural settings in Pakistan and Bangladesh.

Methods and findings

Caregivers of 950 children under 5 y with pneumonia and 980 with "no pneumonia" were identified in urban and rural settings and allocated for DHS/MICS questions 2 or 4 wk later. Study physicians assigned a diagnosis of pneumonia as reference standard; the predictive ability of DHS/MICS questions and additional measurement tools to identify pneumonia versus non-pneumonia cases was evaluated. Results at both sites showed suboptimal discriminative power, with no difference between 2- or 4-wk recall. Individual patterns of sensitivity and specificity varied substantially across study sites (sensitivity 66.9% and 45.5%, and specificity 68.8% and 69.5%, for DHS in Pakistan and Bangladesh, respectively). Prescribed antibiotics for pneumonia were correctly recalled by about two-thirds of caregivers using DHS questions, increasing to 72% and 82% in Pakistan and Bangladesh, respectively, using a drug chart and detailed enquiry.

Conclusions

Monitoring antibiotic treatment of pneumonia is essential for national and global programs. Current (DHS/MICS questions) and proposed new (video and pneumonia score) methods of identifying pneumonia based on maternal recall discriminate poorly between pneumonia and children with cough. Furthermore, these methods have a low yield to identify children who have true pneumonia. Reported antibiotic treatment rates among these children are therefore not a valid proxy indicator of pneumonia treatment rates. These results have important implications for program monitoring and suggest that data in its current format from DHS/MICS surveys should not be used for the purpose of monitoring antibiotic treatment rates in children with pneumonia at the present time.

SUBMITTER: Hazir T

PROVIDER: S-EPMC3646205 | biostudies-literature | 2013

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Measuring coverage in MNCH: a prospective validation study in Pakistan and Bangladesh on measuring correct treatment of childhood pneumonia.

Hazir Tabish T Begum Khadija K El Arifeen Shams S Khan Amira M AM Huque M Hamidul MH Kazmi Narjis N Roy Sushmita S Abbasi Saleem S Rahman Qazi Sadeq-Ur QS Theodoratou Evropi E Khorshed Mahmuda Shayema MS Rahman Kazi Mizanur KM Bari Sanwarul S Kaiser M Mahfuzul Islam MM Saha Samir K SK Ahmed A S M Nawshad Uddin AS Rudan Igor I Bryce Jennifer J Qazi Shamim Ahmad SA Campbell Harry H

PLoS medicine 20130507 5

<h4>Background</h4>Antibiotic treatment for pneumonia as measured by Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS) is a key indicator for tracking progress in achieving Millennium Development Goal 4. Concerns about the validity of this indicator led us to perform an evaluation in urban and rural settings in Pakistan and Bangladesh.<h4>Methods and findings</h4>Caregivers of 950 children under 5 y with pneumonia and 980 with "no pneumonia" were identified in ur ...[more]

PMID: 23667339

Similar Datasets

Project description:BackgroundAccurate data on coverage of key maternal, newborn, and child health (MNCH) interventions are crucial for monitoring progress toward the Millennium Development Goals 4 and 5. Coverage estimates are primarily obtained from routine population surveys through self-reporting, the validity of which is not well understood. We aimed to examine the validity of the coverage of selected MNCH interventions in Gongcheng County, China.Method and findingsWe conducted a validation study by comparing women's self-reported coverage of MNCH interventions relating to antenatal and postnatal care, mode of delivery, and child vaccinations in a community survey with their paper- and electronic-based health care records, treating the health care records as the reference standard. Of 936 women recruited, 914 (97.6%) completed the survey. Results show that self-reported coverage of these interventions had moderate to high sensitivity (0.57 [95% confidence interval (CI): 0.50-0.63] to 0.99 [95% CI: 0.98-1.00]) and low to high specificity (0 to 0.83 [95% CI: 0.80-0.86]). Despite varying overall validity, with the area under the receiver operating characteristic curve (AUC) ranging between 0.49 [95% CI: 0.39-0.57] and 0.90 [95% CI: 0.88-0.92], bias in the coverage estimates at the population level was small to moderate, with the test to actual positive (TAP) ratio ranging between 0.8 and 1.5 for 24 of the 28 indicators examined. Our ability to accurately estimate validity was affected by several caveats associated with the reference standard. Caution should be exercised when generalizing the results to other settings.ConclusionsThe overall validity of self-reported coverage was moderate across selected MNCH indicators. However, at the population level, self-reported coverage appears to have small to moderate degree of bias. Accuracy of the coverage was particularly high for indicators with high recorded coverage or low recorded coverage but high specificity. The study provides insights into the accuracy of self-reports based on a population survey in low- and middle-income countries. Similar studies applying an improved reference standard are warranted in the future.

Project description:BackgroundCesarean section is the only surgery for which we have nearly global population-based data. However, few surveys provide additional data related to cesarean sections. Given weaknesses in many health information systems, health planners in developing countries will likely rely on nationally representative surveys for the foreseeable future. The objective is to validate self-reported data on the emergency status of cesarean sections among women delivering in teaching hospitals in the capitals of two contrasting countries: Accra, Ghana and Santo Domingo, Dominican Republic (DR).Methods and findingsThis study compares hospital-based data, considered the reference standard, against women's self-report for two definitions of emergency cesarean section based on the timing of the decision to operate and the timing of the cesarean section relative to onset of labor. Hospital data were abstracted from individual medical records, and hospital discharge interviews were conducted with women who had undergone cesarean section in two hospitals. The study assessed sensitivity, specificity, and positive predictive value of responses to questions regarding emergency versus non-emergency cesarean section and estimated the percent of emergency cesarean sections that would be obtained from a survey, given the observed prevalence, sensitivity, and specificity from this study. Hospital data were matched with exit interviews for 659 women delivered via cesarean section for Ghana and 1,531 for the Dominican Republic. In Ghana and the Dominican Republic, sensitivity and specificity for emergency cesarean section defined by decision time were 79% and 82%, and 50% and 80%, respectively. The validity of emergency cesarean defined by operation time showed less favorable results than decision time in Ghana and slightly more favorable results in the Dominican Republic.ConclusionsQuestions used in this study to identify emergency cesarean section are promising but insufficient to promote for inclusion in international survey questionnaires. Additional studies which confirm the accuracy of key facility-based indicators in advance of data collection and which use a longer recall period are warranted.

Project description:ObjectiveThis study compares two methods for clinical diagnosis of childhood pneumonia that aim to estimate rates of underdiagnosis and overdiagnosis of childhood pneumonia by examining the sensitivity of Integrated Management of Childhood Diseases implementation in routine care against lung ultrasound (LUS) diagnosis.SettingWe conducted observations in 83 public health facilities (dispensaries, health centres and district hospitals) in Pwani, Dodoma and Tabora, Tanzania between October and December 2017.MethodsWe used a novel method to estimate rates of underdiagnosis and overdiagnosis of childhood pneumonia by comparing directly observed public provider diagnoses to the results of diagnoses made by trained clinicians using Mindray DP-10 ultrasound machines. We perform multivariate analysis to identify confounding effects and robustness checks to bound the result. We also explore a number of observable characteristics correlated with higher rates of agreement between provider diagnoses and ultrasound diagnoses.ResultsWe observed 93 providers conducting exams on patients aged 2 months-5 years who presented respiratory symptoms or were given a respiratory diagnosis by the provider. Of these 957 patients, 110 were excluded from analysis resulting in a final sample of 847.17.6% of cases identified as pneumonia via LUS examinations in our sample were diagnosed as pneumonia by providers, suggesting that a significant number of pneumonia cases for which care is sought in the public sector go undiagnosed. Provider knowledge of breath counting and years of experience are positively correlated with higher agreement. While clinical examination rates are not statistically correlated with agreement, it is notable that providers conducted a clinical examination on only about one-third of patients in the sample.ConclusionOur results suggest that provider training and knowledge of clinical examination protocols for pneumonia diagnosis are predictive of correct diagnosis of pneumonia and should be further explored in future research as a tool for improving quality of care.

Dataset Information

Measuring coverage in MNCH: a prospective validation study in Pakistan and Bangladesh on measuring correct treatment of childhood pneumonia.

Background

Methods and findings

Conclusions

Publications

Measuring coverage in MNCH: a prospective validation study in Pakistan and Bangladesh on measuring correct treatment of childhood pneumonia.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets