Dataset Information

Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya.

ABSTRACT:

Background

Tracking progress on maternal and newborn survival requires accurate information on the coverage of essential interventions. Despite widespread use, most indicators measuring maternal and newborn intervention coverage have not been validated. This study assessed the ability of women delivering in two Kenyan hospitals to recall critical elements of care received during the intrapartum and immediate postnatal period at two time points: hospital discharge and 13-15 months following delivery.

Methods

Women's reports of received care were compared against observations by trained third party observers. Indicators selected for validation were either currently in use or have the potential to be included in population-based surveys. We used a mixed-methods approach to validate women's reporting ability. We calculated individual-reporting accuracy using the area under the receiver operating curve (AUC), population-level accuracy using the inflation factor (IF), and compared the accuracy of women's reporting at baseline and follow-up. We also assessed the consistency of women's reporting over time. We used in-depth interviews with a sub-set of women (n?=?20) to assess their understanding of key survey terms.

Results

Of 606 women who participated at baseline and agreed to follow-up, 515 were re-interviewed. Thirty-eight indicators had sufficient sample size for validation analysis; ten met criteria for high or moderate reporting accuracy (0.60ConclusionThe few indicators that women reported accurately at baseline were consistently recalled with accuracy at 13-15 months follow-up. Although there is deterioration in women's recall in some indicators over time, the extent of deterioration does not appreciably compromise reporting accuracy for indicators with high baseline validity. Indicators related to initial client assessment and the immediate postnatal period have generally low accuracy and poor reporting consistency over time.

SUBMITTER: McCarthy KJ

PROVIDER: S-EPMC5012235 | biostudies-literature | 2016 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya.

McCarthy Katharine J KJ Blanc Ann K AK Warren Charlotte E CE Kimani James J Mdawida Brian B Ndwidga Charity C

Journal of global health 20161201 2

<h4>Background</h4>Tracking progress on maternal and newborn survival requires accurate information on the coverage of essential interventions. Despite widespread use, most indicators measuring maternal and newborn intervention coverage have not been validated. This study assessed the ability of women delivering in two Kenyan hospitals to recall critical elements of care received during the intrapartum and immediate postnatal period at two time points: hospital discharge and 13-15 months followi ...[more]

PMID: 27606061

Similar Datasets

Project description:BackgroundThe intrapartum period is a time of high mortality risk for newborns and mothers. Numerous interventions exist to minimize risk during this period. Data on intervention coverage are needed for health system improvement. Maternal report of intrapartum interventions through surveys is the primary source of coverage data, but they may be invalid or unreliable.MethodsWe assessed the reliability of maternal report of delivery and immediate newborn care for a sample of home and health facility births in Sarlahi, Nepal. Mothers were visited as soon as possible following delivery (< 72 h) and asked to report circumstances of labor and delivery. A subset was revisited 1-24 months after delivery and asked to recall interventions received using standard household survey questions. We assessed the reliability of each indicator by comparing what mothers reported immediately after delivery against what they reported at the follow-up survey. We assessed potential variation in reliability of maternal report by characteristics of the mother, birth event, or intervention prevalence.ResultsOne thousand five hundred two mother/child pairs were included in the reliability study, with approximately half of births occurring at home. A higher proportion of women who delivered in facilities reported "don't know" when asked to recall specific interventions both initially and at follow-up. Most indicators had high observed percent agreement, but kappa values were below 0.4, indicating agreement was primarily due to chance. Only "received any injection during delivery" demonstrated high reliability among all births (kappa: 0.737). The reliability of maternal report was typically lower among women who delivered at a facility. There was no difference in reliability based on time since birth of the follow-up interview. We observed over-reporting of interventions at follow-up that were more common in the population and under-reporting of less common interventions.ConclusionsThis study reinforces previous findings that mothers are unable to report reliably on many interventions within the peripartum period. Household surveys which rely on maternal report, therefore, may not be an appropriate method for collecting data on coverage of many interventions during the peripartum period. This is particularly true among facility births, where many interventions may occur without the mother's full knowledge.

Project description:BackgroundDespite the concentration of maternal and infant deaths in the early postnatal period, information on the content and quality of postnatal care interventions is not routinely collected in most low and middle-income countries. At present, data on the coverage of postnatal care interventions mostly rely on women's reports collected in household surveys, such as the Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS), which collect limited information. We assessed the validity of a set of postnatal care indicators that reflect a range of recommended interventions for both mother and newborn and have potential to be included in household surveys for monitoring of population-level coverage.MethodsWe compared women's reports in exit interviews on the content of postnatal care received in health facilities located in Kenya and Swaziland against a gold standard of direct observation by a trained third party. We calculated sensitivity, specificity and the area under the receiver operating curve (AUC) to assess individual-level reporting accuracy and the inflation factor (IF) to assess population-level accuracy. We also examined whether women's reporting accuracy varied significantly by her sociodemographic characteristics.Results18 indicators in Kenya and 19 in Swaziland had sufficient sample size for analysis. Of these, 12 indicators in Kenya and five in Swaziland met criteria for acceptable individual and population-level reporting accuracy. Two indicators met acceptability criteria in both Kenya and Swaziland: whether the provider performed a breast exam or an abdominal exam. There was no significant association between women's characteristics and reporting accuracy, across indicators.ConclusionWomen are able to accurately report on multiple aspects of care received during a postnatal visit. Findings inform the recommendation of indicators for tracking progress of critical postnatal care interventions for mothers and newborns. Improved measurement of the coverage of maternal and newborn postnatal care is warranted to monitor progress in maternal and newborn care globally.

Project description:BACKGROUND:A variety of global-level monitoring initiatives have recommended indicators for tracking progress in maternal and newborn health. As a first step supporting the work of WHO's Mother and Newborn Information for Tracking Outcomes and Results (MoNITOR) Technical Advisory Group, we aimed to compile and synthesize recommended indicators in order to document the landscape of maternal and newborn measurement and monitoring. METHODS:We conducted a scoping review of indicators proposed by global multi-stakeholder groups to suggest next steps to further support maternal and newborn measurement and monitoring. Indicators pertaining to pregnancy, childbirth, and postpartum/postnatal and newborn care were extracted and included in the indicator compilation, together with key indicator metadata. We examined patterns and relationships across the compiled indicators. RESULTS:We identified 140 indicators linked to maternal and newborn health topics across the continuum of service provision. Fifty-five indicators relate to inputs and processes, 30 indicators relate to outputs, outcomes comprise 37 indicators in the database, and 18 impact indicators. A quarter of indicators proposed by global groups is either under development/discussion or is considered "aspirational", highlighting the currently evolving monitoring landscape. Although considerable efforts have been made to harmonize indicator recommendations, there are still relatively few indicators shared across key monitoring initiatives and some of those that are shared may have definitional variation. CONCLUSION:Rapid, wide-ranging work by a number of multi-stakeholder groups has resulted in a substantial number of indicators, many of which partially overlap and many are not supported with adequate documentation or guidance. The volume of indicators, coupled with the number of initiatives promoting different indicator lists, highlight the need for strengthened coordination and technical leadership to harmonize recommendations for improved measurement and monitoring of data related to maternal and newborn heath.

Dataset Information

Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya.

Background

Methods

Results

Publications

Can surveys of women accurately track indicators of maternal and newborn care? A validity and reliability study in Kenya.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets