Dataset Information

What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation.

ABSTRACT: BACKGROUND:Rigorous monitoring supports progress in achieving maternal and newborn mortality and morbidity reductions. Recent work to strengthen measurement for maternal and newborn health highlights the existence of a large number of indicators being used for this purpose. The definitions and data sources used to produce indicator estimates vary and challenges exist with completeness, accuracy, transparency, and timeliness of data. The objective of this study is to create a conceptual overview of how indicator validity is defined and understood by those who develop and use maternal and newborn health indicators. METHODS:A conceptual framework of validity was developed using mixed methods. We were guided by principles for conceptual frameworks and by a review of the literature and key maternal and newborn health indicator guidance documents. We also conducted qualitative semi-structured interviews with 32 key informants chosen through purposive sampling. RESULTS:We categorised indicator validity into three main types: criterion, convergent, and construct. Criterion or diagnostic validity, comparing a measure with a gold standard, has predominantly been used to assess indicators of care coverage and content. Studies assessing convergent validity quantify the extent to which two or more indicator measurement approaches, none of which is a gold-standard, relate. Key informants considered construct validity, or the accuracy of the operationalisation of a concept or phenomenon, a critical part of the overall assessment of indicator validity. CONCLUSION:Given concerns about the large number of maternal and newborn health indicators currently in use, a more consistent understanding of validity can help guide prioritization of key indicators and inform development of new indicators. All three types of validity are relevant for evaluating the performance of maternal and newborn health indicators. We highlight the need to establish a common language and understanding of indicator validity among the various global and local stakeholders working within maternal and newborn health.

SUBMITTER: Benova L

PROVIDER: S-EPMC7259779 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation.

Benova Lenka L Moller Ann-Beth AB Hill Kathleen K Vaz Lara M E LME Morgan Alison A Hanson Claudia C Semrau Katherine K Al Arifeen Shams S Moran Allisyn C AC

PloS one 20200529 5

<h4>Background</h4>Rigorous monitoring supports progress in achieving maternal and newborn mortality and morbidity reductions. Recent work to strengthen measurement for maternal and newborn health highlights the existence of a large number of indicators being used for this purpose. The definitions and data sources used to produce indicator estimates vary and challenges exist with completeness, accuracy, transparency, and timeliness of data. The objective of this study is to create a conceptual o ...[more]

PMID: 32470019

Similar Datasets

Project description:Policy Points: Strengthening accountability through better measurement and reporting is vital to ensure progress in improving quality primary health care (PHC) systems and achieving universal health coverage (UHC). The Primary Health Care Performance Initiative (PHCPI) provides national decision makers and global stakeholders with opportunities to benchmark and accelerate performance improvement through better performance measurement. Results from the initial PHC performance assessments in low- and middle-income countries (LMICs) are helping guide PHC reforms and investments and improve the PHCPI's instruments and indicators. Findings from future assessment activities will further amplify cross-country comparisons and peer learning to improve PHC. New indicators and sources of data are needed to better understand PHC system performance in LMICs.ContextThe Primary Health Care Performance Initiative (PHCPI), a collaboration between the Bill and Melinda Gates Foundation, The World Bank, and the World Health Organization, in partnership with Ariadne Labs and Results for Development, was launched in 2015 with the aim of catalyzing improvements in primary health care (PHC) systems in 135 low- and middle-income countries (LMICs), in order to accelerate progress toward universal health coverage. Through more comprehensive and actionable measurement of quality PHC, the PHCPI stimulates peer learning among LMICs and informs decision makers to guide PHC investments and reforms. Instruments for performance assessment and improvement are in development; to date, a conceptual framework and 2 sets of performance indicators have been released.MethodsThe PHCPI team developed the conceptual framework through literature reviews and consultations with an advisory committee of international experts. We generated 2 sets of performance indicators selected from a literature review of relevant indicators, cross-referenced against indicators available from international sources, and evaluated through 2 separate modified Delphi processes, consisting of online surveys and in-person facilitated discussions with experts.FindingsThe PHCPI conceptual framework builds on the current understanding of PHC system performance through an expanded emphasis on the role of service delivery. The first set of performance indicators, 36 Vital Signs, facilitates comparisons across countries and over time. The second set, 56 Diagnostic Indicators, elucidates underlying drivers of performance. Key challenges include a lack of available data for several indicators and a lack of validated indicators for important dimensions of quality PHC.ConclusionsThe availability of data is critical to assessing PHC performance, particularly patient experience and quality of care. The PHCPI will continue to develop and test additional performance assessment instruments, including composite indices and national performance dashboards. Through country engagement, the PHCPI will further refine its instruments and engage with governments to better design and finance primary health care reforms.

Project description:BackgroundMidwives' authorization to deliver the seven basic emergency obstetric and newborn care (BEmONC) functions is a core policy indicator in global monitoring frameworks, yet little evidence supports whether such data are captured accurately, or whether authorization demonstrates convergence with midwives' skills and actual provision of services. In this study, we aimed to validate the data reported in global monitoring frameworks (criterion validity) and to determine whether a measure of authorization is a valid indicator for BEmONC availability (construct validity).MethodsWe conducted a validation study in Argentina, Ghana, and India. To assess accuracy of the reported data on midwives' authorization to provide BEmONC services, we reviewed national regulatory documents and compared with reported country-specific data in Countdown to 2030 and the World Health Organization Maternal, Newborn, Child and Adolescent Health Policy Survey. To assess whether authorization demonstrates convergent validity with midwives' skills, training, and performance of BEmONC signal functions, we surveyed 1257 midwives/midwifery professionals and assessed variance.ResultsWe detected discrepancies between data reported in the global monitoring frameworks and the national regulatory framework in all three countries. We found wide variations between midwives' authorization to perform signal functions and their self-reported skills and actual performance within the past 90 days. The percentage of midwives who reported performing all signal functions for which they were authorized per country-specific regulations was 17% in Argentina, 23% in Ghana, and 31% in India. Additionally, midwives in all three countries reported performing some signal functions that the national regulations did not authorize.ConclusionOur findings suggest limitations in criterion and construct validity for this indicator in Argentina, Ghana, and India. Some signal functions such as assisted vaginal delivery may be obsolete based on current practice patterns. Findings suggest the need to re-examine the emergency interventions that should be included as BEmONC signal functions.

Project description:BackgroundRespectful maternal and newborn care (RMNC) is an important component of high-quality care but progress is impeded by critical measurement gaps for women and newborns. The Every Newborn Birth Indicators Research Tracking in Hospitals (EN-BIRTH) study was an observational study with mixed methods assessing measurement validity for coverage and quality of maternal and newborn indicators. This paper reports results regarding the measurement of respectful care for women and newborns.MethodsAt one EN-BIRTH study site in Pokhara, Nepal, we included additional questions during exit-survey interviews with women about their experiences (July 2017-July 2018). The questionnaire was based on seven mistreatment typologies: Physical; Sexual; or Verbal abuse; Stigma/discrimination; Failure to meet professional standards of care; Poor rapport between women and providers; and Health care denied due to inability to pay. We calculated associations between these typologies and potential determinants of health - ethnicity, age, sex, mode of birth - as possible predictors for reporting poor care.ResultsAmong 4296 women interviewed, none reported physical, sexual, or verbal abuse. 15.7% of women were dissatisfied with privacy, and 13.0% of women reported their birth experience did not meet their religious and cultural needs. In descriptive analysis, adjusted odds ratios and multivariate analysis showed primiparous women were less likely to report respectful care (β = 0.23, p-value < 0.0001). Women from Madeshi (a disadvantaged ethnic group) were more likely to report poor care (β = - 0.34; p-value 0.037) than women identifying as Chettri/Brahmin. Women who had caesarean section were less likely to report poor care during childbirth (β = - 0.42; p-value < 0.0001) than women with a vaginal birth. However, babies born by caesarean had a 98% decrease in the odds (aOR = 0.02, 95% CI, 0.01-0.05) of receiving skin-to-skin contact than those with vaginal births.ConclusionsMeasurement of respectful care at exit interview after hospital birth is challenging, and women generally reported 100% respectful care for themselves and their baby. Specific questions, with stratification by mode of birth, women's age and ethnicity, are important to identify those mistreated during care and to prioritise action. More research is needed to develop evidence-based measures to track experience of care, including zero separation for the mother-newborn pair, and to improve monitoring.

Project description:ObjectiveThe COVID-19 pandemic exposed significant gaps in Iran's and other health systems' risk communication. The accompanying infodemic undermined policy responses, amplified distrust in government and reduced adherence to public health recommendations among the Iranian population. This study aimed to develop a conceptual framework for health risk communication and infodemic management (RCIM) during epidemics and health emergencies in Iran that could have potential applications in other contexts.DesignThis study was designed in two phases. Phase 1 involved semistructured qualitative interviews with key informants to explore effective RCIM strategies across public health settings in Iran and to develop a conceptual framework. Phase 2 involved revising the framework based on feedback from an online expert panel regarding its comprehensiveness and validity.SettingProvincial/national public health settings in Iran.ParticipantsTwenty key informants from provincial and national public health authorities who contributed to COVID-19 response programmes participated in interviews. Nine experts from diverse academic disciplines, provincial and national settings, and geographical locations participated in an online expert panel.ResultsThe conceptual model was created based on qualitative interviews and expert panel discussions and was structured according to six pillars of the WHO health system framework: leadership and governance, information, health workforce and financial resources, along with media and community. Leadership and governance, including trustworthy leaders, were recommended as the foundation for developing RCIM in Iran. Developing an official strategy with information infrastructures, including high-quality surveillance systems, identified personnel and training for specialists among the health workforce, financial resources, communication channels and community engagement were recognised as other dimensions for developing health risk communication in Iran.ConclusionThe proposed framework represents a step toward establishing a national RCIM strategy in Iran. Further validation of the conceptual framework and experiments on how it could potentially influence policy and practice is recommended. This model has the potential to be applied in other contexts in its current form or as the foundation for customised local versions.

Dataset Information

What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation.

Publications

What is meant by validity in maternal and newborn health measurement? A conceptual framework for understanding indicator validation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets