Dataset Information

Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection.

ABSTRACT: Policy Points: Strengthening accountability through better measurement and reporting is vital to ensure progress in improving quality primary health care (PHC) systems and achieving universal health coverage (UHC). The Primary Health Care Performance Initiative (PHCPI) provides national decision makers and global stakeholders with opportunities to benchmark and accelerate performance improvement through better performance measurement. Results from the initial PHC performance assessments in low- and middle-income countries (LMICs) are helping guide PHC reforms and investments and improve the PHCPI's instruments and indicators. Findings from future assessment activities will further amplify cross-country comparisons and peer learning to improve PHC. New indicators and sources of data are needed to better understand PHC system performance in LMICs.

Context

The Primary Health Care Performance Initiative (PHCPI), a collaboration between the Bill and Melinda Gates Foundation, The World Bank, and the World Health Organization, in partnership with Ariadne Labs and Results for Development, was launched in 2015 with the aim of catalyzing improvements in primary health care (PHC) systems in 135 low- and middle-income countries (LMICs), in order to accelerate progress toward universal health coverage. Through more comprehensive and actionable measurement of quality PHC, the PHCPI stimulates peer learning among LMICs and informs decision makers to guide PHC investments and reforms. Instruments for performance assessment and improvement are in development; to date, a conceptual framework and 2 sets of performance indicators have been released.

Methods

The PHCPI team developed the conceptual framework through literature reviews and consultations with an advisory committee of international experts. We generated 2 sets of performance indicators selected from a literature review of relevant indicators, cross-referenced against indicators available from international sources, and evaluated through 2 separate modified Delphi processes, consisting of online surveys and in-person facilitated discussions with experts.

Findings

The PHCPI conceptual framework builds on the current understanding of PHC system performance through an expanded emphasis on the role of service delivery. The first set of performance indicators, 36 Vital Signs, facilitates comparisons across countries and over time. The second set, 56 Diagnostic Indicators, elucidates underlying drivers of performance. Key challenges include a lack of available data for several indicators and a lack of validated indicators for important dimensions of quality PHC.

Conclusions

The availability of data is critical to assessing PHC performance, particularly patient experience and quality of care. The PHCPI will continue to develop and test additional performance assessment instruments, including composite indices and national performance dashboards. Through country engagement, the PHCPI will further refine its instruments and engage with governments to better design and finance primary health care reforms.

SUBMITTER: Veillard J

PROVIDER: S-EPMC5723717 | biostudies-literature | 2017 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection.

Veillard Jeremy J Cowling Krycia K Bitton Asaf A Ratcliffe Hannah H Kimball Meredith M Barkley Shannon S Mercereau Laure L Wong Ethan E Taylor Chelsea C Hirschhorn Lisa R LR Wang Hong H

The Milbank quarterly 20171201 4

Policy Points: Strengthening accountability through better measurement and reporting is vital to ensure progress in improving quality primary health care (PHC) systems and achieving universal health coverage (UHC). The Primary Health Care Performance Initiative (PHCPI) provides national decision makers and global stakeholders with opportunities to benchmark and accelerate performance improvement through better performance measurement. Results from the initial PHC performance assessments in low- ...[more]

PMID: 29226448

Similar Datasets

Project description:System dynamics methods were used to explore effective implementation pathways for improving health systems performance through pay-for-performance (P4P) schemes. A causal loop diagram was developed to delineate primary causal relationships for service delivery within primary health facilities. A quantitative stock-and-flow model was developed next. The stock-and-flow model was then used to simulate the impact of various P4P implementation scenarios on quality and volume of services. Data from the Afghanistan national facility survey in 2012 was used to calibrate the model. The models show that P4P bonuses could increase health workers' motivation leading to higher levels of quality and volume of services. Gaming could reduce or even reverse this desired effect, leading to levels of quality and volume of services that are below baseline levels. Implementation issues, such as delays in the disbursement of P4P bonuses and low levels of P4P bonuses, also reduce the desired effect of P4P on quality and volume, but they do not cause the outputs to fall below baseline levels. Optimal effect of P4P on quality and volume of services is obtained when P4P bonuses are distributed per the health workers' contributions to the services that triggered the payments. Other distribution algorithms such as equal allocation or allocations proportionate to salaries resulted in quality and volume levels that were substantially lower, sometimes below baseline. The system dynamics models served to inform, with quantitative results, the theory of change underlying P4P intervention. Specific implementation strategies, such as prompt disbursement of adequate levels of performance bonus distributed per health workers' contribution to service, increase the likelihood of P4P success. Poorly designed P4P schemes, such as those without an optimal algorithm for distributing performance bonuses and adequate safeguards for gaming, can have a negative overall impact on health service delivery systems.

Project description:Background . For the last two decades there has been growing interest in governmental and global health stakeholders about the role that performance measurement and management systems can play for the production of high-quality and safely delivered primary care services. Despite recognition and interest, the gaps in evidence in this field of research and practice in low- and middle-income countries remain poorly characterized. This study will develop an evidence gap map in the area of performance management in primary care delivery systems in low- and middle-income countries. Methods. The evidence gap map will follow the methodology developed by 3Ie, the International Initiative for Impact Evaluation, to systematically map evidence and research gaps. The process starts with the development of the scope by creating an evidence-informed framework that helps identify the interventions and outcomes of relevance as well as help define inclusion and exclusion criteria. A search strategy is then developed to guide the systematic search of the literature, covering the following databases: Medline (Ovid), Embase (Ovid), CAB Global Health (Ovid), CINAHL (Ebsco), Cochrane Library, Scopus (Elsevier), and Econlit (Ovid). Sources of grey literature are also searched. Studies that meet the inclusion criteria are systematically coded, extracting data on intervention, outcome, measures, context, geography, equity, and study design. Systematic reviews are also critically appraised using an existing standard checklist. Impact evaluations are not appraised but will be coded according to study design. The process of map-building ends with the creation of an evidence gap map graphic that displays the available evidence according to the intervention and outcome framework of interest. Discussion . Implications arising from the evidence map will be discussed in a separate paper that will summarize findings and make recommendations for the development of a prioritized research agenda.

Project description:BackgroundThe majority of global cardiovascular disease (CVD) burden falls on people living in low- and middle-income countries (LMICs). In order to reduce preventable CVD mortality and morbidity, LMIC health systems and health care providers need to improve the delivery and quality of CVD care.ObjectivesAs part of the Disease Control Priorities Three (DCP3) Study efforts addressing quality improvement, we reviewed and summarized currently available evidence on interventions to improve quality of clinic-based CVD prevention and management in LMICs.MethodsWe conducted a narrative review of published comparative clinical trials that evaluated efficacy or effectiveness of clinic-based CVD prevention and management quality improvement interventions in LMICs. Conditions selected a priori included hypertension, diabetes, hyperlipidemia, coronary artery disease, stroke, rheumatic heart disease, and congestive heart failure. MEDLINE and EMBASE electronic databases were systematically searched. Studies were categorized as occurring at the system or patient/provider level and as treating the acute or chronic phase of CVD.ResultsFrom 847 articles identified in the electronic search, 49 met full inclusion criteria and were selected for review. Selected studies were performed in 19 different LMICs. There were 10 studies of system level quality improvement interventions, 38 studies of patient/provider interventions, and one study that fit both criteria. At the patient/provider level, regardless of the specific intervention, intensified, team-based care generally led to improved medication adherence and hypertension control. At the system level, studies provided evidence that introduction of universal health insurance coverage improved hypertension and diabetes control. Studies of system and patient/provider level acute coronary syndrome quality improvement interventions yielded inconclusive results. The duration of most studies was less than 12 months.ConclusionsThe results of this review suggest that CVD care quality improvement can be successfully implemented in LMICs. Most studies focused on chronic CVD conditions; more acute CVD care quality improvement studies are needed. Longer term interventions and follow-up will be needed in order to assess the sustainability of quality improvement efforts in LMICs.

Project description:BackgroundGrowth and early development (ECD) are vital outcomes for children. This study aimed to examine the association between child growth and overall development in children aged 3 to 5?years in low- and middle-income countries.MethodsA secondary analysis of nationally representative data collected in UNICEF's Multiple Indicator Cluster Surveys (MICS) and national Demographic and Health Surveys (DHS). The early development of children aged 3 to 5?years from the randomly selected households was ascertained using a 10-item scale which assessed four developmental domains: language-cognitive, physical, socio-emotional, and approaches to learning with a total development score ranging from 0 (the least optimal) to 10 (the most optimal). Children's growth, the height-for-age Z score (HAZ), was calculated using the WHO Child Growth Standards. Unadjusted (Pearson's correlation coefficient, r) and adjusted estimations (standardised mean difference (SMD) adjusted for child sex, child age, and household wealth index) of the magnitude of the association between HAZ and ECD scores were calculated for each country.ResultsData contributed by 178,393 children aged 36 to 59?months from 55 countries were included in the analyses. The pooled r between HAZ and standardised ECD scores was 0.12 and the pooled adjusted SMD was 0.06. The r ranged from ~?0 in Barbados, Lebanon, and Moldova to 0.32 in Pakistan and 0.36 in Nigeria. Overall, 47/55 countries had correlation coefficients less than the cut-off for a small association. The adjusted SMDs were ~?0 in 20 countries. All SMDs were lower than the cut-off for a small effect size. The magnitudes of the association were highest in South Asia and lowest in Middle East and North Africa, and lowest in the highest HDI group.ConclusionsThe association between growth and development in early childhood appears to be primarily a co-occurrence because the magnitude of the association varies among settings from no association in higher-income countries to a moderate level in low-income countries. In low-income countries, interventions targeting child growth and ECD should be integrated given their common risks frequency in these settings. Overall, growth is not a sensitive and therefore suitable indicator of child development.

Project description:OBJECTIVE:To systematically review and critically appraise the evidence for the effects of interventions to improve the performance of community health workers (CHWs) for community-based primary healthcare in low- and middle-income countries. DESIGN:Systematic review following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. METHODS:19 electronic databases were searched with a highly sensitive prespecified strategy and the grey literature examined, completed July 2016. Randomised controlled trials evaluating interventions to improve CHW performance in low- and middle-income countries were included and appraised for risk of bias. Outcomes were biological and behavioural patient outcomes (primary), use of health services, quality of care provided by CHWs and CHW retention (secondary). RESULTS:Two reviewers screened 8082 records; 14 evaluations were included. Due to heterogeneity and lack of clear outcome data, no meta-analysis was conducted. Results were presented in a narrative summary. The review found one study showing no effect on the biological outcomes of interest, though these moderate quality data may not be indicative of all biological outcomes. It also found moderate quality evidence of the efficacy of performance improvement interventions for (1) improving behavioural outcomes for patients, (2) improving use of services by increasing the absolute number of patients who access services and, perhaps, better identifying those who would benefit from such services and (3) improving CHW quality of care in terms of upstream measures like completion of prescribed activities and downstream measures like adherence to treatment protocols. Nearly half of studies were compound interventions, making it difficult to isolate the effects of individual performance improvement intervention components, though four specific strategies pertaining to recruitment, supervision, incentivisation and equipment were identified. CONCLUSIONS:Variations in recruitment, supervision, incentivisation and equipment may improve CHW performance. Practitioners should, however, assess the relevance and feasibility of these strategies in their health setting prior to implementation. Component selection experiments on a greater range of interventions to improve performance ought to be conducted.

Project description:BackgroundThe strength of a health system-and ultimately the health of a population-depends to a large degree on health worker performance. However, insufficient support to build, manage and optimize human resources for health (HRH) in low- and middle-income countries (LMICs) results in inadequate health workforce performance, perpetuating health inequities and low-quality health services.MethodsThe USAID-funded Human Resources for Health in 2030 Program (HRH2030) conducted a systematic review of studies documenting supervision enhancements and approaches that improved health worker performance to highlight components associated with these interventions' effectiveness. Structured by a conceptual framework to classify the inputs, processes, and results, the review assessed 57 supervision studies since 2010 in approximately 29 LMICs.ResultsOf the successful supervision approaches described in the 57 studies reviewed, 44 were externally funded pilots, which is a limitation. Thirty focused on community health worker (CHW) programs. Health worker supervision was informed by health system data for 38 approaches (67%) and 22 approaches used continuous quality improvement (QI) (39%). Many successful approaches integrated digital supervision technologies (e.g., SmartPhones, mHealth applications) to support existing data systems and complement other health system activities. Few studies were adapted, scaled, or sustained, limiting reports of cost-effectiveness or impact.ConclusionBuilding on results from the review, to increase health worker supervision effectiveness we recommend to: integrate evidence-based, QI tools and processes; integrate digital supervision data into supervision processes; increase use of health system information and performance data when planning supervision visits to prioritize lowest-performing areas; scale and replicate successful models across service delivery areas and geographies; expand and institutionalize supervision to reach, prepare, protect, and support frontline health workers, especially during health emergencies; transition and sustain supervision efforts with domestic human and financial resources, including communities, for holistic workforce support. In conclusion, effective health worker supervision is informed by health system data, uses continuous quality improvement (QI), and employs digital technologies integrated into other health system activities and existing data systems to enable a whole system approach. Effective supervision enhancements and innovations should be better integrated, scaled, and sustained within existing systems to improve access to quality health care.

Dataset Information

Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection.

Context

Methods

Findings

Conclusions

Publications

Better Measurement for Performance Improvement in Low- and Middle-Income Countries: The Primary Health Care Performance Initiative (PHCPI) Experience of Conceptual Framework Development and Indicator Selection.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets