Dataset Information

Methodological considerations for linking household and healthcare provider data for estimating effective coverage: a systematic review.

ABSTRACT:

Objective

To assess existing knowledge related to methodological considerations for linking population-based surveys and health facility data to generate effective coverage estimates. Effective coverage estimates the proportion of individuals in need of an intervention who receive it with sufficient quality to achieve health benefit.

Design

Systematic review of available literature.

Data sources

Medline, Carolina Population Health Center and Demographic and Health Survey publications and handsearch of related or referenced works of all articles included in full text review. The search included publications from 1 January 2000 to 29 March 2021.

Eligibility criteria

Publications explicitly evaluating (1) the suitability of data, (2) the implications of the design of existing data sources and (3) the impact of choice of method for combining datasets to obtain linked coverage estimates.

Results

Of 3805 papers reviewed, 70 publications addressed relevant issues. Limited data suggest household surveys can be used to identify sources of care, but their validity in estimating intervention need was variable. Methods for collecting provider data and constructing quality indices were diverse and presented limitations. There was little empirical data supporting an association between structural, process and outcome quality. Few studies addressed the influence of the design of common data sources on linking analyses, including imprecise household geographical information system data, provider sampling design and estimate stability. The most consistent evidence suggested under certain conditions, combining data based on geographical proximity or administrative catchment (ecological linking) produced similar estimates to linking based on the specific provider utilised (exact match linking).

Conclusions

Linking household and healthcare provider data can leverage existing data sources to generate more informative estimates of intervention coverage and care. However, existing evidence on methods for linking data for effective coverage estimation are variable and numerous methodological questions remain. There is need for additional research to develop evidence-based, standardised best practices for these analyses.

SUBMITTER: Carter ED

PROVIDER: S-EPMC8395298 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundExisting population-based surveys have limited accuracy for estimating the coverage and quality of management of child illness. Linking household survey data with health care provider assessments has been proposed as a means of generating more informative population-level estimates of effective coverage, but methodological issues need to be addressed.MethodsA 2016 survey estimated effective coverage of management of child illness in Southern Province, Zambia, using multiple methods for linking temporally and geographically proximate household and health care provider data. Mothers of children <5 years were surveyed about seeking care for child illness. Information on health care providers' capacity to manage child illness, or structural quality, was assessed using case scenarios and a tool modeled on the WHO Service Availability and Readiness Assessment (SARA). Each sick child was assigned the structural quality score of their stated (exact-match) source of care. Effective coverage was calculated as the average structural quality experienced by all sick children. Children were also ecologically linked to providers using measures of geographic proximity, with and without data on non-facility providers, to assess the effects of these linking methods on effective coverage estimates.ResultsData were collected on 83 providers and 385 children with fever, diarrhea, and/or symptoms of ARI in the preceding 2 weeks. Most children sought care from government facilities or community-based agents (CBAs). Effective coverage of management of child illness estimated through exact-match linking was approximately 15-points lower in each stratum than coverage of seeking skilled care due to providers' limited structural quality. Estimates generated using most measures of geographic proximity were similar to the exact-match estimate, with the exception of the kernel density estimation method in the urban area. Estimates of coverage in rural areas were greatly reduced across all methods using facility-only data if seeking care from CBAs was treated as unskilled care.ConclusionsLinking household and provider data may generate more informative estimates of effective coverage of management of child illness. Ecological linking with provider data on a sample of all skilled providers may be as effective as exact-match linking in areas with low variation in structural quality within a provider category or minimal provider bypassing.

Project description:BackgroundPopulation-based measures of intervention coverage are used in low- and middle-income countries for program planning, prioritization, and evaluation. There is increased interest in effective coverage, which integrates information about service quality or health outcomes. Approaches proposed for quality-adjusted effective coverage include linking data on need and service contact from population-based surveys with data on service quality from health facility surveys. However, there is limited evidence about the validity of different linking methods for effective coverage estimation.MethodsWe collaborated with the 2016 Côte d'Ivoire Multiple Indicator Cluster Survey (MICS) to link data from a health provider assessment to care-seeking data collected by the MICS in the Savanes region of Côte d'Ivoire. The provider assessment was conducted in a census of public and non-public health facilities and pharmacies in Savanes in May-June 2016. We also included community health workers managing sick children who served the clusters sampled for the MICS. The provider assessment collected information on structural and process quality for antenatal care, delivery and immediate newborn care, postnatal care, and sick child care. We linked the MICS and provider data using exact-match and ecological linking methods, including aggregate linking and geolinking methods. We compared the results obtained from exact-match and ecological methods.ResultsWe linked 731 of 786 care-seeking episodes (93%) from the MICS to a structural quality score for the provider named by the respondent. Effective coverage estimates computed using exact-match methods were 13%-63% lower than the care-seeking estimates from the MICS. Absolute differences between exact match and ecological linking methods were ±7 percentage points for all ecological methods. Incorporating adjustments for provider category and weighting by service-specific utilization into the ecological methods generally resulted in better agreement between ecological and exact match estimates.ConclusionsEcological linking may be a feasible and valid approach for estimating quality-adjusted effective coverage when a census of providers is used. Adjusting for provider type and caseload may improve agreement with exact match results. There remain methodological questions to be addressed to develop guidance on using linking methods for estimating quality-adjusted effective coverage, including the effect of facility sampling and time displacement.

Project description:BackgroundCurrently many measures of intervention coverage obtained from household surveys do not measure actual health intervention/service delivery, resulting in a need for linking reports of care-seeking with assessments of the service environment in order to improve measurements. This systematic review aims to identify evidence of different methods used to link household surveys and service provision assessments, with a focus on reproductive, maternal, newborn and child health care, in low- and middle-income countries.MethodsUsing pre-defined search terms, articles published in peer-reviewed journals and the grey literature after 1990 were identified, their reference lists scanned and linking methods synthesized.FindingsA total of 59 articles and conference presentations were carefully reviewed and categorized into two groups based on the linking method used: 1) indirect/ecological linking that included studies in which health care-seeking behavior was linked to all or the nearest facilities or providers of certain types within a geographical area, and 2) direct linking/exact matching where individuals were linked with the exact provider or facility where they sought care. The former approach was employed in 51 of 59 included studies, and was particularly common among studies that were based on independent sources of household and facility data that were nationally representative. Only eight of the 59 reviewed studies employed direct linking methods, which were typically done at the sub-national level (eg, district level) and often in rural areas, where the number of providers was more limited compared to urban areas.ConclusionsDifferent linking methods have been reported in the literature, each category has its own set of advantages and limitations, in terms of both methodology and practicality for scale-up. Future studies that link household and provider/facility data should also take into account factors such as sources of data, the timing of surveys, the temporality of data points, the type of services and interventions, and the scale of the study in order to produce valid and reliable results.

Project description:BackgroundWith increasing use of real world data in observational health care research, data quality assessment of these data is equally gaining in importance. Electronic health record (EHR) or claims datasets can differ significantly in the spectrum of care covered by the data.ObjectiveIn our study, we link provider specialty with diagnoses (encoded in International Classification of Diseases) with a motivation to characterize data completeness.MethodsWe develop a set of measures that determine diagnostic span of a specialty (how many distinct diagnosis codes are generated by a specialty) and specialty span of a diagnosis (how many specialties diagnose a given condition). We also analyze ranked lists for both measures. As use case, we apply these measures to outpatient Medicare claims data from 2016 (3.5 billion diagnosis-specialty pairs). We analyze 82 distinct specialties present in Medicare claims (using Medicare list of specialties derived from level III Healthcare Provider Taxonomy Codes).ResultsA typical specialty diagnoses on average 4,046 distinct diagnosis codes. It can range from 33 codes for medical toxicology to 25,475 codes for internal medicine. Specialties with large visit volume tend to have large diagnostic span. Median specialty span of a diagnosis code is 8 specialties with a range from 1 to 82 specialties. In total, 13.5% of all observed diagnoses are generated exclusively by a single specialty. Quantitative cumulative rankings reveal that some diagnosis codes can be dominated by few specialties. Using such diagnoses in cohort or outcome definitions may thus be vulnerable to incomplete specialty coverage of a given dataset.ConclusionWe propose specialty fingerprinting as a method to assess data completeness component of data quality. Datasets covering a full spectrum of care can be used to generate reference benchmark data that can quantify relative importance of a specialty in constructing diagnostic history elements of computable phenotype definitions.

Project description:Calls have been made for improved measurement of coverage for maternal, newborn and child health interventions. Recently, methods linking household and health facility surveys have been used to improve estimation of intervention coverage. However, linking methods rely the availability of household and health facility surveys which are temporally matched. Because nationally representative health facility assessments are not yet routinely conducted in many low and middle income countries, estimates of intervention coverage based on linking methods can be produced for only a subset of countries. Estimates of intervention coverage are a critical input for modelling the health impact of intervention scale-up in the Lives Saved Tool (LiST). The purpose of this study was to develop a data-driven approach to estimate coverage for a subset of antenatal care interventions modeled in LiST.Using a five-step process, estimates of population level coverage for syphilis detection and treatment, case management of diabetes, malaria infection, hypertensive disorders, and pre-eclampsia, were computed by linking household and health facility surveys. Based on data characterizing antenatal care and estimates of coverage derived from the linking approach, predictive models for intervention coverage were developed. Updated estimates of coverage based on the predictive models were compared, first with current default proxies, then with estimates based on the linking approach. Model fit and accuracy were assessed using three measures: the coefficient of determination, Pearson's correlation coefficient, and the root mean square error (RMSE).The ability to predict intervention coverage was fairly accurate across all interventions considered. Predictive models accounted for 20-63% of the variance in intervention coverages, and correlation coefficients ranged from 0.5 to 0.83. The predictive model used to estimate coverage of management of pre-eclampsia performed relatively better (RMSE = 0.11) than the model estimating coverage of diabetes case management (RMSE = 0.19).The new approach to estimate coverage represents an improvement over current default proxies in LiST. As the availability of reliable coverage data improves, impact estimates generated by LiST will improve. This study underscores the need for continued efforts to improve coverage measurement, while bringing to the fore the importance of health facility assessments as complementary data sources.