Measurement Error in Public Health Insurance Reporting in the American Community Survey: Evidence from Record Linkage.
Ontology highlight
ABSTRACT:
SUBMITTER: Boudreaux MH
PROVIDER: S-EPMC4693849 | biostudies-literature | 2015 Dec
REPOSITORIES: biostudies-literature
Publications
Measurement Error in Public Health Insurance Reporting in the American Community Survey: Evidence from Record Linkage.
Boudreaux Michel H MH Call Kathleen Thiede KT Turner Joanna J Fried Brett B O'Hara Brett B
Health services research 20150412 6
<h4>Objective</h4>Examine measurement error to public health insurance in the American Community Survey (ACS).<h4>Data sources/study setting</h4>The ACS and the Medicaid Statistical Information System (MSIS).<h4>Study design</h4>We tabulated the two data sources separately and then merged the data and examined health insurance reports among ACS cases known to be enrolled in Medicaid or expansion Children's Health Insurance Program (CHIP) benefits.<h4>Data collection/extraction methods</h4>The tw ...[more]
Similar Datasets
Project description:ObjectiveTo introduce the American Community Survey (ACS) and its measure of health insurance coverage to researchers and policy makers.Data sources/study settingWe compare the survey designs for the ACS and Current Population Survey (CPS) that measure insurance coverage.Study designWe describe the ACS and how it will be useful to health policy researchers.Principal findingsRelative to the CPS, the ACS will provide more precise state and substate estimates of health insurance coverage at a point-in-time. Yet the ACS lacks the historical data and detailed state-specific coverage categories seen in the CPS.ConclusionsThe ACS will be a critical new resource for researchers. To use the new data to the best advantage, careful research will be needed to understand its strengths and weaknesses.
| S-EPMC2677056 | biostudies-literature
Project description:BACKGROUND:Virtually all existing evidence linking access to firearms to elevated risks of mortality and morbidity comes from ecological and case-control studies. To improve understanding of the health risks and benefits of firearm ownership, we launched a cohort study: the Longitudinal Study of Handgun Ownership and Transfer (LongSHOT). METHODS:Using probabilistic matching techniques we linked three sources of individual-level, state-wide data in California: official voter registration records, an archive of lawful handgun transactions and all-cause mortality data. There were nearly 28.8 million unique voter registrants, 5.5 million handgun transfers and 3.1 million deaths during the study period (18 October 2004 to 31 December 2016). The linkage relied on several identifying variables (first, middle and last names; date of birth; sex; residential address) that were available in all three data sets, deploying them in a series of bespoke algorithms. RESULTS:Assembly of the LongSHOT cohort commenced in January 2016 and was completed in March 2019. Approximately three-quarters of matches identified were exact matches on all link variables. The cohort consists of 28.8?million adult residents of California followed for up to 12.2 years. A total of 1.2?million cohort members purchased at least one handgun during the study period, and 1.6?million died. CONCLUSIONS:Three steps taken early may be particularly useful in enhancing the efficiency of large-scale data linkage: thorough data cleaning; assessment of the suitability of off-the-shelf data linkage packages relative to bespoke coding; and careful consideration of the minimum sample size and matching precision needed to support rigorous investigation of the study questions.
| S-EPMC7146924 | biostudies-literature
Project description:ImportanceDespite billions spent in public investment, electronic health records (EHRs) have not delivered on the promise of large quality and safety improvement. Simultaneously, there is debate on whether public quality reporting is a useful tool to incentivize quality improvement.ObjectiveTo evaluate whether publicly reported feedback was associated with hospital improvement in an evaluation of medication-related clinical decision support (CDS) safety performance.Design, settings, and participantsThis nonrandomized controlled trial included US hospitals that participated in the Computerized Provider Order Entry (CPOE) Evaluation Tool in the Leapfrog Hospital Survey, a national quality reporting program that evaluates safety performance of hospital CDS using simulated orders and patients, in 2017 to 2018. A sharp regression discontinuity design was used to identify the association of receiving negative feedback with hospital performance improvement in the subsequent year. Data were analyzed from January through September 2020.ExposuresPublicly reported quality feedback.Main outcomes and measuresThe main outcome was improvement from 2017 to 2018 on the Leapfrog CPOE Evaluation Tool, using regression discontinuity model estimates of the association of receiving negative publicly reported feedback with quality improvement.ResultsA total of 1183 hospitals were included, with a mean (SD) CPOE score of 59.3% (16.3%) at baseline. Hospitals receiving negative feedback improved 8.44 (95% CI, 0.09 to 16.80) percentage points more in the subsequent year compared with hospitals that received positive feedback on the same evaluation. This change was driven by differences in improvement in basic CDS capabilities (β = 8.71 [95%CI, 1.67 to 18.73]) rather than advanced CDS (β = 6.15 [95% CI, -9.11 to 26.83]).Conclusions and relevanceIn this nonrandomized controlled trial, publicly reported feedback was associated with quality improvement, suggesting targeted measurement and reporting of process quality may be an effective policy lever to encourage improvement in specific areas. Clinical decision support represents an important tool in ensuring patient safety and decreasing adverse drug events, especially for complex patients and those with multiple chronic conditions who often receive several different drugs during an episode of care.
| S-EPMC8456388 | biostudies-literature
Project description:Survey researchers are increasingly seeking opportunities to link interview data with administrative records. However, obtaining consent from all survey respondents (or certain subgroups) remains a barrier to performing record linkage in many studies. We experimentally investigated whether emphasizing different benefits of record linkage to respondents in a telephone survey of employee working conditions improves respondents' willingness to consent to linkage of employment administrative records relative to a neutral consent request. We found that emphasizing linkage benefits related to "time savings" yielded a small, albeit statistically significant, improvement in the overall linkage consent rate (86.0) relative to the neutral consent request (83.8 percent). The time savings argument was particularly effective among "busy" respondents. A second benefit argument related to "improved study value" did not yield a statistically significant improvement in the linkage consent rate (84.4 percent) relative to the neutral request. This benefit argument was also ineffective among the subgroup of respondents considered to be most likely to have a self-interest in the study outcomes. The article concludes with a brief discussion of the practical implications of these findings and offers suggestions for possible research extensions.
| S-EPMC7447194 | biostudies-literature
Project description:BACKGROUND:Many public health departments use record linkage between surveillance data and external data sources to inform public health interventions. However, little guidance is available to inform these activities, and many health departments rely on deterministic algorithms that may miss many true matches. In the context of public health action, these missed matches lead to missed opportunities to deliver interventions and may exacerbate existing health inequities. OBJECTIVE:This study aimed to compare the performance of record linkage algorithms commonly used in public health practice. METHODS:We compared five deterministic (exact, Stenger, Ocampo 1, Ocampo 2, and Bosh) and two probabilistic record linkage algorithms (fastLink and beta record linkage [BRL]) using simulations and a real-world scenario. We simulated pairs of datasets with varying numbers of errors per record and the number of matching records between the two datasets (ie, overlap). We matched the datasets using each algorithm and calculated their recall (ie, sensitivity, the proportion of true matches identified by the algorithm) and precision (ie, positive predictive value, the proportion of matches identified by the algorithm that were true matches). We estimated the average computation time by performing a match with each algorithm 20 times while varying the size of the datasets being matched. In a real-world scenario, HIV and sexually transmitted disease surveillance data from King County, Washington, were matched to identify people living with HIV who had a syphilis diagnosis in 2017. We calculated the recall and precision of each algorithm compared with a composite standard based on the agreement in matching decisions across all the algorithms and manual review. RESULTS:In simulations, BRL and fastLink maintained a high recall at nearly all data quality levels, while being comparable with deterministic algorithms in terms of precision. Deterministic algorithms typically failed to identify matches in scenarios with low data quality. All the deterministic algorithms had a shorter average computation time than the probabilistic algorithms. BRL had the slowest overall computation time (14 min when both datasets contained 2000 records). In the real-world scenario, BRL had the lowest trade-off between recall (309/309, 100.0%) and precision (309/312, 99.0%). CONCLUSIONS:Probabilistic record linkage algorithms maximize the number of true matches identified, reducing gaps in the coverage of interventions and maximizing the reach of public health action.
| S-EPMC7226047 | biostudies-literature
Project description:BackgroundIn Brazil, both the Civil Registry (CR) and Ministry of Health (MoH) Mortality Information System (SIM) are sources of routine mortality data, but neither is 100% complete. Deaths from these two sources can be linked to facilitate estimation of completeness of mortality reporting and measurement of adjusted mortality indicators using generalized linear modeling (GLM).MethodsThe 2015 and 2016 CR and SIM data were linked using deterministic methods. GLM with covariates of the deceased's sex, age, state of residence, cause of death and place of death, and municipality-level education decile and population density decile, was used to estimate total deaths and completeness nationally, subnationally and by population sub-group, and to identify the characteristics of unreported deaths. The empirical completeness method and Global Burden of Disease (GBD) 2017 estimates were comparators at the national and state level.ResultsCompleteness was 98% for SIM and 95% for CR. The vast majority of deaths in Brazil were captured by either system and 94% were reported by both sources. For each source, completeness was lowest in the north. SIM completeness was consistently high across all sub-groups while CR completeness was lowest for deaths at younger ages, outside facilities, and in the lowest deciles of municipality education and population density. There was no clear municipality-level relationship in SIM and CR completeness, suggesting minimal dependence between sources. The empirical completeness method model 1 and GBD completeness estimates were each, on average, less than three percentage points different from GLM estimates at the state level. Life expectancy was lowest in the northeast and 7.5 years higher in females than males.ConclusionsGLM using socio-economic and demographic covariates is a valuable tool to accurately estimate completeness from linked data sources. Close scrutiny of the quality of variables used to link deaths, targeted identification of unreported deaths in poorer, northern states, and closer coordination of the two systems will help Brazil achieve 100% death reporting completeness. The results also confirm the validity of the empirical completeness method.
| S-EPMC7650525 | biostudies-literature
Project description:ObjectiveIntegration of patients' records across resources enhances analytics. To address privacy concerns, emerging strategies such as Bloom filter encodings (BFEs), enable integration while obscuring identifiers. However, recent investigations demonstrate BFEs are, in theory, vulnerable to cryptanalysis when encoded identifiers are randomly selected from a public resource. This study investigates the extent to which cryptanalysis conditions hold for (1) real patient records and (2) a countermeasure that obscures the frequencies of the identifying values in encoded datasets.DesignFirst, to investigate the strength of cryptanalysis for real patient records, we build BFEs from identifiers in an electronic medical record system and apply cryptanalysis using identifiers in a publicly available voter registry. Second, to investigate the countermeasure under ideal cryptanalysis conditions, we compose BFEs from the identifiers that are randomly selected from a public voter registry.MeasurementWe utilize precision (ie, rate of correct re-identified encodings) and computation efficiency (ie, time to complete cryptanalysis) to assess the performance of cryptanalysis in BFEs before and after application of the countermeasure.ResultsCryptanalysis can achieve high precision when the encoded identifiers are composed of a random sample of a public resource (ie, a voter registry). However, we also find that the attack is less efficient and may not be practical for more realistic scenarios. By contrast, the proposed countermeasure made cryptanalysis impractical in terms of precision and efficiency.ConclusionsPerformance of cryptanalysis against BFEs based on patient data is significantly lower than theoretical estimates. The proposed countermeasure makes BFEs resistant to known practical attacks.
| S-EPMC3638181 | biostudies-literature
Project description:Studies involving the use of probabilistic record linkage are becoming increasingly common. However, the methods underpinning probabilistic record linkage are not widely taught or understood, and therefore these studies can appear to be a 'black box' research tool. In this article, we aim to describe the process of probabilistic record linkage through a simple exemplar. We first introduce the concept of deterministic linkage and contrast this with probabilistic linkage. We illustrate each step of the process using a simple exemplar and describe the data structure required to perform a probabilistic linkage. We describe the process of calculating and interpreting matched weights and how to convert matched weights into posterior probabilities of a match using Bayes theorem. We conclude this article with a brief discussion of some of the computational demands of record linkage, how you might assess the quality of your linkage algorithm, and how epidemiologists can maximize the value of their record-linked research using robust record linkage methods.
| S-EPMC5005943 | biostudies-literature
Project description:Several studies have compared metagenome inference performance in different human body sites; however, none specifically reported on the vaginal microbiome. Findings from other body sites cannot easily be generalized to the vaginal microbiome due to unique features of vaginal microbial ecology, and investigators seeking to use metagenome inference in vaginal microbiome research are "flying blind" with respect to potential bias these methods may introduce into analyses. We compared the performance of PICRUSt2 and Tax4Fun2 using paired 16S rRNA gene amplicon sequencing and whole-metagenome sequencing data from vaginal samples from 72 pregnant individuals enrolled in the Pregnancy, Infection, and Nutrition (PIN) cohort. Participants were selected from those with known birth outcomes and adequate 16S rRNA gene amplicon sequencing data in a case-control design. Cases experienced early preterm birth (<32 weeks of gestation), and controls experienced term birth (37 to 41 weeks of gestation). PICRUSt2 and Tax4Fun2 performed modestly overall (median Spearman correlation coefficients between observed and predicted KEGG ortholog [KO] relative abundances of 0.20 and 0.22, respectively). Both methods performed best among Lactobacillus crispatus-dominated vaginal microbiotas (median Spearman correlation coefficients of 0.24 and 0.25, respectively) and worst among Lactobacillus iners-dominated microbiotas (median Spearman correlation coefficients of 0.06 and 0.11, respectively). The same pattern was observed when evaluating correlations between univariable hypothesis test P values generated with observed and predicted metagenome data. Differential metagenome inference performance across vaginal microbiota community types can be considered differential measurement error, which often causes differential misclassification. As such, metagenome inference will introduce hard-to-predict bias (toward or away from the null) in vaginal microbiome research. IMPORTANCE Compared to taxonomic composition, the functional potential within a bacterial community is more relevant to establishing mechanistic understandings and causal relationships between the microbiome and health outcomes. Metagenome inference attempts to bridge the gap between 16S rRNA gene amplicon sequencing and whole-metagenome sequencing by predicting a microbiome's gene content based on its taxonomic composition and annotated genome sequences of its members. Metagenome inference methods have been evaluated primarily among gut samples, where they appear to perform fairly well. Here, we show that metagenome inference performance is markedly worse for the vaginal microbiome and that performance varies across common vaginal microbiome community types. Because these community types are associated with sexual and reproductive outcomes, differential metagenome inference performance will bias vaginal microbiome studies, obscuring relationships of interest. Results from such studies should be interpreted with substantial caution and the understanding that they may over- or underestimate associations with metagenome content.
| S-EPMC10134888 | biostudies-literature
Project description:Few biomarker-based validation studies have examined error in online self-report dietary assessment instruments, and food records (FRs) have been considered less than food frequency questionnaires (FFQs) and 24-hour recalls (24HRs). We investigated measurement error in online and paper-based FFQs, online 24HRs, and paper-based FRs in 3 samples drawn primarily from 3 cohorts, comprising 1,393 women and 1,455 men aged 45-86 years. Data collection occurred from January 2011 to October 2013. Attenuation factors and correlation coefficients between reported and true usual intake for energy, protein, sodium, potassium, and respective densities were estimated using recovery biomarkers. Across studies, average attenuation factors for energy were 0.07, 0.07, and 0.19 for a single FFQ, 24HR, and FR, respectively. Correlation coefficients for energy were 0.24, 0.23, and 0.40, respectively. Excluding energy, the average attenuation factors across nutrients and studies were 0.22 for a single FFQ, 0.22 for a single 24HR, and 0.51 for a single FR. Corresponding correlation coefficients were 0.31, 0.34, and 0.53, respectively. For densities (nutrient expressed relative to energy), the average attenuation factors across studies were 0.37, 0.17, and 0.50, respectively. The findings support prior research suggesting different instruments have unique strengths that should be leveraged in epidemiologic research.
| S-EPMC9393065 | biostudies-literature