Dataset Information

The effect of data cleaning on record linkage quality.

ABSTRACT:

Background

Within the field of record linkage, numerous data cleaning and standardisation techniques are employed to ensure the highest quality of links. While these facilities are common in record linkage software packages and are regularly deployed across record linkage units, little work has been published demonstrating the impact of data cleaning on linkage quality.

Methods

A range of cleaning techniques was applied to both a synthetically generated dataset and a large administrative dataset previously linked to a high standard. The effect of these changes on linkage quality was investigated using pairwise F-measure to determine quality.

Results

Data cleaning made little difference to the overall linkage quality, with heavy cleaning leading to a decrease in quality. Further examination showed that decreases in linkage quality were due to cleaning techniques typically reducing the variability - although correct records were now more likely to match, incorrect records were also more likely to match, and these incorrect matches outweighed the correct matches, reducing quality overall.

Conclusions

Data cleaning techniques have minimal effect on linkage quality. Care should be taken during the data cleaning process.

SUBMITTER: Randall SM

PROVIDER: S-EPMC3688507 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The effect of data cleaning on record linkage quality.

Randall Sean M SM Ferrante Anna M AM Boyd James H JH Semmens James B JB

BMC medical informatics and decision making 20130605

<h4>Background</h4>Within the field of record linkage, numerous data cleaning and standardisation techniques are employed to ensure the highest quality of links. While these facilities are common in record linkage software packages and are regularly deployed across record linkage units, little work has been published demonstrating the impact of data cleaning on linkage quality.<h4>Methods</h4>A range of cleaning techniques was applied to both a synthetically generated dataset and a large adminis ...[more]

PMID: 23739011

Similar Datasets

Project description:Background and significanceIntravascular (IV) catheters are the most invasive medical device in healthcare. Localized priority-setting related to IV catheter quality surveillance is a key objective of recent healthcare reform in Australia. We sought to determine the plausibility of using electronic health record (EHR) data for catheter surveillance by mapping currently available data across state-wide platforms. This work has identified barriers and facilitators to a state-wide EHR surveillance initiative.Materials and methodsData variables were generated and mapped from routinely used EHR sources across Queensland, Australia through a systematic search of gray literature and expert consultation with clinical information specialists. EHR systems were eligible for inclusion if they collected data related to IV catheter insertion, care, or outcomes of hospitalized patients. Generated variables were mapped against international recommendations for IV catheter surveillance, with data linkage and data export capacity narratively summarized.ResultsWe identified five EHR systems, namely, iEMR, MetaVision ICU®, Multiprac, RiskMan, and the Nephrology Registry. Systems were used across jurisdictions and hospital wards. Data linkage was not evident across systems. Extraction processes for catheter data were not standardized, lacking clear and reliable extraction techniques. In combination, EHR systems collected 43/50 international variables recommended for catheter surveillance, however, individual systems collected a median of 24/50 (IQR 22, 30) variables. We did not identify integrated clinical analytic systems (incorporating machine learning) to support clinical decision making or for risk stratification (e.g., catheter-related infection).ConclusionCurrent data linkage across EHR systems limits the development of an IV catheter quality surveillance system to provide timely data related to catheter complications and harm. To facilitate reliable and timely surveillance of catheter outcomes using clinical informatics, substantial work is needed to overcome existing barriers and transform health surveillance.

Project description:BackgroundAdvancements in linking publicly available census records with vital and administrative records have enabled novel investigations in epidemiology and social history. However, in the absence of unique identifiers, the linkage of the records may be uncertain or only be successful for a subset of the census cohort, resulting in missing data. For survival analysis, differential ascertainment of event times can impact inference on risk associations and median survival.MethodsWe modify some existing approaches that are commonly used to handle missing survival times to accommodate this imperfect linkage situation including complete case analysis, censoring, weighting, and several multiple imputation methods. We then conduct simulation studies to compare the performance of the proposed approaches in estimating the associations of a risk factor or exposure in terms of hazard ratio (HR) and median survival times in the presence of missing survival times. The effects of different missing data mechanisms and exposure-survival associations on their performance are also explored. The approaches are applied to a historic cohort of residents in Ambler, PA, established using the 1930 US census, from which only 2,440 out of 4,514 individuals (54%) had death records retrievable from publicly available data sources and death certificates. Using this cohort, we examine the effects of occupational and paraoccupational asbestos exposure on survival and disparities in mortality by race and gender.ResultsWe show that imputation based on conditional survival results in less bias and greater efficiency relative to a complete case analysis when estimating log-hazard ratios and median survival times. When the approaches are applied to the Ambler cohort, we find a significant association between occupational exposure and mortality, particularly among black individuals and males, but not between paraoccupational exposure and mortality.DiscussionThis investigation illustrates the strengths and weaknesses of different imputation methods for missing survival times due to imperfect linkage of the administrative or registry data. The performance of the methods may depend on the missingness process as well as the parameter being estimated and models of interest, and such factors should be considered when choosing the methods to address the missing event times.

Project description:Linkage of medical databases, including insurer claims and electronic health records (EHRs), is increasingly common. However, few studies have investigated the behavior and output of linkage software. To determine how linkage quality is affected by different algorithms, blocking variables, methods for string matching and weight determination, and decision rules, we compared the performance of 4 nonproprietary linkage software packages linking patient identifiers from noninteroperable inpatient and outpatient EHRs. We linked datasets using first and last name, gender, and date of birth (DOB). We evaluated DOB and year of birth (YOB) as blocking variables and used exact and inexact matching methods. We compared the weights assigned to record pairs and evaluated how matching weights corresponded to a gold standard, medical record number. Deduplicated datasets contained 69,523 inpatient and 176,154 outpatient records, respectively. Linkage runs blocking on DOB produced weights ranging in number from 8 for exact matching to 64,273 for inexact matching. Linkage runs blocking on YOB produced 8 to 916,806 weights. Exact matching matched record pairs with identical test characteristics (sensitivity 90.48%, specificity 99.78%) for the highest ranked group, but algorithms differentially prioritized certain variables. Inexact matching behaved more variably, leading to dramatic differences in sensitivity (range 0.04-93.36%) and positive predictive value (PPV) (range 86.67-97.35%), even for the most highly ranked record pairs. Blocking on DOB led to higher PPV of highly ranked record pairs. An ensemble approach based on averaging scaled matching weights led to modestly improved accuracy. In summary, we found few differences in the rankings of record pairs with the highest matching weights across 4 linkage packages. Performance was more consistent for exact string matching than for inexact string matching. Most methods and software packages performed similarly when comparing matching accuracy with the gold standard. In some settings, an ensemble matching approach may outperform individual linkage algorithms.

Dataset Information

The effect of data cleaning on record linkage quality.

Background

Methods

Results

Conclusions

Publications

The effect of data cleaning on record linkage quality.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets