Comparison of Electronic Health Record-Based and Claims-Based Diabetes Care Quality Measures: Causes of Discrepancies.
Ontology highlight
ABSTRACT: Objective
To investigate magnitude and sources of discrepancy in quality metrics using claims versus electronic health record (EHR) data.Study design
Assessment of proportions of HbA1c and LDL testing for people ascertained as diabetic from the respective sources. Qualitative interviews and review of EHRs of discrepant cases.Data collection/extraction
Claims submitted to Rhode Island Medicaid by three practice sites in 2013; program-coded EHR extraction; manual review of selected EHRs.Principal findings
Of 21,030 adult Medicaid beneficiaries attributed to a primary care patient at a site by claims or EHR data, concordance on assignment ranged from 0.30 to 0.41. Of patients with concordant assignment, the ratio of patients ascertained as diabetic by EHR versus claims ranged from 1.06 to 1.14. For patients with concordant assignment and diagnosis, the ratio based on EHR versus claims ranged from 1.08 to 18.34 for HbA1c testing, and from 1.29 to 14.18 for lipid testing. Manual record review of 264 patients discrepant on diagnosis or testing identified problems such as misuse of ICD-9 codes, failure to submit claims, and others.Conclusions
Claims data underestimate performance on these metrics compared to EHR documentation, by varying amounts. Use of claims data for these metrics is problematic.
SUBMITTER: Laws MB
PROVIDER: S-EPMC6056571 | biostudies-literature | 2018 Aug
REPOSITORIES: biostudies-literature
Publications
Comparison of Electronic Health Record-Based and Claims-Based Diabetes Care Quality Measures: Causes of Discrepancies.
Laws Michael Barton MB Michaud Joanne J Shield Renee R McQuade William W Wilson Ira B IB
Health services research 20171228
<h4>Objective</h4>To investigate magnitude and sources of discrepancy in quality metrics using claims versus electronic health record (EHR) data.<h4>Study design</h4>Assessment of proportions of HbA1c and LDL testing for people ascertained as diabetic from the respective sources. Qualitative interviews and review of EHRs of discrepant cases.<h4>Data collection/extraction</h4>Claims submitted to Rhode Island Medicaid by three practice sites in 2013; program-coded EHR extraction; manual review of ...[more]
Similar Datasets
Project description:IntroductionAlthough infrequently recorded in electronic health records (EHRs), measures of SES are essential to describe health inequalities and account for confounding in epidemiologic research. Medical Assistance (i.e., Medicaid) is often used as a surrogate for SES, but correspondence between conventional SES and Medical Assistance has been insufficiently studied.MethodsGeisinger Clinic EHR data from 2001 to 2014 and a 2014 questionnaire were used to create six SES measures: EHR-derived Medical Assistance and proportion of time under observation on Medical Assistance; educational attainment, income, and marital status; and area-level poverty. Analyzed in 2016-2017, associations of SES measures with obesity, hypertension, type 2 diabetes, chronic rhinosinusitis, fatigue, and migraine headache were assessed using weighted age- and sex-adjusted logistic regression.ResultsAmong 5,550 participants (interquartile range, 39.6-57.5 years, 65.9% female), 83% never used Medical Assistance. All SES measures were correlated (Spearman's p≤0.4). Medical Assistance was significantly associated with all six health outcomes in adjusted models. For example, the OR for prevalent type 2 diabetes associated with Medical Assistance was 1.7 (95% CI=1.3, 2.2); the OR for high school versus college graduates was 1.7 (95% CI=1.2, 2.5). Medical Assistance was an imperfect proxy for SES: associations between conventional SES measures and health were attenuated <20% after adjustment for Medical Assistance.ConclusionsBecause systematically collected SES measures are rarely available in EHRs and are unlikely to appear soon, researchers can use EHR-based Medical Assistance to describe inequalities. As SES has many domains, researchers who use Medical Assistance to evaluate the association of SES with health should expect substantial unmeasured confounding.
| S-EPMC5818301 | biostudies-literature
Project description:IntroductionPregnancy outcome identification and precise estimates of gestational age (GA) are critical in drug safety studies of pregnant women. Validated pregnancy outcome algorithms based on the International Classification of Diseases, Tenth Revision, Clinical Modification/Procedure Coding System (ICD-10-CM/PCS) have not previously been published.MethodsWe developed algorithms to classify pregnancy outcomes and estimate GA using ICD-10-CM/PCS and service codes on claims in the 2016-2018 IBM® MarketScan® Explorys® Claims-EMR Data Set and compared the results with ob-gyn adjudication of electronic medical records (EMRs). Obstetric services were grouped into episodes using hierarchical and spacing requirements. GA was based on evidence with the highest clinical accuracy. Among pregnancies with obstetric EMRs, 100 full-term live births (FTBs), 100 preterm live births (PTBs), 100 spontaneous abortions (SAs), and 24 stillbirths were selected for review. Physicians adjudicated cases using Global Alignment of Immunization safety Assessment in pregnancy (GAIA) definitions applied to structured EMRs.ResultsThe claims-based algorithms identified 34,204 pregnancies, of which 9.9% had obstetric EMRs. Of sampled pregnancies, 92 FTBs, 93 PTBs, 75 SAs, and 24 stillbirths were adjudicated. Among these pregnancies, the percent agreement was 97.8%, 62.4%, 100.0%, and 70.8% for FTBs, PTBs, SAs, and stillbirths, respectively. The percent agreement on GA within 7 and 28 days, respectively, was 85.9% and 100.0% for FTBs, 81.7% and 98.9% for PTBs, 61.3% and 94.7% for SAs, and 66.7% and 79.2% for stillbirths.ConclusionsThe pregnancy outcome algorithms had high agreement with physician adjudication of EMRs and may inform post-market maternal safety surveillance.
| S-EPMC8481319 | biostudies-literature
Project description:BackgroundHypertension is the most prevalent risk factor for mortality globally. Uncontrolled hypertension is associated with excess morbidity and mortality, and nearly one-half of individuals with hypertension do not have the condition under control. Data from electronic health record (EHR) systems may be useful for community hypertension surveillance, filling a gap in local public health departments' community health assessments and supporting the public health data modernization initiatives currently underway. To identify patients with hypertension, computable phenotypes are required. These phenotypes leverage available data elements-such as vitals measurements and medications-to identify patients diagnosed with hypertension. However, there are multiple methodologies for creating a phenotype, and the identification of which method most accurately reflects real-world prevalence rates is needed to support data modernization initiatives.ObjectiveThis study sought to assess the comparability of 6 different EHR-based hypertension prevalence estimates with estimates from a national survey. Each of the prevalence estimates was created using a different computable phenotype. The overarching goal is to identify which phenotypes most closely align with nationally accepted estimations.MethodsUsing the 6 different EHR-based computable phenotypes, we calculated hypertension prevalence estimates for Marion County, Indiana, for the period from 2014 to 2015. We extracted hypertension rates from the Behavioral Risk Factor Surveillance System (BRFSS) for the same period. We used the two 1-sided t test (TOST) to test equivalence between BRFSS- and EHR-based prevalence estimates. The TOST was performed at the overall level as well as stratified by age, gender, and race.ResultsUsing both 80% and 90% CIs, the TOST analysis resulted in 2 computable phenotypes demonstrating rough equivalence to BRFSS estimates. Variation in performance was noted across phenotypes as well as demographics. TOST with 80% CIs demonstrated that the phenotypes had less variance compared to BRFSS estimates within subpopulations, particularly those related to racial categories. Overall, less variance occurred on phenotypes that included vitals measurements.ConclusionsThis study demonstrates that certain EHR-derived prevalence estimates may serve as rough substitutes for population-based survey estimates. These outcomes demonstrate the importance of critically assessing which data elements to include in EHR-based computer phenotypes. Using comprehensive data sources, containing complete clinical data as well as data representative of the population, are crucial to producing robust estimates of chronic disease. As public health departments look toward data modernization activities, the EHR may serve to assist in more timely, locally representative estimates for chronic disease prevalence.
| S-EPMC10973965 | biostudies-literature
Project description:ImportanceCardiovascular disease is the leading cause of death in the United States. To improve cardiovascular outcomes, primary care must have valid methods of assessing performance on cardiovascular clinical quality measures, including aspirin use (aspirin measure), blood pressure control (BP measure), and smoking cessation counseling and intervention (smoking measure).ObjectiveTo compare observed performance scores measured using 2 imperfect reference standard data sources (medical record abstraction [MRA] and electronic health record [EHR]-generated reports) with misclassification-adjusted performance scores obtained using bayesian latent class analysis.Design, setting, and participantsThis cross-sectional study used a subset of the 2016 aspirin, BP, and smoking performance data from the Healthy Hearts for Oklahoma Project. Each clinical quality measure was calculated for a subset of a practice's patient population who can benefit from recommended care (ie, the eligible population). A random sample of 380 eligible patients were included for the aspirin measure; 126, for the BP measure; and 115, for the smoking measure. Data were collected from 21 primary care practices belonging to a single large health care system from January 1 to December 31, 2018, and analyzed from February 21 to April 17, 2019.Main outcomes and measuresThe main outcomes include performance scores for the aspirin, BP, and smoking measures using imperfect MRA and EHRs and estimated through bayesian latent class models.ResultsA total of 621 eligible patients were included in the analysis. Based on MRA and EHR data, observed aspirin performance scores were 76.0% (95% bayesian credible interval [BCI], 71.5%-80.1%) and 74.9% (95% BCI, 70.4%-79.1%), respectively; observed BP performance scores, 80.6% (95% BCI, 73.2%-86.9%) and 75.1% (95% BCI, 67.2%-82.1%), respectively; and observed smoking performance scores, 85.7% (95% BCI, 78.6%-91.2%) and 75.4% (95% BCI, 67.0%-82.6%), respectively. Misclassification-adjusted estimates were 74.9% (95% BCI, 70.5%-79.1%) for the aspirin performance score, 75.0% (95% BCI, 66.6%-82.5%) for the BP performance score, and 83.0% (95% BCI, 74.4%-89.8%) for the smoking performance score.Conclusions and relevanceEnsuring valid performance measurement is critical for value-based payment models and quality improvement activities in primary care. This study found that extracting information for the same individuals using different data sources generated different performance score estimates. Further research is required to identify the sources of these differences.
| S-EPMC7388024 | biostudies-literature
Project description:BackgroundCreation of a new electronic health record (EHR)-based registry often can be a "one-off" complex endeavor: first developing new EHR data collection and clinical decision support tools, followed by developing registry-specific data extractions from the EHR for analysis. Each development phase typically has its own long development and testing time, leading to a prolonged overall cycle time for delivering one functioning registry with companion reporting into production. The next registry request then starts from scratch. Such an approach will not scale to meet the emerging demand for specialty registries to support population health and value-based care.ObjectiveTo determine if the creation of EHR-based specialty registries could be markedly accelerated by employing (a) a finite core set of EHR data collection principles and methods, (b) concurrent engineering of data extraction and data warehouse design using a common dimensional data model for all registries, and (c) agile development methods commonly employed in new product development.MethodsWe adopted as guiding principles to (a) capture data as a byproduct of care of the patient, (b) reinforce optimal EHR use by clinicians, (c) employ a finite but robust set of EHR data capture tool types, and (d) leverage our existing technology toolkit. Registries were defined by a shared condition (recorded on the Problem List) or a shared exposure to a procedure (recorded on the Surgical History) or to a medication (recorded on the Medication List). Any EHR fields needed - either to determine registry membership or to calculate a registry-associated clinical quality measure (CQM) - were included in the enterprise data warehouse (EDW) shared dimensional data model. Extract-transform-load (ETL) code was written to pull data at defined "grains" from the EHR into the EDW model. All calculated CQM values were stored in a single Fact table in the EDW crossing all registries. Registry-specific dashboards were created in the EHR to display both (a) real-time patient lists of registry patients and (b) EDW-generated CQM data. Agile project management methods were employed, including co-development, lightweight requirements documentation with User Stories and acceptance criteria, and time-boxed iterative development of EHR features in 2-week "sprints" for rapid-cycle feedback and refinement.ResultsUsing this approach, in calendar year 2015 we developed a total of 43 specialty chronic disease registries, with 111 new EHR data collection and clinical decision support tools, 163 new clinical quality measures, and 30 clinic-specific dashboards reporting on both real-time patient care gaps and summarized and vetted CQM measure performance trends.ConclusionsThis study suggests concurrent design of EHR data collection tools and reporting can quickly yield useful EHR structured data for chronic disease registries, and bodes well for efforts to migrate away from manual abstraction. This work also supports the view that in new EHR-based registry development, as in new product development, adopting agile principles and practices can help deliver valued, high-quality features early and often.
| S-EPMC5608102 | biostudies-literature
Project description:ContextPalliative care can improve the lives of people with serious illness, yet clear operational definitions of this population do not exist. Prior efforts to identify this population have not focused on Medicare Advantage (MA) and commercial health plan enrollees.ObjectivesWe aimed to operationalize our conceptual definition of serious illness to identify those with serious medical conditions (SMC) among commercial insurance and MA enrollees, and to compare the populations identified through electronic health record (EHR) or claims data sources.MethodsWe used de-identified claims and EHR data from the OptumLabs Data Warehouse (2016-2017), to identify adults age ≥18 with SMC and examine their utilization and mortality. Within the subset found in both data sources, we compared the performance of claims and EHR data.ResultsWithin claims, SMC was identified among 10% of those aged ≥18 (5.4% ages 18-64, 27% age ≥65). Within EHR, SMC was identified among 9% of those aged ≥18 (5.6% ages 18-64, 21% ages ≥65). Hospital, emergency department and mortality rates were similar between the EHR and claims-based groups. Only 50% of people identified as having SMC were recognized by both data sources.ConclusionThese results demonstrate the feasibility of identifying adults with SMC in a commercially insured population, including MA enrollees; yet separate use of EHR or claims result in populations that differ. Future research should examine methods to combine these data sources to optimize identification and support population management, quality measurement, and research to improve the care of those living with serious illness.
| S-EPMC8419009 | biostudies-literature
Project description:ObjectiveTo explore the extent to which commonly used claims-based process quality indicators can be used to create an internally valid global composite measure of physician practice quality.Data sourcesHealth insurance claims data (October 2007-May 2010) from 134 physician practices in Seattle, WA.Study designWe use confirmatory and exploratory factor analysis to develop theory- and empirically driven internally valid composite measures based on 19 quality indicators.Data collection methodsHealth insurance claims data from nine insurance companies and self-funded employers were collected and aggregated by third-party organization.Principal findingsOur results did not support a single global measure using the entire set of quality indicators. We did identify an acceptable multidimensional model (RMSEA = 0.059; CFI = 0.934; TLI = 0.910). The four dimensions in our data were diabetes, depression, preventive care, and generic drug prescribing.ConclusionsOur study demonstrates that commonly used process indicators can be used to create a small set of useful composite measures. However, the lack of an internally valid single unidimensional global measure has important implications for policy approaches meant to improve quality by rewarding "high-quality physicians."
| S-EPMC5441486 | biostudies-literature
Project description:ObjectiveAmbiguous definitions of quality measures in natural language impede their automated computability and also the reproducibility, validity, timeliness, traceability, comparability, and interpretability of computed results. Therefore, quality measures should be formalized before their release. We have previously developed and successfully applied a method for clinical indicator formalization (CLIF). The objective of our present study is to test whether CLIF is generalizable--that is, applicable to a large set of heterogeneous measures of different types and from various domains.Materials and methodsWe formalized the entire set of 159 Dutch quality measures for general practice, which contains structure, process, and outcome measures and covers seven domains. We relied on a web-based tool to facilitate the application of our method. Subsequently, we computed the measures on the basis of a large database of real patient data.ResultsOur CLIF method enabled us to fully formalize 100% of the measures. Owing to missing functionality, the accompanying tool could support full formalization of only 86% of the quality measures into Structured Query Language (SQL) queries. The remaining 14% of the measures required manual application of our CLIF method by directly translating the respective criteria into SQL. The results obtained by computing the measures show a strong correlation with results computed independently by two other parties.ConclusionsThe CLIF method covers all quality measures after having been extended by an additional step. Our web tool requires further refinement for CLIF to be applied completely automatically. We therefore conclude that CLIF is sufficiently generalizable to be able to formalize the entire set of Dutch quality measures for general practice.
| S-EPMC3932459 | biostudies-literature
Project description:We describe quality improvement and practice-based research using the electronic medical record (EMR) in a community health system-based department of neurology. Our care transformation initiative targets 10 neurologic disorders (brain tumors, epilepsy, migraine, memory disorders, mild traumatic brain injury, multiple sclerosis, neuropathy, Parkinson disease, restless legs syndrome, and stroke) and brain health (risk assessments and interventions to prevent Alzheimer disease and related disorders in targeted populations). Our informatics methods include building and implementing structured clinical documentation support tools in the EMR; electronic data capture; enrollment, data quality, and descriptive reports; quality improvement projects; clinical decision support tools; subgroup-based adaptive assignments and pragmatic trials; and DNA biobanking. We are sharing EMR tools and deidentified data with other departments toward the creation of a Neurology Practice-Based Research Network. We discuss practical points to assist other clinical practices to make quality improvements and practice-based research in neurology using the EMR a reality.
| S-EPMC4634157 | biostudies-literature
Project description:PURPOSE:Data from claims and electronic medical records (EMRs) are frequently used to identify clinical events (eg, cancer diagnosis, stroke). However, accurately determining the time of clinical events can be challenging, and the methods used to generate time estimates are underdeveloped. We sought to develop an approach to determine the time of a clinical event-cancer recurrence-using high-dimensional longitudinal structured data. METHODS:Manual chart abstraction provided information regarding the actual time of cancer recurrence. These data were linked to claims from Medicare or structured EMR data from the Cancer Research Network, which were used to determine time of recurrence for patients with lung or colorectal cancer. We analyzed the longitudinal profile of codes that could help determine the time of recurrence, adjusted for systematic differences between code dates and recurrence dates, and integrated time estimates from different codes to empirically derive an optimal algorithm. RESULTS:We identified twelve code groups that could help determine the time of recurrence. Using claims data for patients with lung cancer, the optimal algorithm consisted of three code groups and provided an average prediction error of 4.8 months. Using EMR data or applying this approach to patients with colorectal cancer yielded similar results. CONCLUSION:Time estimates were improved by selecting codes not necessarily the same as those used to identify recurrence, combining time estimates from multiple code groups, and adjusting for systematic bias between code dates and recurrence dates. Improving the accuracy of time estimates for clinical events can facilitate research, quality measurement, and process improvement.
| S-EPMC6338474 | biostudies-literature