Dataset Information

Monitoring Prevalence, Treatment, and Control of Metabolic Conditions in New York City Adults Using 2013 Primary Care Electronic Health Records: A Surveillance Validation Study.

ABSTRACT:

Introduction

Electronic health records (EHRs) can potentially extend chronic disease surveillance, but few EHR-based initiatives tracking population-based metrics have been validated for accuracy. We designed a new EHR-based population health surveillance system for New York City (NYC) known as NYC Macroscope. This report is the third in a 3-part series describing the development and validation of that system. The first report describes governance and technical infrastructure underlying the NYC Macroscope. The second report describes validation methods and presents validation results for estimates of obesity, smoking, depression and influenza vaccination. In this third paper we present validation findings for metabolic indicators (hypertension, hyperlipidemia, diabetes).

Methods

We compared EHR-based estimates to those from a gold standard surveillance source - the 2013-2014 NYC Health and Nutrition Examination Survey (NYC HANES) - overall and stratified by sex and age group, using the two one-sided test of equivalence and other validation criteria.

Results

EHR-based hypertension prevalence estimates were highly concordant with NYC HANES estimates. Diabetes prevalence estimates were highly concordant when measuring diagnosed diabetes but less so when incorporating laboratory results. Hypercholesterolemia prevalence estimates were less concordant overall. Measures to assess treatment and control of the 3 metabolic conditions performed poorly.

Discussion

While indicator performance was variable, findings here confirm that a carefully constructed EHR-based surveillance system can generate prevalence estimates comparable to those from gold-standard examination surveys for certain metabolic conditions such as hypertension and diabetes.

Conclusions

Standardized EHR metrics have potential utility for surveillance at lower annual costs than surveys, especially as representativeness of contributing clinical practices to EHR-based surveillance systems increases.

SUBMITTER: Thorpe LE

PROVIDER: S-EPMC5226388 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Monitoring Prevalence, Treatment, and Control of Metabolic Conditions in New York City Adults Using 2013 Primary Care Electronic Health Records: A Surveillance Validation Study.

Thorpe Lorna E LE McVeigh Katharine H KH Perlman Sharon S Chan Pui Ying PY Bartley Katherine K Schreibstein Lauren L Rodriguez-Lopez Jesica J Newton-Dame Remle R

EGEMS (Washington, DC) 20161215 1

<h4>Introduction</h4>Electronic health records (EHRs) can potentially extend chronic disease surveillance, but few EHR-based initiatives tracking population-based metrics have been validated for accuracy. We designed a new EHR-based population health surveillance system for New York City (NYC) known as NYC Macroscope. This report is the third in a 3-part series describing the development and validation of that system. The first report describes governance and technical infrastructure underlying ...[more]

PMID: 28154836

Similar Datasets

Project description:IntroductionElectronic health records (EHRs) have the potential to offer real-time, inexpensive standardized health data about chronic health conditions. Despite rapid expansion, EHR data evaluations for chronic disease surveillance have been limited. We present design and methods for the New York City (NYC) Macroscope, an EHR-based chronic disease surveillance system. This methods report is the first in a three part series describing the development and validation of the NYC Macroscope. This report describes in detail the infrastructure underlying the NYC Macroscope; indicator definitions; design decisions that were made to maximize data quality; characteristics of the population sampled; completeness of data collected; and lessons learned from doing this work. The second report describes the methods used to evaluate the validity and robustness of NYC Macroscope prevalence estimates; presents validation results for estimates of obesity, smoking, depression and influenza vaccination; and discusses the implications of our findings for NYC and for other jurisdictions embarking on similar work. The third report applies the same validation methods to metabolic outcomes, including the prevalence, treatment and control of diabetes, hypertension and hyperlipidemia.MethodsWe designed the NYC Macroscope for comparison to a local "gold standard," the 2013-14 NYC Health and Nutrition Examination Survey, and the telephonic 2013 Community Health Survey. NYC Macroscope indicators covered prevalence, treatment, and control of diabetes, hypertension, and hyperlipidemia; and prevalence of influenza vaccination, obesity, depression and smoking. Indicators were stratified by age, sex, and neighborhood poverty, and weighted to the in-care NYC population and limited to primary care patients. Indicator queries were distributed to a virtual network of primary care practices; 392 practices and 716,076 adult patients were retained in the final sample.FindingsThe NYC Macroscope covered 10% of primary care providers and 15% of all adult patients in NYC in 2013 (8-47% of patients by neighborhood). Data completeness varied by domain from 98% for blood pressure among patients with hypertension to 33% for depression screening.DiscussionDesign and validation efforts undertaken by NYC are described here to provide one potential blueprint for leveraging EHRs for population health monitoring. To replicate a model like NYC Macroscope, jurisdictions should establish buy-in; build informatics capacity; use standard, simple case defnitions; establish documentation quality thresholds; restrict to primary care providers; and weight the sample to a target population.

Project description:IntroductionDisease registers and electronic health records are valuable resources for disease surveillance and research but can be limited by variation in data quality over time. Quality may be limited in terms of the accuracy of clinical information, of the internal linkage that supports person-based analysis of most administrative datasets, or by errors in linkage between multiple datasets.ObjectivesBy linking the National Down Syndrome Cytogenetic Register (NDSCR) to Hospital Episode Statistics for England (HES), we aimed to assess the quality of each and establish a consistent approach for analysis of trends in prevalence of Down's syndrome among live births in England.MethodsProbabilistic record linkage of NDSCR to HES for the period 1998-2013 was supported by linkage of babies to mothers within HES. Comparison of prevalence estimates in England were made using NDSCR only, HES data only, and linked data. Capture-recapture analysis and quantitative bias analysis were used to account for potential errors, including false positive diagnostic codes, unrecorded diagnoses, and linkage error.ResultsAnalyses of single-source data indicated increasing live birth prevalence of Down's Syndrome, particularly in the analysis of HES. Linked data indicated a contrastingly stable prevalence of 12.3 (plausible range: 11.6-12.7) cases per 10 000 live births.ConclusionCase ascertainment in NDSCR improved slightly over time, creating a picture of slowly increasing prevalence. The emerging epidemic suggested by HES primarily reflects improving linkage within HES (assignment of unique patient identifiers to hospital episodes). Administrative data are valuable but trends should be interpreted with caution, and with assessment of data quality over time. Data linkage with quantitative bias analysis can provide more robust estimation and, in this case, stronger evidence that prevalence is not increasing. Routine linkage of administrative and register data can enhance the value of each.

Project description:BackgroundMusculoskeletal (MSK) conditions are a common presentation in primary care. This study sought to determine the prevalence of MSK conditions in primary care in Ontario and to validate the extent to which health administrative date billing codes accurately represent MSK diagnoses.MethodsDe-identified electronic medical records (EMR) from the DELPHI database in southwestern Ontario, which contains 2493 patients (55.6% female, mean age 50.3 years (SD = 22.2)) and 21,964 encounters (July 1, 2006-June 30, 2010) were used for the analyses. Outcomes included: validation measures of agreement between International Classification of Diseases (ICD-9) diagnostic codes (health administrative data) and International Classification of Primary Care (ICPC) diagnoses defined as the reference standard, time to first ICD-9 code, prevalence, and healthcare utilization.ResultsThere were 2940 true positive MSK encounters with primary care practitioners for 998 patients. Performance of the ICD-9 diagnostic codes included sensitivity = 76.5%, specificity = 95.2%, PPV = 94.6%, and NPV = 78.7%, compared to the ICPC reference standard. The majority of 998 patients were coded with both an ICPC and ICD-9 MSK code at their first or second encounter (67.4%). However, 23.5% of patients with the ICPC reference standard MSK were never coded with ICD-9. Four-year prevalence of MSK was 52.3% and varied by age (4.5% 0-17 years, 20.1% 18-44, 42.7% 45-64, and 32.7% 65+). Patients at MSK encounters had a higher number of: investigations (17.9% compared to 9.1%, p < .0001); referrals (17.6% compared to 14.3%, p < .0001); and prescriptions for opioids (17.2% compared to 5.3%, p < .0001).ConclusionsThis study determined the prevalence of musculoskeletal conditions in primary care in Ontario using a reference standard definition. The study highlighted the value of using primary care ICPC codes to validate a definition for musculoskeletal conditions. Health administrative data can be used to ascertain the presence of musculoskeletal conditions; however, ICD-9 codes may underrepresent the prevalence of MSK conditions.

Project description:BackgroundThe importance of understanding age when estimating the impact of influenza on hospitalizations and deaths has been well described, yet existing surveillance systems have not made adequate use of age-specific data. Monitoring influenza-related morbidity using electronic health data may provide timely and detailed insight into the age-specific course, impact and epidemiology of seasonal drift and reassortment epidemic viruses. The purpose of this study was to evaluate the use of emergency department (ED) chief complaint data for measuring influenza-attributable morbidity by age and by predominant circulating virus.Methods and findingsWe analyzed electronically reported ED fever and respiratory chief complaint and viral surveillance data in New York City (NYC) during the 2001-2002 through 2005-2006 influenza seasons, and inferred dominant circulating viruses from national surveillance reports. We estimated influenza-attributable impact as observed visits in excess of a model-predicted baseline during influenza periods, and epidemic timing by threshold and cross correlation. We found excess fever and respiratory ED visits occurred predominantly among school-aged children (8.5 excess ED visits per 1,000 children aged 5-17 y) with little or no impact on adults during the early-2002 B/Victoria-lineage epidemic; increased fever and respiratory ED visits among children younger than 5 y during respiratory syncytial virus-predominant periods preceding epidemic influenza; and excess ED visits across all ages during the 2003-2004 (9.2 excess visits per 1,000 population) and 2004-2005 (5.2 excess visits per 1,000 population) A/H3N2 Fujian-lineage epidemics, with the relative impact shifted within and between seasons from younger to older ages. During each influenza epidemic period in the study, ED visits were increased among school-aged children, and each epidemic peaked among school-aged children before other impacted age groups.ConclusionsInfluenza-related morbidity in NYC was highly age- and strain-specific. The impact of reemerging B/Victoria-lineage influenza was focused primarily on school-aged children born since the virus was last widespread in the US, while epidemic A/Fujian-lineage influenza affected all age groups, consistent with a novel antigenic variant. The correspondence between predominant circulating viruses and excess ED visits, hospitalizations, and deaths shows that excess fever and respiratory ED visits provide a reliable surrogate measure of incident influenza-attributable morbidity. The highly age-specific impact of influenza by subtype and strain suggests that greater age detail be incorporated into ongoing surveillance. Influenza morbidity surveillance using electronic data currently available in many jurisdictions can provide timely and representative information about the age-specific epidemiology of circulating influenza viruses.

Project description:Post-market medical device surveillance is a challenge facing manufacturers, regulatory agencies, and health care providers. Electronic health records are valuable sources of real-world evidence for assessing device safety and tracking device-related patient outcomes over time. However, distilling this evidence remains challenging, as information is fractured across clinical notes and structured records. Modern machine learning methods for machine reading promise to unlock increasingly complex information from text, but face barriers due to their reliance on large and expensive hand-labeled training sets. To address these challenges, we developed and validated state-of-the-art deep learning methods that identify patient outcomes from clinical notes without requiring hand-labeled training data. Using hip replacements-one of the most common implantable devices-as a test case, our methods accurately extracted implant details and reports of complications and pain from electronic health records with up to 96.3% precision, 98.5% recall, and 97.4% F1, improved classification performance by 12.8-53.9% over rule-based methods, and detected over six times as many complication events compared to using structured data alone. Using these additional events to assess complication-free survivorship of different implant systems, we found significant variation between implants, including for risk of revision surgery, which could not be detected using coded data alone. Patients with revision surgeries had more hip pain mentions in the post-hip replacement, pre-revision period compared to patients with no evidence of revision surgery (mean hip pain mentions 4.97 vs. 3.23; t?=?5.14; p?<?0.001). Some implant models were associated with higher or lower rates of hip pain mentions. Our methods complement existing surveillance mechanisms by requiring orders of magnitude less hand-labeled training data, offering a scalable solution for national medical device surveillance using electronic health records.

Project description:Importance:Internationally imported cases of measles into the United States can lead to outbreaks requiring extensive and rapid control measures. Importation of measles from an unvaccinated adolescent in 2013 led to what has been the largest outbreak of measles in New York City, New York, since 1992. Objective:To describe the epidemiology and public health burden in terms of resources and cost of the 2013 measles outbreak in New York City. Design, Setting, and Participants:This epidemiologic assessment and cost analysis conducted between August 15, 2013, and August 5, 2014, examined all outbreak-associated cases of measles among persons residing in New York City in 2013. Exposures:Measles virus. Main Outcomes and Measures:Numbers of measles cases and contacts. Total personnel time and total direct cost to the New York City Department of Health and Mental Hygiene (DOHMH), calculated as the sum of inputs (supplies and materials, equipment, and logistics) and personnel time (salary and fringe benefits). Results:Between March 13, 2013, and June 9, 2013, 58 persons in New York City with a median age of 3 years (range, 0-32 years) were identified as having measles. Among these individuals, 45 (78%) were at least 12 months old and were unvaccinated owing to parental refusal or intentional delay. Only 28 individuals (48%) visited a medical health care professional who suspected measles and reported the case to the DOHMH at the initial clinical suspicion. Many case patients were not immediately placed into airborne isolation, resulting in exposures in 11 health care facilities. In total, 3351 exposed contacts were identified. Total direct costs to the New York City DOHMH were $394?448, and a total of 10?054 hours were consumed responding to and controlling the outbreak. Conclusions and Relevance:Vaccine refusals and delays appeared to have propagated a large outbreak following importation of measles into the United States. Prompt recognition of measles along with rapid implementation of airborne isolation of individuals suspected of measles infection in health care facilities and timely reporting to public health agencies may avoid large numbers of exposures. The response and containment of measles outbreaks are resource intensive.

Dataset Information

Monitoring Prevalence, Treatment, and Control of Metabolic Conditions in New York City Adults Using 2013 Primary Care Electronic Health Records: A Surveillance Validation Study.

Introduction

Methods

Results

Discussion

Conclusions

Publications

Monitoring Prevalence, Treatment, and Control of Metabolic Conditions in New York City Adults Using 2013 Primary Care Electronic Health Records: A Surveillance Validation Study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure