Dataset Information

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

ABSTRACT:

Introduction

Electronic health records (EHRs) have the potential to offer real-time, inexpensive standardized health data about chronic health conditions. Despite rapid expansion, EHR data evaluations for chronic disease surveillance have been limited. We present design and methods for the New York City (NYC) Macroscope, an EHR-based chronic disease surveillance system. This methods report is the first in a three part series describing the development and validation of the NYC Macroscope. This report describes in detail the infrastructure underlying the NYC Macroscope; indicator definitions; design decisions that were made to maximize data quality; characteristics of the population sampled; completeness of data collected; and lessons learned from doing this work. The second report describes the methods used to evaluate the validity and robustness of NYC Macroscope prevalence estimates; presents validation results for estimates of obesity, smoking, depression and influenza vaccination; and discusses the implications of our findings for NYC and for other jurisdictions embarking on similar work. The third report applies the same validation methods to metabolic outcomes, including the prevalence, treatment and control of diabetes, hypertension and hyperlipidemia.

Methods

We designed the NYC Macroscope for comparison to a local "gold standard," the 2013-14 NYC Health and Nutrition Examination Survey, and the telephonic 2013 Community Health Survey. NYC Macroscope indicators covered prevalence, treatment, and control of diabetes, hypertension, and hyperlipidemia; and prevalence of influenza vaccination, obesity, depression and smoking. Indicators were stratified by age, sex, and neighborhood poverty, and weighted to the in-care NYC population and limited to primary care patients. Indicator queries were distributed to a virtual network of primary care practices; 392 practices and 716,076 adult patients were retained in the final sample.

Findings

The NYC Macroscope covered 10% of primary care providers and 15% of all adult patients in NYC in 2013 (8-47% of patients by neighborhood). Data completeness varied by domain from 98% for blood pressure among patients with hypertension to 33% for depression screening.

Discussion

Design and validation efforts undertaken by NYC are described here to provide one potential blueprint for leveraging EHRs for population health monitoring. To replicate a model like NYC Macroscope, jurisdictions should establish buy-in; build informatics capacity; use standard, simple case defnitions; establish documentation quality thresholds; restrict to primary care providers; and weight the sample to a target population.

SUBMITTER: Newton-Dame R

PROVIDER: S-EPMC5226383 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

Newton-Dame Remle R McVeigh Katharine H KH Schreibstein Lauren L Perlman Sharon S Lurie-Moroni Elizabeth E Jacobson Laura L Greene Carolyn C Snell Elisabeth E Thorpe Lorna E LE

EGEMS (Washington, DC) 20161215 1

<h4>Introduction</h4>Electronic health records (EHRs) have the potential to offer real-time, inexpensive standardized health data about chronic health conditions. Despite rapid expansion, EHR data evaluations for chronic disease surveillance have been limited. We present design and methods for the New York City (NYC) Macroscope, an EHR-based chronic disease surveillance system. This methods report is the first in a three part series describing the development and validation of the NYC Macroscope ...[more]

PMID: 28154835

Similar Datasets

Project description:BACKGROUND:Administrative health records (AHRs) and electronic medical records (EMRs) are two key sources of population-based data for disease surveillance, but misclassification errors in the data can bias disease estimates. Methods that combine information from error-prone data sources can build on the strengths of AHRs and EMRs. We compared bias and error for four data-combining methods and applied them to estimate hypertension prevalence. METHODS:Our study included rule-based OR and AND methods that identify disease cases from either or both data sources, respectively, rule-based sensitivity-specificity adjusted (RSSA) method that corrects for inaccuracies using a deterministic rule, and probabilistic-based sensitivity-specificity adjusted (PSSA) method that corrects for error using a statistical model. Computer simulation was used to estimate relative bias (RB) and mean square error (MSE) under varying conditions of population disease prevalence, correlation amongst data sources, and amount of misclassification error. AHRs and EMRs for Manitoba, Canada were used to estimate hypertension prevalence using validated case definitions and multiple disease markers. RESULTS:The OR method had the lowest RB and MSE when population disease prevalence was 10%, and the RSSA method had the lowest RB and MSE when population prevalence increased to 20%. As the correlation between data sources increased, the OR method resulted in the lowest RB and MSE. Estimates of hypertension prevalence for AHRs and EMRs alone were 30.9% (95% CI: 30.6-31.2) and 24.9% (95% CI: 24.6-25.2), respectively. The estimates were 21.4% (95% CI: 21.1-21.7), for the AND method, 34.4% (95% CI: 34.1-34.8) for the OR method, 32.2% (95% CI: 31.8-32.6) for the RSSA method, and ranged from 34.3% (95% CI: 34.1-34.5) to 35.9% (95% CI, 35.7-36.1) for the PSSA method, depending on the statistical model. CONCLUSIONS:The OR and AND methods are influenced by correlation amongst the data sources, while the RSSA method is dependent on the accuracy of prior sensitivity and specificity estimates. The PSSA method performed well when population prevalence was high and average correlations amongst disease markers was low. This study will guide researchers to select a data-combining method that best suits their data characteristics.

Project description:Post-market medical device surveillance is a challenge facing manufacturers, regulatory agencies, and health care providers. Electronic health records are valuable sources of real-world evidence for assessing device safety and tracking device-related patient outcomes over time. However, distilling this evidence remains challenging, as information is fractured across clinical notes and structured records. Modern machine learning methods for machine reading promise to unlock increasingly complex information from text, but face barriers due to their reliance on large and expensive hand-labeled training sets. To address these challenges, we developed and validated state-of-the-art deep learning methods that identify patient outcomes from clinical notes without requiring hand-labeled training data. Using hip replacements-one of the most common implantable devices-as a test case, our methods accurately extracted implant details and reports of complications and pain from electronic health records with up to 96.3% precision, 98.5% recall, and 97.4% F1, improved classification performance by 12.8-53.9% over rule-based methods, and detected over six times as many complication events compared to using structured data alone. Using these additional events to assess complication-free survivorship of different implant systems, we found significant variation between implants, including for risk of revision surgery, which could not be detected using coded data alone. Patients with revision surgeries had more hip pain mentions in the post-hip replacement, pre-revision period compared to patients with no evidence of revision surgery (mean hip pain mentions 4.97 vs. 3.23; t?=?5.14; p?<?0.001). Some implant models were associated with higher or lower rates of hip pain mentions. Our methods complement existing surveillance mechanisms by requiring orders of magnitude less hand-labeled training data, offering a scalable solution for national medical device surveillance using electronic health records.

Project description:ContextCarbon monoxide (CO) exposure can be life-threatening. Suspected and confirmed cases of CO poisoning warranting health care in New York City (NYC) are reportable to the NYC Poison Control Center (PCC).ObjectivesWe evaluated 4 hospital-based sources of CO surveillance data to identify ways to improve data capture and reporting.DesignSuspected and confirmed CO poisoning records from October 2015 through December 2016 were collected from the NYC emergency department (ED) syndromic surveillance system, New York State Statewide Planning and Research Cooperative System (SPARCS) ED billing data, NYC PCC calls made from hospitals, and the Electronic Clinical Laboratory Reporting System (ECLRS). Syndromic and SPARCS records were person- and visit-matched. SPARCS and ECLRS records were also matched to PCC records on combinations of name, demographic characteristics, and visit information.SettingHospitals in NYC.ParticipantsIndividuals who visited NYC hospitals for CO-related health effects.Main outcome measuresWe assessed the validity of syndromic data, with SPARCS records as the gold standard. We matched SPARCS and ECLRS records to PCC records to analyze reporting rates by case characteristics.ResultsThe sensitivity of syndromic surveillance was 60% (225 true-positives detected among 372 visit-matched SPARCS cases), and positive predictive value was 46%. Syndromic records often missed CO flags because of a nonspecific or absent International Classification of Diseases code in the diagnosis field. Only 15% of 428 SPARCS records (total includes 56 records not visit-matched to syndromic) and 16% of 199 ECLRS records were reported to PCC, with male sex and younger age associated with higher reporting.ConclusionsMandatory reporting makes PCC useful for tracking CO poisoning in NYC, but incomplete reporting and challenges in distinguishing between confirmed and suspected cases limit its utility. Simultaneous tracking of the systems we evaluated can best reveal surveillance patterns.

Dataset Information

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

Introduction

Methods

Findings

Discussion

Publications

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure