Dataset Information

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

ABSTRACT:

Introduction

Electronic health records (EHRs) have the potential to offer real-time, inexpensive standardized health data about chronic health conditions. Despite rapid expansion, EHR data evaluations for chronic disease surveillance have been limited. We present design and methods for the New York City (NYC) Macroscope, an EHR-based chronic disease surveillance system. This methods report is the first in a three part series describing the development and validation of the NYC Macroscope. This report describes in detail the infrastructure underlying the NYC Macroscope; indicator definitions; design decisions that were made to maximize data quality; characteristics of the population sampled; completeness of data collected; and lessons learned from doing this work. The second report describes the methods used to evaluate the validity and robustness of NYC Macroscope prevalence estimates; presents validation results for estimates of obesity, smoking, depression and influenza vaccination; and discusses the implications of our findings for NYC and for other jurisdictions embarking on similar work. The third report applies the same validation methods to metabolic outcomes, including the prevalence, treatment and control of diabetes, hypertension and hyperlipidemia.

Methods

We designed the NYC Macroscope for comparison to a local "gold standard," the 2013-14 NYC Health and Nutrition Examination Survey, and the telephonic 2013 Community Health Survey. NYC Macroscope indicators covered prevalence, treatment, and control of diabetes, hypertension, and hyperlipidemia; and prevalence of influenza vaccination, obesity, depression and smoking. Indicators were stratified by age, sex, and neighborhood poverty, and weighted to the in-care NYC population and limited to primary care patients. Indicator queries were distributed to a virtual network of primary care practices; 392 practices and 716,076 adult patients were retained in the final sample.

Findings

The NYC Macroscope covered 10% of primary care providers and 15% of all adult patients in NYC in 2013 (8-47% of patients by neighborhood). Data completeness varied by domain from 98% for blood pressure among patients with hypertension to 33% for depression screening.

Discussion

Design and validation efforts undertaken by NYC are described here to provide one potential blueprint for leveraging EHRs for population health monitoring. To replicate a model like NYC Macroscope, jurisdictions should establish buy-in; build informatics capacity; use standard, simple case defnitions; establish documentation quality thresholds; restrict to primary care providers; and weight the sample to a target population.

SUBMITTER: Newton-Dame R

PROVIDER: S-EPMC5226383 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

Newton-Dame Remle R McVeigh Katharine H KH Schreibstein Lauren L Perlman Sharon S Lurie-Moroni Elizabeth E Jacobson Laura L Greene Carolyn C Snell Elisabeth E Thorpe Lorna E LE

EGEMS (Washington, DC) 20161215 1

<h4>Introduction</h4>Electronic health records (EHRs) have the potential to offer real-time, inexpensive standardized health data about chronic health conditions. Despite rapid expansion, EHR data evaluations for chronic disease surveillance have been limited. We present design and methods for the New York City (NYC) Macroscope, an EHR-based chronic disease surveillance system. This methods report is the first in a three part series describing the development and validation of the NYC Macroscope ...[more]

PMID: 28154835

Similar Datasets

Project description:BACKGROUND:Administrative health records (AHRs) and electronic medical records (EMRs) are two key sources of population-based data for disease surveillance, but misclassification errors in the data can bias disease estimates. Methods that combine information from error-prone data sources can build on the strengths of AHRs and EMRs. We compared bias and error for four data-combining methods and applied them to estimate hypertension prevalence. METHODS:Our study included rule-based OR and AND methods that identify disease cases from either or both data sources, respectively, rule-based sensitivity-specificity adjusted (RSSA) method that corrects for inaccuracies using a deterministic rule, and probabilistic-based sensitivity-specificity adjusted (PSSA) method that corrects for error using a statistical model. Computer simulation was used to estimate relative bias (RB) and mean square error (MSE) under varying conditions of population disease prevalence, correlation amongst data sources, and amount of misclassification error. AHRs and EMRs for Manitoba, Canada were used to estimate hypertension prevalence using validated case definitions and multiple disease markers. RESULTS:The OR method had the lowest RB and MSE when population disease prevalence was 10%, and the RSSA method had the lowest RB and MSE when population prevalence increased to 20%. As the correlation between data sources increased, the OR method resulted in the lowest RB and MSE. Estimates of hypertension prevalence for AHRs and EMRs alone were 30.9% (95% CI: 30.6-31.2) and 24.9% (95% CI: 24.6-25.2), respectively. The estimates were 21.4% (95% CI: 21.1-21.7), for the AND method, 34.4% (95% CI: 34.1-34.8) for the OR method, 32.2% (95% CI: 31.8-32.6) for the RSSA method, and ranged from 34.3% (95% CI: 34.1-34.5) to 35.9% (95% CI, 35.7-36.1) for the PSSA method, depending on the statistical model. CONCLUSIONS:The OR and AND methods are influenced by correlation amongst the data sources, while the RSSA method is dependent on the accuracy of prior sensitivity and specificity estimates. The PSSA method performed well when population prevalence was high and average correlations amongst disease markers was low. This study will guide researchers to select a data-combining method that best suits their data characteristics.

Project description:Post-market medical device surveillance is a challenge facing manufacturers, regulatory agencies, and health care providers. Electronic health records are valuable sources of real-world evidence for assessing device safety and tracking device-related patient outcomes over time. However, distilling this evidence remains challenging, as information is fractured across clinical notes and structured records. Modern machine learning methods for machine reading promise to unlock increasingly complex information from text, but face barriers due to their reliance on large and expensive hand-labeled training sets. To address these challenges, we developed and validated state-of-the-art deep learning methods that identify patient outcomes from clinical notes without requiring hand-labeled training data. Using hip replacements-one of the most common implantable devices-as a test case, our methods accurately extracted implant details and reports of complications and pain from electronic health records with up to 96.3% precision, 98.5% recall, and 97.4% F1, improved classification performance by 12.8-53.9% over rule-based methods, and detected over six times as many complication events compared to using structured data alone. Using these additional events to assess complication-free survivorship of different implant systems, we found significant variation between implants, including for risk of revision surgery, which could not be detected using coded data alone. Patients with revision surgeries had more hip pain mentions in the post-hip replacement, pre-revision period compared to patients with no evidence of revision surgery (mean hip pain mentions 4.97 vs. 3.23; t?=?5.14; p?<?0.001). Some implant models were associated with higher or lower rates of hip pain mentions. Our methods complement existing surveillance mechanisms by requiring orders of magnitude less hand-labeled training data, offering a scalable solution for national medical device surveillance using electronic health records.

Project description:ImportanceMore evidence on associations between mandated paid sick leave and health service utilization among low-income adults is needed to guide health policy and legislation nationwide.ObjectiveTo evaluate the association between New York City's 2014 paid sick leave mandate and health care utilization among Medicaid-enrolled adults.Design setting and participantsThis retrospective cohort study used New York State Medicaid administrative data for adults 18 to 64 years old continuously enrolled in Medicaid from August 1, 2011, through July 31, 2017. A difference-in-differences approach with entropy balancing weights was used to compare New York City with the rest of New York State to assess the association of the paid sick leave mandate with health care utilization, and for those 40 to 64 years old, with preventive care utilization. The data analysis was performed from June through August 2020.ExposuresTemporal and spatial variation in exposure to the mandate.Main outcomes and measuresAnnual health care utilization (emergency care, specialist visits, and primary care clinician visits) per Medicaid-enrolled adult. Secondary outcomes include categories of emergency utilization and utilization of 5 preventive services.ResultsOf 552 857 individuals (mean [SD] age, 43 [12] years; 351 130 [64%] women) who met inclusion criteria, 99 181 (18%) were White, 162 492 (29%) Black, and 138 061 (25%) Hispanic. Paid sick leave was significantly associated with a reduction in the probability of emergency care (-0.6 percentage points [pp]; 95% CI, -0.7 to -0.5 pp; P < .001), including a 0.3 pp reduction (95% CI, -0.4 to -0.2; P < .001) in care for conditions treatable in a primary care setting and an increase in annual outpatient visits (0.124 pp; 95% CI, 0.040 to 0.208 pp; P < .001). Among those 40 to 64 years old, the mandate was significantly associated with increased probabilities of glycated hemoglobin A1c level testing (2.9 pp; 95% CI, 2.5-3.3 pp; P < .001), blood cholesterol testing (2.7 pp; 95% CI, 2.5-2.9 pp; P < .001), and colon cancer screening (0.4 pp; 95% CI, 0.2-0.6 pp; P < .001).Conclusions and relevanceThis retrospective cohort study of nonelderly adults enrolled in Medicaid New York State showed that mandated paid sick leave in New York City was significantly associated with differences in several dimensions of health care services use.

Dataset Information

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

Introduction

Methods

Findings

Discussion

Publications

Design of the New York City Macroscope: Innovations in Population Health Surveillance Using Electronic Health Records.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets