Dataset Information

Parameterizing time in electronic health record studies.

ABSTRACT:

Background

Fields like nonlinear physics offer methods for analyzing time series, but many methods require that the time series be stationary-no change in properties over time.Objective Medicine is far from stationary, but the challenge may be able to be ameliorated by reparameterizing time because clinicians tend to measure patients more frequently when they are ill and are more likely to vary.

Methods

We compared time parameterizations, measuring variability of rate of change and magnitude of change, and looking for homogeneity of bins of temporal separation between pairs of time points. We studied four common laboratory tests drawn from 25 years of electronic health records on 4 million patients.

Results

We found that sequence time-that is, simply counting the number of measurements from some start-produced more stationary time series, better explained the variation in values, and had more homogeneous bins than either traditional clock time or a recently proposed intermediate parameterization. Sequence time produced more accurate predictions in a single Gaussian process model experiment.

Conclusions

Of the three parameterizations, sequence time appeared to produce the most stationary series, possibly because clinicians adjust their sampling to the acuity of the patient. Parameterizing by sequence time may be applicable to association and clustering experiments on electronic health record data. A limitation of this study is that laboratory data were derived from only one institution. Sequence time appears to be an important potential parameterization.

SUBMITTER: Hripcsak G

PROVIDER: S-EPMC6169471 | biostudies-literature | 2015 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Parameterizing time in electronic health record studies.

Hripcsak George G Albers David J DJ Perotte Adler A

Journal of the American Medical Informatics Association : JAMIA 20150226 4

<h4>Background</h4>Fields like nonlinear physics offer methods for analyzing time series, but many methods require that the time series be stationary-no change in properties over time.Objective Medicine is far from stationary, but the challenge may be able to be ameliorated by reparameterizing time because clinicians tend to measure patients more frequently when they are ill and are more likely to vary.<h4>Methods</h4>We compared time parameterizations, measuring variability of rate of change an ...[more]

PMID: 25725004

Similar Datasets

Project description:BACKGROUND:The secondary use of electronic health records (EHRs) promises to facilitate medical research. We reviewed general data requirements in observational studies and analyzed the feasibility of conducting observational studies with structured EHR data, in particular diagnosis and procedure codes. METHODS:After reviewing published observational studies from the University Hospital of Erlangen for general data requirements, we identified three different study populations for the feasibility analysis with eligibility criteria from three exemplary observational studies. For each study population, we evaluated the availability of relevant patient characteristics in our EHR, including outcome and exposure variables. To assess data quality, we computed distributions of relevant patient characteristics from the available structured EHR data and compared them to those of the original studies. We implemented computed phenotypes for patient characteristics where necessary. In random samples, we evaluated how well structured patient characteristics agreed with a gold standard from manually interpreted free texts. We categorized our findings using the four data quality dimensions "completeness", "correctness", "currency" and "granularity". RESULTS:Reviewing general data requirements, we found that some investigators supplement routine data with questionnaires, interviews and follow-up examinations. We included 847 subjects in the feasibility analysis (Study 1 n?=?411, Study 2 n?=?423, Study 3 n?=?13). All eligibility criteria from two studies were available in structured data, while one study required computed phenotypes in eligibility criteria. In one study, we found that all necessary patient characteristics were documented at least once in either structured or unstructured data. In another study, all exposure and outcome variables were available in structured data, while in the other one unstructured data had to be consulted. The comparison of patient characteristics distributions, as computed from structured data, with those from the original study yielded similar distributions as well as indications of underreporting. We observed violations in all four data quality dimensions. CONCLUSIONS:While we found relevant patient characteristics available in structured EHR data, data quality problems may entail that it remains a case-by-case decision whether diagnosis and procedure codes are sufficient to underpin observational studies. Free-text data or subsequently supplementary study data may be important to complement a comprehensive patient history.

Project description:ImportanceNumerous prognostic models of suicide risk have been published, but few have been implemented outside of integrated managed care systems.ObjectiveTo evaluate performance of a suicide attempt risk prediction model implemented in a vendor-supplied electronic health record to predict subsequent (1) suicidal ideation and (2) suicide attempt.Design, setting, and participantsThis observational cohort study evaluated implementation of a suicide attempt prediction model in live clinical systems without alerting. The cohort comprised patients seen for any reason in adult inpatient, emergency department, and ambulatory surgery settings at an academic medical center in the mid-South from June 2019 to April 2020.Main outcomes and measuresPrimary measures assessed external, prospective, and concurrent validity. Manual medical record validation of coded suicide attempts confirmed incident behaviors with intent to die. Subgroup analyses were performed based on demographic characteristics, relevant clinical context/setting, and presence or absence of universal screening. Performance was evaluated using discrimination (number needed to screen, C statistics, positive/negative predictive values) and calibration (Spiegelhalter z statistic). Recalibration was performed with logistic calibration.ResultsThe system generated 115 905 predictions for 77 973 patients (42 490 [54%] men, 35 404 [45%] women, 60 586 [78%] White, 12 620 [16%] Black). Numbers needed to screen in highest risk quantiles were 23 and 271 for suicidal ideation and attempt, respectively. Performance was maintained across demographic subgroups. Numbers needed to screen for suicide attempt by sex were 256 for men and 323 for women; and by race: 373, 176, and 407 for White, Black, and non-White/non-Black patients, respectively. Model C statistics were, across the health system: 0.836 (95% CI, 0.836-0.837); adult hospital: 0.77 (95% CI, 0.77-0.772); emergency department: 0.778 (95% CI, 0.777-0.778); psychiatry inpatient settings: 0.634 (95% CI, 0.633-0.636). Predictions were initially miscalibrated (Spiegelhalter z = -3.1; P = .001) with improvement after recalibration (Spiegelhalter z = 1.1; P = .26).Conclusions and relevanceIn this study, this real-time predictive model of suicide attempt risk showed reasonable numbers needed to screen in nonpsychiatric specialty settings in a large clinical system. Assuming that research-valid models will translate without performing this type of analysis risks inaccuracy in clinical practice, misclassification of risk, wasted effort, and missed opportunity to correct and prevent such problems. The next step is careful pairing with low-cost, low-harm preventive strategies in a pragmatic trial of effectiveness in preventing future suicidality.

Project description:OBJECTIVE:Analysis of routinely collected electronic health record (EHR) data from primary care is reliant on the creation of codelists to define clinical features of interest. To improve scientific rigour, transparency and replicability, we describe and demonstrate a standardised reproducible methodology for clinical codelist development. DESIGN:We describe a three-stage process for developing clinical codelists. First, the clear definition a priori of the clinical feature of interest using reliable clinical resources. Second, development of a list of potential codes using statistical software to comprehensively search all available codes. Third, a modified Delphi process to reach consensus between primary care practitioners on the most relevant codes, including the generation of an 'uncertainty' variable to allow sensitivity analysis. SETTING:These methods are illustrated by developing a codelist for shortness of breath in a primary care EHR sample, including modifiable syntax for commonly used statistical software. PARTICIPANTS:The codelist was used to estimate the frequency of shortness of breath in a cohort of 28?216 patients aged over 18 years who received an incident diagnosis of lung cancer between 1 January 2000 and 30 November 2016 in the Clinical Practice Research Datalink (CPRD). RESULTS:Of 78 candidate codes, 29 were excluded as inappropriate. Complete agreement was reached for 44 (90%) of the remaining codes, with partial disagreement over 5 (10%). 13?091 episodes of shortness of breath were identified in the cohort of 28?216 patients. Sensitivity analysis demonstrates that codes with the greatest uncertainty tend to be rarely used in clinical practice. CONCLUSIONS:Although initially time consuming, using a rigorous and reproducible method for codelist generation 'future-proofs' findings and an auditable, modifiable syntax for codelist generation enables sharing and replication of EHR studies. Published codelists should be badged by quality and report the methods of codelist generation including: definitions and justifications associated with each codelist; the syntax or search method; the number of candidate codes identified; and the categorisation of codes after Delphi review.

Project description:BackgroundMultiple policy initiatives encourage more cautious prescribing of opioids in light of their risks. Electronic health record (EHR) redesign can influence prescriber choices, but some redesigns add to workload.ObjectiveTo estimate the effect of an EHR prescribing redesign on both opioid prescribing choices and keystrokes.DesignQuality improvement quasi-experiment, analyzed as interrupted time series.ParticipantsAdult patients of an academic multispecialty practice and a federally qualified health center (FQHC) who received new prescriptions for short-acting opioids, and their providers.InterventionIn the redesign, new prescriptions of short-acting opioids defaulted to the CDC-recommended minimum for opioid-naïve patients, with no alerts or hard stops, such that 9 keystrokes were required for a guideline-concordant prescription and 24 for a non-concordant prescription.Main measuresProportion of guideline-concordant prescriptions, defined as new prescriptions with a 3-day supply or less, calculated per 2-week period. Number of mouse clicks and keystrokes needed to place prescriptions.Key resultsAcross the 2 sites, 22,113 patients received a new short-acting opioid prescription from 821 providers. Before the intervention, both settings showed secular trends toward smaller-quantity prescriptions. At the academic practice, the intervention was associated with an immediate increase in guideline-concordant prescriptions from an average of 12% to 31% of all prescriptions. At the FQHC, about 44% of prescriptions were concordant at the time of the intervention, which was not associated with an additional significant increase. However, total keystrokes needed to place the concordant prescriptions decreased 62.7% from 3552 in the 6 months before the intervention to 1323 in the 6 months afterwards.ConclusionsAutocompleting prescription forms with guideline-recommended values was associated with a large increase in guideline concordance in an organization where baseline concordance was low, but not in an organization where it was already high. The redesign markedly reduced the number of keystrokes needed to place orders, with important implications for EHR-related stress.Trial registrationwww.ClinicalTrials.gov protocol 1710018646.

Dataset Information

Parameterizing time in electronic health record studies.

Background

Methods

Results

Conclusions

Publications

Parameterizing time in electronic health record studies.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets