Browse
Submit Data
Databases
API
Help

Dataset Information

27 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Utilizing timestamps of longitudinal electronic health record data to classify clinical deterioration events.

ABSTRACT:

Objective

To propose an algorithm that utilizes only timestamps of longitudinal electronic health record data to classify clinical deterioration events.

Materials and methods

This retrospective study explores the efficacy of machine learning algorithms in classifying clinical deterioration events among patients in intensive care units using sequences of timestamps of vital sign measurements, flowsheets comments, order entries, and nursing notes. We design a data pipeline to partition events into discrete, regular time bins that we refer to as timesteps. Logistic regressions, random forest classifiers, and recurrent neural networks are trained on datasets of different length of timesteps, respectively, against a composite outcome of death, cardiac arrest, and Rapid Response Team calls. Then these models are validated on a holdout dataset.

Results

A total of 6720 intensive care unit encounters meet the criteria and the final dataset includes 830 578 timestamps. The gated recurrent unit model utilizes timestamps of vital signs, order entries, flowsheet comments, and nursing notes to achieve the best performance on the time-to-outcome dataset, with an area under the precision-recall curve of 0.101 (0.06, 0.137), a sensitivity of 0.443, and a positive predictive value of 0. 092 at the threshold of 0.6.

Discussion and conclusion

This study demonstrates that our recurrent neural network models using only timestamps of longitudinal electronic health record data that reflect healthcare processes achieve well-performing discriminative power.

SUBMITTER: Fu LH

PROVIDER: S-EPMC8363809 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Impact of longitudinal data-completeness of electronic health record data on risk score misclassification.

Project description:BackgroundElectric health record (EHR) discontinuity, that is, receiving care outside of a given EHR system, can lead to substantial information bias. We aimed to determine whether a previously described EHR-continuity prediction model can reduce the misclassification of 4 commonly used risk scores in pharmacoepidemiology.MethodsThe study cohort consists of patients aged ≥ 65 years identified in 2 US EHR systems linked with Medicare claims data from 2007 to 2017. We calculated 4 risk scores, CHAD2DS2-VASc, HAS-BLED, combined comorbidity score (CCS), claims-based frailty index (CFI) based on information recorded in the 365 days before cohort entry, and assessed their misclassification by comparing score values based on EHR data alone versus the linked EHR-claims data. CHAD2DS2-VASc and HAS-BLED were assessed in atrial fibrillation (AF) patients, whereas CCS and CFI were assessed in the general population.ResultsOur study cohort included 204 014 patients (26 537 with nonvalvular AF) in system 1 and 115 726 patients (15 529 with nonvalvular AF) in system 2. Comparing the low versus high predicted EHR continuity in system 1, the proportion of patients with misclassification of ≥2 categories improved from 55% to 16% for CHAD2DS2-VASc, from 55% to 12% for HAS-BLED, from 37% to 16% for CCS, and from 10% to 2% for CFI. A similar pattern was found in system 2.ConclusionsUsing a previously described prediction model to identify patients with high EHR continuity may significantly reduce misclassification for the commonly used risk scores in EHR-based comparative studies.

| S-EPMC9196679 | biostudies-literature

Secondary use of electronic health record data for clinical workflow analysis.

Project description:ObjectiveOutpatient clinics lack guidance for tackling modern efficiency and productivity demands. Workflow studies require large amounts of timing data that are prohibitively expensive to collect through observation or tracking devices. Electronic health records (EHRs) contain a vast amount of timing data - timestamps collected during regular use - that can be mapped to workflow steps. This study validates using EHR timestamp data to predict outpatient ophthalmology clinic workflow timings at Oregon Health and Science University and demonstrates their usefulness in 3 different studies.Materials and methodsFour outpatient ophthalmology clinics were observed to determine their workflows and to time each workflow step. EHR timestamps were mapped to the workflow steps and validated against the observed timings.ResultsThe EHR timestamp analysis produced times that were within 3 min of the observed times for >80% of the appointments. EHR use patterns affected the accuracy of using EHR timestamps to predict workflow times.DiscussionEHR timestamps provided a reasonable approximation of workflow and can be used for workflow studies. They can be used to create simulation models, analyze EHR use, and quantify the impact of trainees on workflow.ConclusionThe secondary use of EHR timestamp data is a valuable resource for clinical workflow studies. Sample timestamp data files and algorithms for processing them are provided and can be used as a template for more studies in other clinical specialties and settings.

| S-EPMC6080808 | biostudies-literature

Learning from Longitudinal Data in Electronic Health Record and Genetic Data to Improve Cardiovascular Event Prediction.

Project description:Current approaches to predicting a cardiovascular disease (CVD) event rely on conventional risk factors and cross-sectional data. In this study, we applied machine learning and deep learning models to 10-year CVD event prediction by using longitudinal electronic health record (EHR) and genetic data. Our study cohort included 109, 490 individuals. In the first experiment, we extracted aggregated and longitudinal features from EHR. We applied logistic regression, random forests, gradient boosting trees, convolutional neural networks (CNN) and recurrent neural networks with long short-term memory (LSTM) units. In the second experiment, we applied a late-fusion approach to incorporate genetic features. We compared the performance with approaches currently utilized in routine clinical practice - American College of Cardiology and the American Heart Association (ACC/AHA) Pooled Cohort Risk Equation. Our results indicated that incorporating longitudinal feature lead to better event prediction. Combining genetic features through a late-fusion approach can further improve CVD prediction, underscoring the importance of integrating relevant genetic data whenever available.

| S-EPMC6345960 | biostudies-literature

Correlating electronic health record concepts with healthcare process events.

Project description:ObjectiveTo study the relation between electronic health record (EHR) variables and healthcare process events.Materials and methodsLagged linear correlation was calculated between five healthcare process events and 84 EHR variables (24 clinical laboratory values and 60 clinical concepts extracted from clinical notes) in a 24-year database. The EHR variables were clustered for each healthcare process event and interpreted.ResultsLaboratory tests tended to cluster together and note concepts tended to cluster together. Within each of those two classes, the variables clustered into clinically sensible groupings. The exact groupings varied from healthcare process event to event, with the largest differences occurring between inpatient events and outpatient events.DiscussionUnlike previously reported pairwise associations between variables, which highlighted correlations across the laboratory-clinical note divide, incorporating healthcare process events appeared to be sensitive to the manner in which the variables were collected.ConclusionWe believe that it may be possible to exploit this sensitivity to help knowledge engineers select variables and correct for biases.

| S-EPMC3861922 | biostudies-literature

Validation of risk prediction models applied to longitudinal electronic health record data for the prediction of major cardiovascular events in the presence of data shifts.

Project description:AimsDeep learning has dominated predictive modelling across different fields, but in medicine it has been met with mixed reception. In clinical practice, simple, statistical models and risk scores continue to inform cardiovascular disease risk predictions. This is due in part to the knowledge gap about how deep learning models perform in practice when they are subject to dynamic data shifts; a key criterion that common internal validation procedures do not address. We evaluated the performance of a novel deep learning model, BEHRT, under data shifts and compared it with several ML-based and established risk models.Methods and resultsUsing linked electronic health records of 1.1 million patients across England aged at least 35 years between 1985 and 2015, we replicated three established statistical models for predicting 5-year risk of incident heart failure, stroke, and coronary heart disease. The results were compared with a widely accepted machine learning model (random forests), and a novel deep learning model (BEHRT). In addition to internal validation, we investigated how data shifts affect model discrimination and calibration. To this end, we tested the models on cohorts from (i) distinct geographical regions; (ii) different periods. Using internal validation, the deep learning models substantially outperformed the best statistical models by 6%, 8%, and 11% in heart failure, stroke, and coronary heart disease, respectively, in terms of the area under the receiver operating characteristic curve.ConclusionThe performance of all models declined as a result of data shifts; despite this, the deep learning models maintained the best performance in all risk prediction tasks. Updating the model with the latest information can improve discrimination but if the prior distribution changes, the model may remain miscalibrated.

| S-EPMC9779795 | biostudies-literature

Electronic health record data quality variability across a multistate clinical research network.

Project description:BackgroundElectronic health record (EHR) data have many quality problems that may affect the outcome of research results and decision support systems. Many methods have been used to evaluate EHR data quality. However, there has yet to be a consensus on the best practice. We used a rule-based approach to assess the variability of EHR data quality across multiple healthcare systems.MethodsTo quantify data quality concerns across healthcare systems in a PCORnet Clinical Research Network, we used a previously tested rule-based framework tailored to the PCORnet Common Data Model to perform data quality assessment at 13 clinical sites across eight states. Results were compared with the current PCORnet data curation process to explore the differences between both methods. Additional analyses of testosterone therapy prescribing were used to explore clinical care variability and quality.ResultsThe framework detected discrepancies across sites, revealing evident data quality variability between sites. The detailed requirements encoded the rules captured additional data errors with a specificity that aids in remediation of technical errors compared to the current PCORnet data curation process. Other rules designed to detect logical and clinical inconsistencies may also support clinical care variability and quality programs.ConclusionRule-based EHR data quality methods quantify significant discrepancies across all sites. Medication and laboratory sources are causes of data errors.

| S-EPMC10308424 | biostudies-literature

Predicting Future Cardiovascular Events in Patients With Peripheral Artery Disease Using Electronic Health Record Data.

Project description:BackgroundPatients with peripheral artery disease (PAD) are at risk of major adverse cardiac and cerebrovascular events. There are no readily available risk scores that can accurately identify which patients are most likely to sustain an event, making it difficult to identify those who might benefit from more aggressive intervention. Thus, we aimed to develop a novel predictive model-using machine learning methods on electronic health record data-to identify which PAD patients are most likely to develop major adverse cardiac and cerebrovascular events.Methods and resultsData were derived from patients diagnosed with PAD at 2 tertiary care institutions. Predictive models were built using a common data model that allowed for utilization of both structured (coded) and unstructured (text) data. Only data from time of entry into the health system up to PAD diagnosis were used for modeling. Models were developed and tested using nested cross-validation. A total of 7686 patients were included in learning our predictive models. Utilizing almost 1000 variables, our best predictive model accurately determined which PAD patients would go on to develop major adverse cardiac and cerebrovascular events with an area under the curve of 0.81 (95% CI, 0.80-0.83).ConclusionsMachine learning algorithms applied to data in the electronic health record can learn models that accurately identify PAD patients at risk of future major adverse cardiac and cerebrovascular events, highlighting the great potential of electronic health records to provide automated risk stratification for cardiovascular diseases. Common data models that can enable cross-institution research and technology development could potentially be an important aspect of widespread adoption of newer risk-stratification models.

| S-EPMC6415677 | biostudies-literature

Use and Customization of Risk Scores for Predicting Cardiovascular Events Using Electronic Health Record Data.

Project description:Clinicians who are using the Framingham Risk Score (FRS) or the American College of Cardiology/American Heart Association Pooled Cohort Equations (PCE) to estimate risk for their patients based on electronic health data (EHD) face 4 questions. (1) Do published risk scores applied to EHD yield accurate estimates of cardiovascular risk? (2) Are FRS risk estimates, which are based on data that are up to 45 years old, valid for a contemporary patient population seeking routine care? (3) Do the PCE make the FRS obsolete? (4) Does refitting the risk score using EHD improve the accuracy of risk estimates? Data were extracted from the EHD of 84 116 adults aged 40 to 79 years who received care at a large healthcare delivery and insurance organization between 2001 and 2011. We assessed calibration and discrimination for 4 risk scores: published versions of FRS and PCE and versions obtained by refitting models using a subset of the available EHD. The published FRS was well calibrated (calibration statistic K=9.1, miscalibration ranging from 0% to 17% across risk groups), but the PCE displayed modest evidence of miscalibration (calibration statistic K=43.7, miscalibration from 9% to 31%). Discrimination was similar in both models (C-index=0.740 for FRS, 0.747 for PCE). Refitting the published models using EHD did not substantially improve calibration or discrimination. We conclude that published cardiovascular risk models can be successfully applied to EHD to estimate cardiovascular risk; the FRS remains valid and is not obsolete; and model refitting does not meaningfully improve the accuracy of risk estimates.

| S-EPMC5532984 | biostudies-literature

Reweighting to address nonparticipation and missing data bias in a longitudinal electronic health record study.

Project description:PurposeWe examined whether weighting techniques could account for longitudinal differences in disease activity by race/ethnicity between research participants and nonparticipants with rheumatoid arthritis (RA).MethodsWe included 377 patients with RA from a public hospital in San Francisco, CA. We estimated the probability of not enrolling in a research study by constructing weights using inverse probability weighting. Disease activity over time by race/ethnicity was analyzed across the entire patient population and among research participants only using multivariable mixed-effects models.ResultsThere were no differences in RA disease activity scores between research participants and nonparticipants at baseline; however, longitudinal differences in disease activity between research participants and nonparticipants were found by race/ethnicity. Weighting research participants in accordance with sociodemographic and clinical characteristics of the nonparticipant population did not result in any meaningful changes in disease activity by race/ethnicity over time.ConclusionsIn our study of patients with RA, inverse probability weighting using select sociodemographic and clinical variables was not sufficient to account for longitudinal disease activity differences by race/ethnicity between research participants and nonparticipants.

| S-EPMC7541711 | biostudies-literature

Utilizing electronic health record data to understand comorbidity burden among people living with HIV: a machine learning approach.

Project description:ObjectivesAn understanding of the predictors of comorbidity among people living with HIV (PLWH) is critical for effective HIV care management. In this study, we identified predictors of comorbidity burden among PLWH based on machine learning models with electronic health record (EHR) data.MethodsThe study population are individuals with a HIV diagnosis between January 2005 and December 2016 in South Carolina (SC). The change of comorbidity burden, represented by the Charlson Comorbidity Index (CCI) score, was measured by the score difference between pre- and post-HIV diagnosis, and dichotomized into a binary outcome variable. Thirty-five risk predictors from multiple domains were used to predict the increase in comorbidity burden based on the logistic least absolute shrinkage and selection operator (Lasso) regression analysis using 80% data for model development and 20% data for validation.ResultsOf 8253 PLWH, the mean value of the CCI score difference was 0.8 ± 1.9 (range from 0 to 21) with 2328 (28.2%) patients showing an increase in CCI score after HIV diagnosis. Top predictors for an increase in CCI score using the LASSO model included older age at HIV diagnosis, positive family history of chronic conditions, tobacco use, longer duration with retention in care, having PEBA insurance, having low recent CD4+ cell count and duration of viral suppression.ConclusionThe application of machine learning methods to EHR data could identify important predictors of increased comorbidity burden among PLWH with high accuracy. Results may enhance the understanding of comorbidities and provide the evidence based data for integrated HIV and comorbidity care management of PLWH.

| S-EPMC8058944 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data