Dataset Information

Machine learning-based prediction of acute mortality in emergency department patients using twelve-lead electrocardiogram.

ABSTRACT:

Background

The risk of mortality is relatively high among patients who visit the emergency department (ED), and stratifying patients at high risk can help improve medical care. This study aimed to create a machine-learning model that utilizes the standard 12-lead ECG to forecast acute mortality risk in ED patients.

Methods

The database included patients who visited the EDs and underwent standard 12-lead ECG between October 2007 and December 2017. A convolutional neural network (CNN) ECG model was developed to classify survival and mortality using 12-lead ECG tracings acquired from 345,593 ED patients. For machine learning model development, the patients were randomly divided into training, validation and testing datasets. The performance of the mortality risk prediction in this model was evaluated for various causes of death.

Results

Patients who visited the ED and underwent one or more ECG examinations experienced a high incidence of 30-day mortality [18,734 (5.42%)]. The developed CNN model demonstrated high accuracy in predicting acute mortality (hazard ratio 8.50, 95% confidence interval 8.20-8.80) with areas under the receiver operating characteristic (ROC) curve of 0.84 for the 30-day mortality risk prediction models. This CNN model also demonstrated good performance in predicting one-year mortality (hazard ratio 3.34, 95% confidence interval 3.30-3.39). This model exhibited good predictive performance for 30-day mortality not only for cardiovascular diseases but also across various diseases.

Conclusions

The machine learning-based ECG model utilizing CNN screens the risks for 30-day mortality. This model can complement traditional early warning scoring indexes as a useful screening tool for mortality prediction.

SUBMITTER: Chang PC

PROVIDER: S-EPMC10641780 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Machine learning-based prediction of acute mortality in emergency department patients using twelve-lead electrocardiogram.

Chang Po-Cheng PC Liu Zhi-Yong ZY Huang Yu-Chang YC Hsu Yu-Chun YC Chen Jung-Sheng JS Lin Ching-Heng CH Tsai Richard R Chou Chung-Chuan CC Wen Ming-Shien MS Wo Hung-Ta HT Lee Wen-Chen WC Liu Hao-Tien HT Wang Chun-Chieh CC Kuo Chang-Fu CF

Frontiers in cardiovascular medicine 20231027

<h4>Background</h4>The risk of mortality is relatively high among patients who visit the emergency department (ED), and stratifying patients at high risk can help improve medical care. This study aimed to create a machine-learning model that utilizes the standard 12-lead ECG to forecast acute mortality risk in ED patients.<h4>Methods</h4>The database included patients who visited the EDs and underwent standard 12-lead ECG between October 2007 and December 2017. A convolutional neural network (CN ...[more]

PMID: 37965090

Similar Datasets

Project description:The relationship between weather and acute coronary syndrome (ACS) incidence has been the subject of considerable research, with varying conclusions. Harnessing machine learning techniques, our study explores the relationship between meteorological factors and ACS presentations in the emergency department (ED), offering insights into seasonal variations and inter-day fluctuations to optimize patient care and resource allocation. A retrospective cohort analysis was conducted, encompassing ACS presentations to Dutch EDs from 2010 to 2017. Temporal patterns were analyzed using heat-maps and time series plots. Multivariable linear regression (MLR) and Random Forest (RF) regression models were employed to forecast daily ACS presentations with prediction horizons of one, three, seven, and thirty days. Model performance was assessed using the coefficient of determination (R²), Mean Absolute Error (MAE), and Mean Absolute Percentage Error (MAPE). The study included 214,953 ACS presentations, predominantly unstable angina (UA) (94,272; 44%), non-ST-elevated myocardial infarction (NSTEMI) (78,963; 37%), and ST-elevated myocardial infarction (STEMI) (41,718; 19%). A decline in daily ACS admissions over time was observed, with notable inter-day (estimated median difference: 41 (95%CI = 37-43, p = < 0.001) and seasonal variations (estimated median difference: 9 (95%CI 6-12, p = < 0.001). Both MLR and RF models demonstrated similar predictive capabilities, with MLR slightly outperforming RF. The models showed moderate explanatory power for ACS incidence (adjusted R² = 0.66; MAE (MAPE): 7.8 (11%)), with varying performance across subdiagnoses. Prediction of UA incidence resulted in the best-explained variability (adjusted R² = 0.80; MAE (MAPE): 5.3 (19.1%)), followed by NSTEMI and STEMI diagnoses. All models maintained consistent performance over extended prediction horizons. Our findings indicate that ACS presentation exhibits distinctive seasonal changes and inter-day differences, with marked reductions in incidence during the summer months and a distinct peak prevalence on Mondays. The predictive performance of our model was moderate. Nonetheless, we obtained good explanatory power for UA presentations. Our model emerges as a potentially valuable supplementary tool to enhance ED resource allocation or future predictive models predicting ACS incidence in the ED.

Project description:ObjectiveProlonged Emergency Department (ED) wait times lead to diminished healthcare quality. Utilizing machine learning (ML) to predict patient wait times could aid in ED operational management. Our aim is to perform a comprehensive analysis of ML models for ED wait time prediction, identify key feature importance and associations with prolonged wait times, and interpret prediction model clinical relevance among ED patients.MethodsThis is a single-centered retrospective study. We included ED patients assigned an Emergency Severity Index (ESI) level of 3 at triage. Patient wait times were categorized as <30 minutes and ≥30 minutes (prolonged wait time). We employed five ML algorithms - cross-validation logistic regression (CVLR), random forest (RF), extreme gradient boosting (XGBoost), artificial neural network (ANN), and support vector machine (SVM) - for predicting patient prolonged wait times. Performance assessment utilized accuracy, recall, precision, F1 score, false positive rate (FPR), and false negative rate (FNR). Furthermore, using XGBoost as an example, model key features and partial dependency plots (PDP) of these key features were illustrated. Shapley additive explanations (SHAP) were employed to interpret model outputs. Additionally, a top key feature interaction analysis was conducted.ResultsAmong total 177,665 patients, nearly half of them (48.20%, 85,632) experienced prolonged ED wait times. Though all five ML models exhibited similar performance, minimizing FNR is associated with the most clinical relevance for wait time predictions. The top features influencing patient wait times and gaining the top ranked interactions were ED crowding condition and patient mode of arrival.ConclusionsNearly half of the patients experienced prolonged wait times in the ED. ML models demonstrated acceptable performance, particularly in minimizing FNR when predicting ED wait times. The prediction of prolonged wait times was influenced by multiple interacting factors. Proper application of ML models to clinical practice requires interpreting their predictions of prolonged wait times in the context of clinical significance.

Project description:BackgroundDevelopment of emergency department (ED) triage systems that accurately differentiate and prioritize critically ill from stable patients remains challenging. We used machine learning models to predict clinical outcomes, and then compared their performance with that of a conventional approach-the Emergency Severity Index (ESI).MethodsUsing National Hospital and Ambulatory Medical Care Survey (NHAMCS) ED data, from 2007 through 2015, we identified all adult patients (aged ≥ 18 years). In the randomly sampled training set (70%), using routinely available triage data as predictors (e.g., demographics, triage vital signs, chief complaints, comorbidities), we developed four machine learning models: Lasso regression, random forest, gradient boosted decision tree, and deep neural network. As the reference model, we constructed a logistic regression model using the five-level ESI data. The clinical outcomes were critical care (admission to intensive care unit or in-hospital death) and hospitalization (direct hospital admission or transfer). In the test set (the remaining 30%), we measured the predictive performance, including area under the receiver-operating-characteristics curve (AUC) and net benefit (decision curves) for each model.ResultsOf 135,470 eligible ED visits, 2.1% had critical care outcome and 16.2% had hospitalization outcome. In the critical care outcome prediction, all four machine learning models outperformed the reference model (e.g., AUC, 0.86 [95%CI 0.85-0.87] in the deep neural network vs 0.74 [95%CI 0.72-0.75] in the reference model), with less under-triaged patients in ESI triage levels 3 to 5 (urgent to non-urgent). Likewise, in the hospitalization outcome prediction, all machine learning models outperformed the reference model (e.g., AUC, 0.82 [95%CI 0.82-0.83] in the deep neural network vs 0.69 [95%CI 0.68-0.69] in the reference model) with less over-triages in ESI triage levels 1 to 3 (immediate to urgent). In the decision curve analysis, all machine learning models consistently achieved a greater net benefit-a larger number of appropriate triages considering a trade-off with over-triages-across the range of clinical thresholds.ConclusionsCompared to the conventional approach, the machine learning models demonstrated a superior performance to predict critical care and hospitalization outcomes. The application of modern machine learning models may enhance clinicians' triage decision making, thereby achieving better clinical care and optimal resource utilization.

Project description:BackgroundAcute abdominal pain (AAP) constitutes 5-10% of all emergency department (ED) visits, with appendicitis being a prevalent AAP etiology often necessitating surgical intervention. The variability in AAP symptoms and causes, combined with the challenge of identifying appendicitis, complicate timely intervention. To estimate the risk of appendicitis, scoring systems such as the Alvarado score have been developed. However, diagnostic errors and delays remain common. Although various machine learning (ML) models have been proposed to enhance appendicitis detection, none have been seamlessly integrated into the ED workflows for AAP or are specifically designed to diagnose appendicitis as early as possible within the clinical decision-making process. To mimic daily clinical practice, this proof-of-concept study aims to develop ML models that support decision-making using comprehensive clinical data up to key decision points in the ED workflow to detect appendicitis in patients presenting with AAP.MethodsData from the Dutch triage system at the ED, vital signs, complete medical history and physical examination findings and routine laboratory test results were retrospectively extracted from 350 AAP patients presenting to the ED of a Dutch teaching hospital from 2016 to 2023. Two eXtreme Gradient Boosting ML models were developed to differentiate cases with appendicitis from other AAP causes: one model used all data up to and including physical examination, and the other was extended with routine laboratory test results. The performance of both models was evaluated on a validation set (n = 68) and compared to the Alvarado scoring system as well as three ED physicians in a reader study.ResultsThe ML models achieved AUROCs of 0.919 without laboratory test results and 0.923 with the addition of laboratory test results. The Alvarado scoring system attained an AUROC of 0.824. ED physicians achieved AUROCs of 0.894, 0.826, and 0.791 without laboratory test results, increasing to AUROCs of 0.923, 0.892, and 0.859 with laboratory test results.ConclusionsBoth ML models demonstrated comparable high accuracy in predicting appendicitis in patients with AAP, outperforming the Alvarado scoring system. The ML models matched or surpassed ED physician performance in detecting appendicitis, with the largest potential performance gain observed in absence of laboratory test results. Integration could assist ED physicians in early and accurate diagnosis of appendicitis.

Project description:ObjectivesPredictive analytics in emergency care has mostly been limited to the use of clinical decision rules (CDRs) in the form of simple heuristics and scoring systems. In the development of CDRs, limitations in analytic methods and concerns with usability have generally constrained models to a preselected small set of variables judged to be clinically relevant and to rules that are easily calculated. Furthermore, CDRs frequently suffer from questions of generalizability, take years to develop, and lack the ability to be updated as new information becomes available. Newer analytic and machine learning techniques capable of harnessing the large number of variables that are already available through electronic health records (EHRs) may better predict patient outcomes and facilitate automation and deployment within clinical decision support systems. In this proof-of-concept study, a local, big data-driven, machine learning approach is compared to existing CDRs and traditional analytic methods using the prediction of sepsis in-hospital mortality as the use case.MethodsThis was a retrospective study of adult ED visits admitted to the hospital meeting criteria for sepsis from October 2013 to October 2014. Sepsis was defined as meeting criteria for systemic inflammatory response syndrome with an infectious admitting diagnosis in the ED. ED visits were randomly partitioned into an 80%/20% split for training and validation. A random forest model (machine learning approach) was constructed using over 500 clinical variables from data available within the EHRs of four hospitals to predict in-hospital mortality. The machine learning prediction model was then compared to a classification and regression tree (CART) model, logistic regression model, and previously developed prediction tools on the validation data set using area under the receiver operating characteristic curve (AUC) and chi-square statistics.ResultsThere were 5,278 visits among 4,676 unique patients who met criteria for sepsis. Of the 4,222 patients in the training group, 210 (5.0%) died during hospitalization, and of the 1,056 patients in the validation group, 50 (4.7%) died during hospitalization. The AUCs with 95% confidence intervals (CIs) for the different models were as follows: random forest model, 0.86 (95% CI = 0.82 to 0.90); CART model, 0.69 (95% CI = 0.62 to 0.77); logistic regression model, 0.76 (95% CI = 0.69 to 0.82); CURB-65, 0.73 (95% CI = 0.67 to 0.80); MEDS, 0.71 (95% CI = 0.63 to 0.77); and mREMS, 0.72 (95% CI = 0.65 to 0.79). The random forest model AUC was statistically different from all other models (p ≤ 0.003 for all comparisons).ConclusionsIn this proof-of-concept study, a local big data-driven, machine learning approach outperformed existing CDRs as well as traditional analytic techniques for predicting in-hospital mortality of ED patients with sepsis. Future research should prospectively evaluate the effectiveness of this approach and whether it translates into improved clinical outcomes for high-risk sepsis patients. The methods developed serve as an example of a new model for predictive analytics in emergency care that can be automated, applied to other clinical outcomes of interest, and deployed in EHRs to enable locally relevant clinical predictions.

Dataset Information

Machine learning-based prediction of acute mortality in emergency department patients using twelve-lead electrocardiogram.

Background

Methods

Results

Conclusions

Publications

Machine learning-based prediction of acute mortality in emergency department patients using twelve-lead electrocardiogram.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets