Machine learning assessment of myocardial ischemia using angiography: Development and retrospective validation.
Ontology highlight
ABSTRACT:
SUBMITTER: Hae H
PROVIDER: S-EPMC6233920 | biostudies-literature | 2018 Nov
REPOSITORIES: biostudies-literature
Publications
Machine learning assessment of myocardial ischemia using angiography: Development and retrospective validation.
Hae Hyeonyong H Kang Soo-Jin SJ Kim Won-Jang WJ Choi So-Yeon SY Lee June-Goo JG Bae Youngoh Y Cho Hyungjoo H Yang Dong Hyun DH Kang Joon-Won JW Lim Tae-Hwan TH Lee Cheol Hyun CH Kang Do-Yoon DY Lee Pil Hyung PH Ahn Jung-Min JM Park Duk-Woo DW Lee Seung-Whan SW Kim Young-Hak YH Lee Cheol Whan CW Park Seong-Wook SW Park Seung-Jung SJ
PLoS medicine 20181113 11
<h4>Background</h4>Invasive fractional flow reserve (FFR) is a standard tool for identifying ischemia-producing coronary stenosis. However, in clinical practice, over 70% of treatment decisions still rely on visual estimation of angiographic stenosis, which has limited accuracy (about 60%-65%) for the prediction of FFR < 0.80. One of the reasons for the visual-functional mismatch is that myocardial ischemia can be affected by the supplied myocardial size, which is not always evident by coronary ...[more]
Similar Datasets
Project description:IntroductionVenous thromboembolism (VTE) risk assessment at admission is of great importance for early screening and timely prophylaxis and management during hospitalization. The purpose of this study is to develop and validate novel risk assessment models at admission based on machine learning (ML) methods.MethodsIn this retrospective study, a total of 3078 individuals were included with their Caprini variables within 24 hours at admission. Then several ML models were built, including logistic regression (LR), random forest (RF), and extreme gradient boosting (XGB). The prediction performance of ML models and the Caprini risk score (CRS) was then validated and compared through a series of evaluation metrics.ResultsThe values of AUROC and AUPRC were 0.798 and 0.303 for LR, 0.804 and 0.360 for RF, and 0.796 and 0.352 for XGB, respectively, which outperformed CRS significantly (0.714 and 0.180, P < 0.001). When prediction scores were stratified into three risk levels for application, RF could obtain more reasonable results than CRS, including smaller false positive alerts and larger lower-risk proportions. The boosting results of stratification were further verified by the net-reclassification-improvement (NRI) analysis.DiscussionThis study indicated that machine learning models could improve VTE risk prediction at admission compared with CRS. Among the ML models, RF was found to have superior performance and great potential in clinical practice.
| S-EPMC10497101 | biostudies-literature
Project description:BackgroundA pathophysiological interplay exists between plaque morphology and coronary physiology. Machine learning (ML) is increasingly being applied to coronary computed tomography angiography (CCTA) for cardiovascular risk stratification. We sought to assess the performance of a ML score integrating CCTA-based quantitative plaque features for predicting vessel-specific ischemia by invasive fractional flow reserve (FFR) and impaired myocardial blood flow (MBF) by positron emission tomography (PET).MethodsThis post-hoc analysis of the PACIFIC trial (Prospective Comparison of Cardiac Positron Emission Tomography/Computed Tomography [CT]' Single Photon Emission Computed Tomography/CT Perfusion Imaging and CT Coronary Angiography with Invasive Coronary Angiography) included 208 patients with suspected coronary artery disease who prospectively underwent CCTA' [15O]H2O PET, and invasive FFR. Plaque quantification from CCTA was performed using semiautomated software. An ML algorithm trained on the prospective NXT trial (484 vessels) was used to develop a ML score for the prediction of ischemia (FFR≤0.80), which was then evaluated in 581 vessels from the PACIFIC trial. Thereafter, the ML score was applied for predicting impaired hyperemic MBF (≤2.30 mL/min per g) from corresponding PET scans. The performance of the ML score was compared with CCTA reads and noninvasive FFR derived from CCTA (FFRCT).ResultsOne hundred thirty-nine (23.9%) vessels had FFR-defined ischemia, and 195 (33.6%) vessels had impaired hyperemic MBF. For the prediction of FFR-defined ischemia, the ML score yielded an area under the receiver-operating characteristic curve of 0.92, which was significantly higher than that of visual stenosis grade (0.84; P<0.001) and comparable with that of FFRCT (0.93; P=0.34). Quantitative percent diameter stenosis and low-density noncalcified plaque volume had the greatest ML feature importance for predicting FFR-defined ischemia. When applied for impaired MBF prediction, the ML score exhibited an area under the receiver-operating characteristic curve of 0.80; significantly higher than visual stenosis grade (area under the receiver-operating characteristic curve 0.74; P=0.02) and comparable with FFRCT (area under the receiver-operating characteristic curve 0.77; P=0.16).ConclusionsAn externally validated ML score integrating CCTA-based quantitative plaque features accurately predicts FFR-defined ischemia and impaired MBF by PET, performing superiorly to standard CCTA stenosis evaluation and comparably to FFRCT.
| S-EPMC10085569 | biostudies-literature
Project description:Diagnosis and appropriate intervention for myocardial infarction (MI) are time-sensitive but rely on clinical measures that can be progressive and initially inconclusive, underscoring the need for an accurate and early predictor of MI to support diagnostic and clinical management decisions. The objective of this study was to develop a machine learning algorithm (MLA) to predict MI diagnosis based on electronic health record data (EHR) readily available during Emergency Department assessment. An MLA was developed using retrospective patient data. The MLA used patient data as they became available in the first 3 h of care to predict MI diagnosis (defined by International Classification of Diseases, 10th revision code) at any time during the encounter. The MLA obtained an area under the receiver operating characteristic curve of 0.87, sensitivity of 87% and specificity of 70%, outperforming the comparator scoring systems TIMI and GRACE on all metrics. An MLA can synthesize complex EHR data to serve as a clinically relevant risk stratification tool for MI.
| S-EPMC8667565 | biostudies-literature
Project description:BackgroundPatient safety in the intensive care unit (ICU) is one of the most critical issues, and unplanned extubation (UE) is considered the most adverse event for patient safety. Prevention and early detection of such an event is an essential but difficult component of quality care.ObjectiveThis study aimed to develop and validate prediction models for UE in ICU patients using machine learning.MethodsThis study was conducted in an academic tertiary hospital in Seoul, Republic of Korea. The hospital had approximately 2000 inpatient beds and 120 ICU beds. As of January 2019, the hospital had approximately 9000 outpatients on a daily basis. The number of annual ICU admissions was approximately 10,000. We conducted a retrospective study between January 1, 2010, and December 31, 2018. A total of 6914 extubation cases were included. We developed a UE prediction model using machine learning algorithms, which included random forest (RF), logistic regression (LR), artificial neural network (ANN), and support vector machine (SVM). For evaluating the model's performance, we used the area under the receiver operating characteristic curve (AUROC). The sensitivity, specificity, positive predictive value, negative predictive value, and F1 score were also determined for each model. For performance evaluation, we also used a calibration curve, the Brier score, and the integrated calibration index (ICI) to compare different models. The potential clinical usefulness of the best model at the best threshold was assessed through a net benefit approach using a decision curve.ResultsAmong the 6914 extubation cases, 248 underwent UE. In the UE group, there were more males than females, higher use of physical restraints, and fewer surgeries. The incidence of UE was higher during the night shift as compared to the planned extubation group. The rate of reintubation within 24 hours and hospital mortality were higher in the UE group. The UE prediction algorithm was developed, and the AUROC for RF was 0.787, for LR was 0.762, for ANN was 0.763, and for SVM was 0.740.ConclusionsWe successfully developed and validated machine learning-based prediction models to predict UE in ICU patients using electronic health record data. The best AUROC was 0.787 and the sensitivity was 0.949, which was obtained using the RF algorithm. The RF model was well-calibrated, and the Brier score and ICI were 0.129 and 0.048, respectively. The proposed prediction model uses widely available variables to limit the additional workload on the clinician. Further, this evaluation suggests that the model holds potential for clinical usefulness.
| S-EPMC8387891 | biostudies-literature
Project description:Myocardial injury after noncardiac surgery (MINS) is an easily overlooked complication but closely related to postoperative cardiovascular adverse outcomes; therefore, the early diagnosis and prediction are particularly important. We aimed to develop and validate an explainable machine learning (ML) model for predicting MINS among older patients undergoing noncardiac surgery. The retrospective cohort study included older patients who had noncardiac surgery from 1 northern center and 1 southern center in China. The data sets from center 1 were divided into a training set and an internal validation set. The data set from center 2 was used as an external validation set. Before modeling, the least absolute shrinkage and selection operator and recursive feature elimination methods were used to reduce dimensions of data and select key features from all variables. Prediction models were developed based on the extracted features using several ML algorithms, including category boosting, random forest, logistic regression, naïve Bayes, light gradient boosting machine, extreme gradient boosting, support vector machine, and decision tree. Prediction performance was assessed by the area under the receiver operating characteristic (AUROC) curve as the main evaluation metric to select the best algorithms. The model performance was verified by internal and external validation data sets with the best algorithm and compared to the Revised Cardiac Risk Index. The Shapley Additive Explanations (SHAP) method was applied to calculate values for each feature, representing the contribution to the predicted risk of complication, and generate personalized explanations. A total of 19,463 eligible patients were included; among those, 12,464 patients in center 1 were included as the training set; 4754 patients in center 1 were included as the internal validation set; and 2245 in center 2 were included as the external validation set. The best-performing model for prediction was the CatBoost algorithm, achieving the highest AUROC of 0.805 (95% CI 0.778-0.831) in the training set, validating with an AUROC of 0.780 in the internal validation set and 0.70 in external validation set. Additionally, CatBoost demonstrated superior performance compared to the Revised Cardiac Risk Index (AUROC 0.636; P<.001). The SHAP values indicated the ranking of the level of importance of each variable, with preoperative serum creatinine concentration, red blood cell distribution width, and age accounting for the top three. The results from the SHAP method can predict events with positive values or nonevents with negative values, providing an explicit explanation of individualized risk predictions. The ML models can provide a personalized and fairly accurate risk prediction of MINS, and the explainable perspective can help identify potentially modifiable sources of risk at the patient level.
| S-EPMC11294761 | biostudies-literature
Project description:Background: Myocardial ischemia is a common early symptom of cardiovascular disease (CVD). Reliable detection of myocardial ischemia using computer-aided analysis of electrocardiograms (ECG) provides an important reference for early diagnosis of CVD. The vectorcardiogram (VCG) could improve the performance of ECG-based myocardial ischemia detection by affording temporal-spatial characteristics related to myocardial ischemia and capturing subtle changes in ST-T segment in continuous cardiac cycles. We aim to investigate if the combination of ECG and VCG could improve the performance of machine learning algorithms in automatic myocardial ischemia detection. Methods: The ST-T segments of 20-second, 12-lead ECGs, and VCGs were extracted from 377 patients with myocardial ischemia and 52 healthy controls. Then, sample entropy (SampEn, of 12 ECG leads and of three VCG leads), spatial heterogeneity index (SHI, of VCG) and temporal heterogeneity index (THI, of VCG) are calculated. Using a grid search, four SampEn and two features are selected as input signal features for ECG-only and VCG-only models based on support vector machine (SVM), respectively. Similarly, three features (S I , THI, and SHI, where S I is the SampEn of lead I) are further selected for the ECG + VCG model. 5-fold cross validation was used to assess the performance of ECG-only, VCG-only, and ECG + VCG models. To fully evaluate the algorithmic generalization ability, the model with the best performance was selected and tested on a third independent dataset of 148 patients with myocardial ischemia and 52 healthy controls. Results: The ECG + VCG model with three features (S I ,THI, and SHI) yields better classifying results than ECG-only and VCG-only models with the average accuracy of 0.903, sensitivity of 0.903, specificity of 0.905, F1 score of 0.942, and AUC of 0.904, which shows better performance with fewer features compared with existing works. On the third independent dataset, the testing showed an AUC of 0.814. Conclusion: The SVM algorithm based on the ECG + VCG model could reliably detect myocardial ischemia, providing a potential tool to assist cardiologists in the early diagnosis of CVD in routine screening during primary care services.
| S-EPMC9192098 | biostudies-literature
Project description:ObjectiveThis study aimed to develop and compare machine learning models for predicting diabetic retinopathy (DR) using clinical and biochemical data, specifically logistic regression, random forest, XGBoost, and neural networks.MethodsA dataset of 3,000 diabetic patients, including 1,500 with DR, was obtained from the National Population Health Science Data Center. Significant predictors were identified, and four predictive models were developed. Model performance was assessed using accuracy, precision, recall, F1-score, and area under the curve (AUC).ResultsRandom forest and XGBoost demonstrated superior performance, achieving accuracies of 95.67% and 94.67%, respectively, with AUC values of 0.991 and 0.989. Logistic regression yielded an accuracy of 76.50% (AUC: 0.828), while neural networks achieved 82.67% accuracy (AUC: 0.927). Key predictors included 24-hour urinary microalbumin, HbA1c, and serum creatinine.ConclusionThe study highlights random forest and XGBoost as effective tools for early DR detection, emphasizing the importance of renal and glycemic markers in risk assessment. These findings support the integration of machine learning models into clinical decision-making for improved patient outcomes in diabetes management.
| S-EPMC11849896 | biostudies-literature
Project description:BackgroundTuberculous spondylitis (TS) and brucellar spondylitis (BS) are commonly observed in spinal infectious diseases, which are initially caused by bacteremia. BS is easily misdiagnosed as TS, especially in underdeveloped regions of northwestern China with less sensitive medical equipment. Nevertheless, a rapid and reliable diagnostic tool remains to be developed and a clinical diagnostic model to differentiate TS and BS using machine learning algorithms is of great significance.MethodsA total of 410 patients were included in this study. Independent factors to predict TS were selected by using the least absolute shrinkage and selection operator (LASSO) regression model, permutation feature importance, and multivariate logistic regression analysis. A TS risk prediction model was developed with six different machine learning algorithms. We used several metrics to evaluate the accuracy, calibration capability, and predictability of these models. The performance of the model with the best predictability was further verified with the area under the curve (AUC) of the receiver operating characteristic (ROC) curve and the calibration curve. The clinical performance of the final model was evaluated by decision curve analysis.ResultsSix variables were incorporated in the final model, namely, pain severity, CRP, x-ray intervertebral disc height loss, x-ray endplate sclerosis, CT vertebral destruction, and MRI paravertebral abscess. The analysis of appraising six models revealed that the logistic regression model developed in the current study outperformed other methods in terms of sensitivity (0.88 ± 0.07) and accuracy (0.79 ± 0.07). The AUC of the logistic regression model predicting TS was 0.86 (95% CI, 0.81-0.90) in the training set and 0.86 (95% CI, 0.78-0.92) in the validation set. The decision curve analysis indicated that the logistic regression model displayed a higher clinical efficiency in the differential diagnosis.ConclusionsThe logistic regression model developed in this study outperformed other methods. The logistic regression model demonstrated by a calculator exerts good discrimination and calibration capability and could be applicable in differentiating TS from BS in primary health care diagnosis.
| S-EPMC9852539 | biostudies-literature
Project description:BackgroundThe construction of a robust healthcare information system is fundamental to enhancing countries' capabilities in the surveillance and control of hepatitis B virus (HBV). Making use of China's rapidly expanding primary healthcare system, this innovative approach using big data and machine learning (ML) could help towards the World Health Organization's (WHO) HBV infection elimination goals of reaching 90% diagnosis and treatment rates by 2030. We aimed to develop and validate HBV detection models using routine clinical data to improve the detection of HBV and support the development of effective interventions to mitigate the impact of this disease in China.MethodsRelevant data records extracted from the Family Medicine Clinic of the University of Hong Kong-Shenzhen Hospital's Hospital Information System were structuralized using state-of-the-art Natural Language Processing techniques. Several ML models have been used to develop HBV risk assessment models. The performance of the ML model was then interpreted using the Shapley value (SHAP) and validated using cohort data randomly divided at a ratio of 2:1 using a five-fold cross-validation framework.ResultsThe patterns of physical complaints of patients with and without HBV infection were identified by processing 158,988 clinic attendance records. After removing cases without any clinical parameters from the derivation sample (n = 105,992), 27,392 cases were analysed using six modelling methods. A simplified model for HBV using patients' physical complaints and parameters was developed with good discrimination (AUC = 0.78) and calibration (goodness of fit test p-value >0.05).ConclusionsSuspected case detection models of HBV, showing potential for clinical deployment, have been developed to improve HBV surveillance in primary care setting in China. (Word count: 264).
| S-EPMC10860422 | biostudies-literature
Project description:ObjectiveAccurate estimations of surgical case durations can lead to the cost-effective utilization of operating rooms. We developed a novel machine learning approach, using both structured and unstructured features as input, to predict a continuous probability distribution of surgical case durations.Materials and methodsThe data set consisted of 53 783 surgical cases performed over 4 years at a tertiary-care pediatric hospital. Features extracted included categorical (American Society of Anesthesiologists [ASA] Physical Status, inpatient status, day of week), continuous (scheduled surgery duration, patient age), and unstructured text (procedure name, surgical diagnosis) variables. A mixture density network (MDN) was trained and compared to multiple tree-based methods and a Bayesian statistical method. A continuous ranked probability score (CRPS), a generalized extension of mean absolute error, was the primary performance measure. Pinball loss (PL) was calculated to assess accuracy at specific quantiles. Performance measures were additionally evaluated on common and rare surgical procedures. Permutation feature importance was measured for the best performing model.ResultsMDN had the best performance, with a CRPS of 18.1 minutes, compared to tree-based methods (19.5-22.1 minutes) and the Bayesian method (21.2 minutes). MDN had the best PL at all quantiles, and the best CRPS and PL for both common and rare procedures. Scheduled duration and procedure name were the most important features in the MDN.ConclusionsUsing natural language processing of surgical descriptors, we demonstrated the use of ML approaches to predict the continuous probability distribution of surgical case durations. The more discerning forecast of the ML-based MDN approach affords opportunities for guiding intelligent schedule design and day-of-surgery operational decisions.
| S-EPMC7727362 | biostudies-literature