Superiority of Supervised Machine Learning on Reading Chest X-Rays in Intensive Care Units
Ontology highlight
ABSTRACT:
SUBMITTER: Tanaka K
PROVIDER: S-EPMC8554032 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:IntroductionChest x-rays (CXRs) are the most frequent radiological tests performed in the intensive care unit (ICU). However, the utility of performing daily routine CXRs is unclear.MethodsWe searched Medline and Embase (1948 to March 2011) for randomized and quasi-randomized controlled trials (RCTs) and before-after observational studies comparing a strategy of routine CXRs to a more restrictive approach with CXRs performed to investigate clinical changes among critically ill adults or children. In duplicate, we extracted data on the CXR strategy, study quality and clinical outcomes (ICU and hospital mortality; duration of mechanical ventilation and ICU and hospital stay).ResultsNine studies (39,358 CXRs; 9,611 patients) were included in the meta-analysis. Three trials (N = 870) of moderate to good quality provided information on the safety of a restrictive routine CXR strategy; only one trial systematically assessed for missed findings. Pooled data from trials showed no evidence of effect of a restrictive approach on ICU mortality (risk ratio [RR] 1.04, 95% confidence interval [CI] 0.84 to 1.28, P = 0.72; two trials, N = 776), hospital mortality (RR 0.98, 95% CI 0.68 to 1.41, P = 0.91; two trials, N = 259), ICU length of stay (weighted mean difference [WMD] -0.86 days, 95% CI -2.38 to 0.66 days, P = 0.27; three trials, N = 870), hospital length of stay (WMD -2.50 days, 95% CI -6.62 to 1.61 days, P = 0.23; two trials, N = 259), or duration of mechanical ventilation (WMD -0.30 days, 95% CI -1.48 to 0.89 days, P = 0.62; three trials, N = 705). Adding data from six observational studies, one of which systematically screened for missed findings, gave similar results.ConclusionsThis meta-analysis did not detect any harm associated with a restrictive chest radiograph strategy. However, confidence intervals were wide and harm was not rigorously assessed. Therefore, the safety of abandoning routine CXRs in patients admitted to the ICU remains uncertain.
| S-EPMC3681397 | biostudies-literature
Project description:Hypothermia is a life-threatening condition where the temperature of the body drops below 35°C and is a key source of concern in Intensive Care Units (ICUs). Early identification can help to nudge clinical management to initiate early interventions. Despite its importance, very few studies have focused on the early prediction of hypothermia. In this study, we aim to monitor and predict Hypothermia (30 min-4 h) ahead of its onset using machine learning (ML) models developed on physiological vitals and to prospectively validate the best performing model in the pediatric ICU. We developed and evaluated ML algorithms for the early prediction of hypothermia in a pediatric ICU. Sepsis advanced forecasting engine ICU Database (SafeICU) data resource is an in-house ICU source of data built in the Pediatric ICU at the All-India Institute of Medical Science (AIIMS), New Delhi. Each time-stamp at 1-min resolution was labeled for the presence of hypothermia to construct a retrospective cohort of pediatric patients in the SafeICU data resource. The training set consisted of windows of the length of 4.2 h with a lead time of 30 min-4 h from the onset of hypothermia. A set of 3,835 hand-engineered time-series features were calculated to capture physiological features from the time series. Features selection using the Boruta algorithm was performed to select the most important predictors of hypothermia. A battery of models such as gradient boosting machine, random forest, AdaBoost, and support vector machine (SVM) was evaluated utilizing five-fold test sets. The best-performing model was prospectively validated. A total of 148 patients with 193 ICU stays were eligible for the model development cohort. Of 3,939 features, 726 were statistically significant in the Boruta analysis for the prediction of Hypothermia. The gradient boosting model performed best with an Area Under the Receiver Operating Characteristic curve (AUROC) of 85% (SD = 1.6) and a precision of 59.2% (SD = 8.8) for a 30-min lead time before the onset of Hypothermia onset. As expected, the model showed a decline in model performance at higher lead times, such as AUROC of 77.2% (SD = 2.3) and precision of 41.34% (SD = 4.8) for 4 h ahead of Hypothermia onset. Our GBM(gradient boosting machine) model produced equal and superior results for the prospective validation, where an AUROC of 79.8% and a precision of 53% for a 30-min lead time before the onset of Hypothermia whereas an AUROC of 69.6% and a precision of 38.52% for a (30 min-4 h) lead time prospective validation of Hypothermia. Therefore, this work establishes a pipeline termed ThermoGnose for predicting hypothermia, a major complication in pediatric ICUs.
| S-EPMC9511412 | biostudies-literature
Project description:ObjectivesEarly hemorrhage detection in intensive care units (ICUs) enables timely intervention and reduces the risk of irreversible outcomes. In this study, we aimed to develop a machine learning model to predict hemorrhage by learning the patterns of continuously changing, real-world clinical data.MethodsWe used the Medical Information Mart for Intensive Care databases (MIMIC-III and MIMIC-IV). A recurrent neural network was used to predict severe hemorrhage in the ICU. We developed three machine learning models with an increasing number of input features and levels of complexity: model 1 (11 features), model 2 (18 features), and model 3 (27 features). MIMIC-III was used for model training, and MIMIC-IV was split for internal validation. Using the model with the highest performance, external verification was performed using data from a subgroup extracted from the eICU Collaborative Research Database.ResultsWe included 5,670 ICU admissions, with 3,150 in the training set and 2,520 in the internal test set. A positive correlation was found between model complexity and performance. As a measure of performance, three models developed with an increasing number of features showed area under the receiver operating characteristic (AUROC) curve values of 0.61-0.94 according to the range of input data. In the subgroup extracted from the eICU database for external validation, an AUROC value of 0.74 was observed.ConclusionsMachine learning models that rely on real clinical data can be used to predict patients at high risk of bleeding in the ICU.
| S-EPMC9672494 | biostudies-literature
Project description:BackgroundAccording to the World Health Organization (WHO), pneumonia is the leading infectious cause of death in children below 5 years old. Hence, the early detection of pediatric pneumonia is crucial to reduce its morbidity and mortality rates. Even though chest radiography is the most commonly employed modality for pneumonia detection, recent studies highlight the existence of poor interobserver agreement in the chest X-ray interpretation of healthcare practitioners when it comes to diagnosing pediatric pneumonia. Thus, there is a significant need for automating the detection process to minimize the potential human error. Since Artificial Intelligence tools such as Deep Learning (DL) and Machine Learning (ML) have the potential to automate disease detection, many researchers explored how such tools can be implemented to detect pneumonia in chest X-rays. Notably, the majority of efforts tackled this problem from a DL point of view. However, ML has shown a higher potential for medical interpretability while being less computationally demanding than DL.ObjectiveThe aim of this paper is to automate the early detection process of pediatric pneumonia using ML as it is less computationally demanding than DL.MethodsThe proposed approach entails performing data augmentation to balance the classes of the utilized dataset, optimizing the feature extraction scheme, and evaluating the performance of several ML models. Moreover, the performance of this approach is compared to a TL benchmark to evaluate its candidacy.ResultsUsing the proposed approach, the Quadratic SVM model yielded an accuracy of 97.58%, surpassing the accuracies reported in the current ML literature. In addition, this model classification time was significantly smaller than that of the TL benchmark.ConclusionThe results strongly support the candidacy of the proposed approach in reliably detecting pediatric pneumonia.
| S-EPMC10259147 | biostudies-literature
Project description:Objectives: This study aims to investigate whether the machine learning algorithms could provide an optimal early mortality prediction method compared with other scoring systems for patients with cerebral hemorrhage in intensive care units in clinical practice. Methods: Between 2008 and 2012, from Intensive Care III (MIMIC-III) database, all cerebral hemorrhage patients monitored with the MetaVision system and admitted to intensive care units were enrolled in this study. The calibration, discrimination, and risk classification of predicted hospital mortality based on machine learning algorithms were assessed. The primary outcome was hospital mortality. Model performance was assessed with accuracy and receiver operating characteristic curve analysis. Results: Of 760 cerebral hemorrhage patients enrolled from MIMIC database [mean age, 68.2 years (SD, ±15.5)], 383 (50.4%) patients died in hospital, and 377 (49.6%) patients survived. The area under the receiver operating characteristic curve (AUC) of six machine learning algorithms was 0.600 (nearest neighbors), 0.617 (decision tree), 0.655 (neural net), 0.671(AdaBoost), 0.819 (random forest), and 0.725 (gcForest). The AUC was 0.423 for Acute Physiology and Chronic Health Evaluation II score. The random forest had the highest specificity and accuracy, as well as the greatest AUC, showing the best ability to predict in-hospital mortality. Conclusions: Compared with conventional scoring system and the other five machine learning algorithms in this study, random forest algorithm had better performance in predicting in-hospital mortality for cerebral hemorrhage patients in intensive care units, and thus further research should be conducted on random forest algorithm.
| S-EPMC7855582 | biostudies-literature
Project description:Lactic acidosis is a heterogeneous condition with multiple underlying causes and associated outcomes. The use of multi-dimensional patient data to subtype lactic acidosis can personalize patient care. Machine learning consensus clustering may identify lactic acidosis subgroups with unique clinical profiles and outcomes. We used the Medical Information Mart for Intensive Care III database to abstract electronic medical record data from patients admitted to intensive care units (ICU) in a tertiary care hospital in the United States. We included patients who developed lactic acidosis (defined as serum lactate ≥ 4 mmol/L) within 48 h of ICU admission. We performed consensus clustering analysis based on patient characteristics, comorbidities, vital signs, organ supports, and laboratory data to identify clinically distinct lactic acidosis subgroups. We calculated standardized mean differences to show key subgroup features. We compared outcomes among subgroups. We identified 1919 patients with lactic acidosis. The algorithm revealed three best unique lactic acidosis subgroups based on patient variables. Cluster 1 (n = 554) was characterized by old age, elective admission to cardiac surgery ICU, vasopressor use, mechanical ventilation use, and higher pH and serum bicarbonate. Cluster 2 (n = 815) was characterized by young age, admission to trauma/surgical ICU with higher blood pressure, lower comorbidity burden, lower severity index, and less vasopressor use. Cluster 3 (n = 550) was characterized by admission to medical ICU, history of liver disease and coagulopathy, acute kidney injury, lower blood pressure, higher comorbidity burden, higher severity index, higher serum lactate, and lower pH and serum bicarbonate. Cluster 3 had the worst outcomes, while cluster 1 had the most favorable outcomes in terms of persistent lactic acidosis and mortality. Consensus clustering analysis synthesized the pattern of clinical and laboratory data to reveal clinically distinct lactic acidosis subgroups with different outcomes.
| S-EPMC8623582 | biostudies-literature
Project description:This paper targets a major challenge of how to effectively allocate medical resources in intensive care units (ICUs). We trained multiple regression models using the Medical Information Mart for Intensive Care III (MIMIC III) database recorded in the period between 2001 and 2012. The training and validation dataset included pneumonia, sepsis, congestive heart failure, hypotension, chest pain, coronary artery disease, fever, respiratory failure, acute coronary syndrome, shortness of breath, seizure and transient ischemic attack, and aortic stenosis patients' recorded data. Then we tested the models on the unseen data of patients diagnosed with coronary artery disease, congestive heart failure or acute coronary syndrome. We included the admission characteristics, clinical prescriptions, physiological measurements, and discharge characteristics of those patients. We assessed the models' performance using mean residuals and running times as metrics. We ran multiple experiments to study the data partition's impact on the learning phase. The total running time of our best-evaluated model is 123,450.9 mS. The best model gives an average accuracy of 98%, highlighting the location of discharge, initial diagnosis, location of admission, drug therapy, length of stay and internal transfers as the most influencing patterns to decide a patient's readiness for discharge.
| S-EPMC9222879 | biostudies-literature
Project description:ObjectivesWe aimed to develop deep learning models using longitudinal chest X-rays (CXRs) and clinical data to predict in-hospital mortality of COVID-19 patients in the intensive care unit (ICU).MethodsSix hundred fifty-four patients (212 deceased, 442 alive, 5645 total CXRs) were identified across two institutions. Imaging and clinical data from one institution were used to train five longitudinal transformer-based networks applying five-fold cross-validation. The models were tested on data from the other institution, and pairwise comparisons were used to determine the best-performing models.ResultsA higher proportion of deceased patients had elevated white blood cell count, decreased absolute lymphocyte count, elevated creatine concentration, and incidence of cardiovascular and chronic kidney disease. A model based on pre-ICU CXRs achieved an AUC of 0.632 and an accuracy of 0.593, and a model based on ICU CXRs achieved an AUC of 0.697 and an accuracy of 0.657. A model based on all longitudinal CXRs (both pre-ICU and ICU) achieved an AUC of 0.702 and an accuracy of 0.694. A model based on clinical data alone achieved an AUC of 0.653 and an accuracy of 0.657. The addition of longitudinal imaging to clinical data in a combined model significantly improved performance, reaching an AUC of 0.727 (p = 0.039) and an accuracy of 0.732.ConclusionsThe addition of longitudinal CXRs to clinical data significantly improves mortality prediction with deep learning for COVID-19 patients in the ICU.Key points• Deep learning was used to predict mortality in COVID-19 ICU patients. • Serial radiographs and clinical data were used. • The models could inform clinical decision-making and resource allocation.
| S-EPMC8857913 | biostudies-literature
Project description:BACKGROUND:Prognostication is an essential tool for risk adjustment and decision making in the intensive care unit (ICU). Research into prognostication in ICU has so far been limited to data from admission or the first 24 hours. Most ICU admissions last longer than this, decisions are made throughout an admission, and some admissions are explicitly intended as time-limited prognostic trials. Despite this, temporal changes in prognostic ability during ICU admission has received little attention to date. Current predictive models, in the form of prognostic clinical tools, are typically derived from linear models and do not explicitly handle incremental information from trends. Machine learning (ML) allows predictive models to be developed which use non-linear predictors and complex interactions between variables, thus allowing incorporation of trends in measured variables over time; this has made it possible to investigate prognosis throughout an admission. METHODS AND FINDINGS:This study uses ML to assess the predictability of ICU mortality as a function of time. Logistic regression against physiological data alone outperformed APACHE-II and demonstrated several important interactions including between lactate & noradrenaline dose, between lactate & MAP, and between age & MAP consistent with the current sepsis definitions. ML models consistently outperformed logistic regression with Deep Learning giving the best results. Predictive power was maximal on the second day and was further improved by incorporating trend data. Using a limited range of physiological and demographic variables, the best machine learning model on the first day showed an area under the receiver-operator characteristic curve (AUC) of 0.883 (σ = 0.008), compared to 0.846 (σ = 0.010) for a logistic regression from the same predictors and 0.836 (σ = 0.007) for a logistic regression based on the APACHE-II score. Adding information gathered on the second day of admission improved the maximum AUC to 0.895 (σ = 0.008). Beyond the second day, predictive ability declined. CONCLUSION:This has implications for decision making in intensive care and provides a justification for time-limited trials of ICU therapy; the assessment of prognosis over more than one day may be a valuable strategy as new information on the second day helps to differentiate outcomes. New ML models based on trend data beyond the first day could greatly improve upon current risk stratification tools.
| S-EPMC6241126 | biostudies-other
Project description:Background: Extubation failure (EF) can lead to an increased chance of ventilator-associated pneumonia, longer hospital stays, and a higher mortality rate. This study aimed to develop and validate an accurate machine-learning model to predict EF in intensive care units (ICUs). Methods: Patients who underwent extubation in the Medical Information Mart for Intensive Care (MIMIC)-IV database were included. EF was defined as the need for ventilatory support (non-invasive ventilation or reintubation) or death within 48 h following extubation. A machine-learning model called Categorical Boosting (CatBoost) was developed based on 89 clinical and laboratory variables. SHapley Additive exPlanations (SHAP) values were calculated to evaluate feature importance and the recursive feature elimination (RFE) algorithm was used to select key features. Hyperparameter optimization was conducted using an automated machine-learning toolkit (Neural Network Intelligence). The final model was trained based on key features and compared with 10 other models. The model was then prospectively validated in patients enrolled in the Cardiac Surgical ICU of Zhongshan Hospital, Fudan University. In addition, a web-based tool was developed to help clinicians use our model. Results: Of 16,189 patients included in the MIMIC-IV cohort, 2,756 (17.0%) had EF. Nineteen key features were selected using the RFE algorithm, including age, body mass index, stroke, heart rate, respiratory rate, mean arterial pressure, peripheral oxygen saturation, temperature, pH, central venous pressure, tidal volume, positive end-expiratory pressure, mean airway pressure, pressure support ventilation (PSV) level, mechanical ventilation (MV) durations, spontaneous breathing trial success times, urine output, crystalloid amount, and antibiotic types. After hyperparameter optimization, our model had the greatest area under the receiver operating characteristic (AUROC: 0.835) in internal validation. Significant differences in mortality, reintubation rates, and NIV rates were shown between patients with a high predicted risk and those with a low predicted risk. In the prospective validation, the superiority of our model was also observed (AUROC: 0.803). According to the SHAP values, MV duration and PSV level were the most important features for prediction. Conclusions: In conclusion, this study developed and prospectively validated a CatBoost model, which better predicted EF in ICUs than other models.
| S-EPMC8165178 | biostudies-literature