Development of a machine learning algorithm to predict intubation among hospitalized patients with COVID-19.
Ontology highlight
ABSTRACT: Purpose
The purpose of this study is to develop a machine learning algorithm to predict future intubation among patients diagnosed or suspected with COVID-19.Materials and methods
This is a retrospective cohort study of patients diagnosed or under investigation for COVID-19. A machine learning algorithm was trained to predict future presence of intubation based on prior vitals, laboratory, and demographic data. Model performance was compared to ROX index, a validated prognostic tool for prediction of mechanical ventilation.Results
4087 patients admitted to five hospitals between February 2020 and April 2020 were included. 11.03% of patients were intubated. The machine learning model outperformed the ROX-index, demonstrating an area under the receiver characteristic curve (AUC) of 0.84 and 0.64, and area under the precision-recall curve (AUPRC) of 0.30 and 0.13, respectively. In the Kaplan-Meier analysis, patients alerted by the model were more likely to require intubation during their admission (p < 0.0001).Conclusion
In patients diagnosed or under investigation for COVID-19, machine learning can be used to predict future risk of intubation based on clinical data which are routinely collected and available in clinical setting. Such an approach may facilitate identification of high-risk patients to assist in clinical care.
SUBMITTER: Arvind V
PROVIDER: S-EPMC7669246 | biostudies-literature | 2020 Nov
REPOSITORIES: biostudies-literature
Publications
Development of a machine learning algorithm to predict intubation among hospitalized patients with COVID-19.
Arvind Varun V Kim Jun S JS Cho Brian H BH Geng Eric E Cho Samuel K SK
Journal of critical care 20201116
<h4>Purpose</h4>The purpose of this study is to develop a machine learning algorithm to predict future intubation among patients diagnosed or suspected with COVID-19.<h4>Materials and methods</h4>This is a retrospective cohort study of patients diagnosed or under investigation for COVID-19. A machine learning algorithm was trained to predict future presence of intubation based on prior vitals, laboratory, and demographic data. Model performance was compared to ROX index, a validated prognostic t ...[more]
Similar Datasets
Project description:Approximately 20-30% of patients with COVID-19 require hospitalization, and 5-12% may require critical care in an intensive care unit (ICU). A rapid surge in cases of severe COVID-19 will lead to a corresponding surge in demand for ICU care. Because of constraints on resources, frontline healthcare workers may be unable to provide the frequent monitoring and assessment required for all patients at high risk of clinical deterioration. We developed a machine learning-based risk prioritization tool that predicts ICU transfer within 24 h, seeking to facilitate efficient use of care providers' efforts and help hospitals plan their flow of operations. A retrospective cohort was comprised of non-ICU COVID-19 admissions at a large acute care health system between 26 February and 18 April 2020. Time series data, including vital signs, nursing assessments, laboratory data, and electrocardiograms, were used as input variables for training a random forest (RF) model. The cohort was randomly split (70:30) into training and test sets. The RF model was trained using 10-fold cross-validation on the training set, and its predictive performance on the test set was then evaluated. The cohort consisted of 1987 unique patients diagnosed with COVID-19 and admitted to non-ICU units of the hospital. The median time to ICU transfer was 2.45 days from the time of admission. Compared to actual admissions, the tool had 72.8% (95% CI: 63.2-81.1%) sensitivity, 76.3% (95% CI: 74.7-77.9%) specificity, 76.2% (95% CI: 74.6-77.7%) accuracy, and 79.9% (95% CI: 75.2-84.6%) area under the receiver operating characteristics curve. A ML-based prediction model can be used as a screening tool to identify patients at risk of imminent ICU transfer within 24 h. This tool could improve the management of hospital resources and patient-throughput planning, thus delivering more effective care to patients hospitalized with COVID-19.
| S-EPMC7356638 | biostudies-literature
Project description:BackgroundThe evolution of patients hospitalized with coronavirus disease 2019 (COVID-19) is still hard to predict, even after several months of dealing with the pandemic.AimsTo develop and validate a score to predict outcomes in patients hospitalized with COVID-19.MethodsAll consecutive adults hospitalized for COVID-19 from February to April 2020 were included in a nationwide observational study. Primary composite outcome was transfer to an intensive care unit from an emergency department or conventional ward, or in-hospital death. A score that estimates the risk of experiencing the primary outcome was constructed from a derivation cohort using stacked LASSO (Least Absolute Shrinkage and Selection Operator), and was tested in a validation cohort.ResultsAmong 2873 patients analysed (57.9% men; 66.6±17.0 years), the primary outcome occurred in 838 (29.2%) patients: 551 (19.2%) were transferred to an intensive care unit; and 287 (10.0%) died in-hospital without transfer to an intensive care unit. Using stacked LASSO, we identified 11 variables independently associated with the primary outcome in multivariable analysis in the derivation cohort (n=2313), including demographics (sex), triage vitals (body temperature, dyspnoea, respiratory rate, fraction of inspired oxygen, blood oxygen saturation) and biological variables (pH, platelets, C-reactive protein, aspartate aminotransferase, estimated glomerular filtration rate). The Critical COVID-19 France (CCF) risk score was then developed, and displayed accurate calibration and discrimination in the derivation cohort, with C-statistics of 0.78 (95% confidence interval 0.75-0.80). The CCF risk score performed significantly better (i.e. higher C-statistics) than the usual critical care risk scores.ConclusionsThe CCF risk score was built using data collected routinely at hospital admission to predict outcomes in patients with COVID-19. This score holds promise to improve early triage of patients and allocation of healthcare resources.
| S-EPMC9595484 | biostudies-literature
Project description:BackgroundThe current COVID-19 pandemic is unprecedented; under resource-constrained settings, predictive algorithms can help to stratify disease severity, alerting physicians of high-risk patients; however, there are only few risk scores derived from a substantially large electronic health record (EHR) data set, using simplified predictors as input.ObjectiveThe objectives of this study were to develop and validate simplified machine learning algorithms that predict COVID-19 adverse outcomes; to evaluate the area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and calibration of the algorithms; and to derive clinically meaningful thresholds.MethodsWe performed machine learning model development and validation via a cohort study using multicenter, patient-level, longitudinal EHRs from the Optum COVID-19 database that provides anonymized, longitudinal EHR from across the United States. The models were developed based on clinical characteristics to predict 28-day in-hospital mortality, intensive care unit (ICU) admission, respiratory failure, and mechanical ventilator usages at inpatient setting. Data from patients who were admitted from February 1, 2020, to September 7, 2020, were randomly sampled into development, validation, and test data sets; data collected from September 7, 2020, to November 15, 2020, were reserved as the postdevelopment prospective test data set.ResultsOf the 3.7 million patients in the analysis, 585,867 patients were diagnosed or tested positive for SARS-CoV-2, and 50,703 adult patients were hospitalized with COVID-19 between February 1 and November 15, 2020. Among the study cohort (n=50,703), there were 6204 deaths, 9564 ICU admissions, 6478 mechanically ventilated or EMCO patients, and 25,169 patients developed acute respiratory distress syndrome or respiratory failure within 28 days since hospital admission. The algorithms demonstrated high accuracy (AUC 0.89, 95% CI 0.89-0.89 on the test data set [n=10,752]), consistent prediction through the second wave of the pandemic from September to November (AUC 0.85, 95% CI 0.85-0.86) on the postdevelopment prospective test data set [n=14,863], great clinical relevance, and utility. Besides, a comprehensive set of 386 input covariates from baseline or at admission were included in the analysis; the end-to-end pipeline automates feature selection and model development. The parsimonious model with only 10 input predictors produced comparably accurate predictions; these 10 predictors (age, blood urea nitrogen, SpO2, systolic and diastolic blood pressures, respiration rate, pulse, temperature, albumin, and major cognitive disorder excluding stroke) are commonly measured and concordant with recognized risk factors for COVID-19.ConclusionsThe systematic approach and rigorous validation demonstrate consistent model performance to predict even beyond the period of data collection, with satisfactory discriminatory power and great clinical utility. Overall, the study offers an accurate, validated, and reliable prediction model based on only 10 clinical features as a prognostic tool to stratifying patients with COVID-19 into intermediate-, high-, and very high-risk groups. This simple predictive tool is shared with a wider health care community, to enable service as an early warning system to alert physicians of possible high-risk patients, or as a resource triaging tool to optimize health care resources.
| S-EPMC8785956 | biostudies-literature
Project description:ObjectiveTo identify risk factors associated with intubation and time to extubation in hospitalized patients with coronavirus disease 2019 (COVID-19).Study designRetrospective observational study.SettingTen hospitals in the Chicago metropolitan area.Subjects and methodsPatients with laboratory-confirmed COVID-19 admitted between March 1 and April 8, 2020, were included. We evaluated sociodemographic and clinical characteristics associated with intubation and prolonged intubation for acute respiratory failure secondary to COVID-19 infection.ResultsOf the 486 hospitalized patients included in the study, the median age was 59 years (interquartile range, 47-69); 271 (55.8%) were male; and the median body mass index was 30.6 (interquartile range, 26.5-35.6). During the hospitalization, 138 (28.4%) patients were intubated; 78 (56.5%) were eventually extubated; 21 (15.2%) died; and 39 (28.3%) remained intubated at a mean ± SD follow-up of 19.6 ± 6.7 days. Intubated patients had a significantly higher median age (65 vs 57 years, P < .001) and rate of diabetes (56 [40.6%] vs 104 [29.9%], P = .031) as compared with nonintubated patients. Multivariable logistic regression analysis identified age, sex, respiratory rate, oxygen saturation, history of diabetes, and shortness of breath as factors predictive of intubation. Age and body mass index were the only factors independently associated with time to extubation.ConclusionIn addition to clinical signs of respiratory distress, patients with COVID-19 who are older, male, or diabetic are at higher risk of requiring intubation. Among intubated patients, older and more obese patients are at higher risk for prolonged intubation. Otolaryngologists consulted for airway management should consider these factors in their decision making.
| S-EPMC7240317 | biostudies-literature
Project description:BackgroundCOVID-19 mortality risk stratification tools could improve care, inform accurate and rapid triage decisions, and guide family discussions regarding goals of care. A minority of COVID-19 prognostic tools have been tested in external cohorts. Our objective was to compare machine learning algorithms and develop a tool for predicting subsequent clinical outcomes in COVID-19. MethodsWe conducted a retrospective cohort study that included hospitalized patients with COVID-19 from March 2020 to March 2021. 712 consecutive patients from University of Washington (UW) and 345 patients from Tongji Hospital in China were included. We applied three different machine learning algorithms to clinical and laboratory data collected within the initial 24 hours of hospital admission to determine the risk of in-hospital mortality, transfer to the intensive care unit (ICU), shock requiring vasopressors, and receipt of renal replacement therapy (RRT). Mortality risk models were derived, internally validated in UW and externally validated in Tongji Hospital. The risk models for ICU transfer, shock and RRT were derived and internally validated in the UW dataset. ResultsAmong the UW dataset, 122 patients died (17%) during hospitalization and the mean days to hospital mortality was 15.7 +/- 21.5 (mean +/- SD). Elastic net logistic regression resulted in a C-statistic for in-hospital mortality of 0.72 (95% CI, 0.64 to 0.81) in the internal validation and 0.85 (95% CI, 0.81 to 0.89) in the external validation set. Age, platelet count, and white blood cell count were the most important predictors of mortality. In the sub-group of patients > 50 years of age, the mortality prediction model continued to perform with a C-statistic of 0.82 (95% CI:0.76,0.87). Mortality prediction models also performed well for shock and RRT in the UW dataset but functioned with lower accuracy for ICU transfer. ConclusionsWe trained, internally and externally validated a prediction model using data collected within 24 hours of hospital admission to predict in-hospital mortality on average two weeks prior to death. We also developed models to predict RRT and shock with high accuracy. These models could be used to improve triage decisions, resource allocation, and support clinical trial enrichment.
| S-EPMC8609901 | biostudies-literature
Project description:COVID-19 mortality risk stratification tools could improve care, inform accurate and rapid triage decisions, and guide family discussions regarding goals of care. A minority of COVID-19 prognostic tools have been tested in external cohorts. Our objective was to compare machine learning algorithms and develop a tool for predicting subsequent clinical outcomes in COVID-19. We conducted a retrospective cohort study that included hospitalized patients with COVID-19 from March 2020 to March 2021. Seven Hundred Twelve consecutive patients from University of Washington and 345 patients from Tongji Hospital in China were included. We applied three different machine learning algorithms to clinical and laboratory data collected within the initial 24 h of hospital admission to determine the risk of in-hospital mortality, transfer to the intensive care unit, shock requiring vasopressors, and receipt of renal replacement therapy. Mortality risk models were derived, internally validated in UW and externally validated in Tongji Hospital. The risk models for ICU transfer, shock and RRT were derived and internally validated in the UW dataset but were unable to be externally validated due to a lack of data on these outcomes. Among the UW dataset, 122 patients died (17%) during hospitalization and the mean days to hospital mortality was 15.7 +/- 21.5 (mean +/- SD). Elastic net logistic regression resulted in a C-statistic for in-hospital mortality of 0.72 (95% CI, 0.64 to 0.81) in the internal validation and 0.85 (95% CI, 0.81 to 0.89) in the external validation set. Age, platelet count, and white blood cell count were the most important predictors of mortality. In the sub-group of patients > 50 years of age, the mortality prediction model continued to perform with a C-statistic of 0.82 (95% CI:0.76,0.87). Prediction models also performed well for shock and RRT in the UW dataset but functioned with lower accuracy for ICU transfer. We trained, internally and externally validated a prediction model using data collected within 24 h of hospital admission to predict in-hospital mortality on average two weeks prior to death. We also developed models to predict RRT and shock with high accuracy. These models could be used to improve triage decisions, resource allocation, and support clinical trial enrichment.
| S-EPMC9547892 | biostudies-literature
Project description:The COVID-19 pandemic has placed unprecedented strain on the healthcare system, particularly hospital bed capacity in the setting of large variations in patient length of stay (LOS). Using electronic health record data from 966 COVID-19 patients at a large academic medical center, we developed three machine learning algorithms to predict the likelihood of prolonged LOS, defined as >8 days. The models included 353 variables and were trained on 80% of the cohort, with 20% used for model validation. The three models were created on hospital days 1, 2 and 3, each including information available at or before that point in time. The models' predictive capabilities improved sequentially over time, reaching an accuracy of 0.765, with an AUC of 0.819 by day 3. These models, developed using readily available data, may help hospital systems prepare for bed capacity needs, and help clinicians counsel patients on their likelihood of prolonged hospitalization.
| S-EPMC8156835 | biostudies-literature
Project description:BackgroundPTX3 is an important mediator of inflammation and innate immunity. We aimed at assessing its prognostic value in a large cohort of patients hospitalized with COVID-19.MethodsLevels of PTX3 were measured in 152 patients hospitalized with COVID-19 at San Gerardo Hospital (Monza, Italy) since March 2020. Cox regression was used to identify predictors of time from admission to in-hospital death or mechanical ventilation. Crude incidences of death were compared between patients with PTX3 levels higher or lower than the best cut-off estimated with the Maximally Selected Rank Statistics Method.ResultsUpon admission, 22% of the patients required no oxygen, 46% low-flow oxygen, 30% high-flow nasal cannula or CPAP-helmet and 3% MV. Median level of PTX3 was 21.7 (IQR: 13.5-58.23) ng/ml. In-hospital mortality was 25% (38 deaths); 13 patients (8.6%) underwent MV. PTX3 was associated with risk of death (per 10 ng/ml, HR 1.08; 95%CI 1.04-1.11; P<0.001) and death/MV (HR 1.04; 95%CI 1.01-1.07; P=0.011), independently of other predictors of in-hospital mortality, including age, Charlson Comorbidity Index, D-dimer and C-reactive protein (CRP). Patients with PTX3 levels above the optimal cut-off of 39.32 ng/ml had significantly higher mortality than the others (55% vs 8%, P<0.001). Higher PTX3 plasma levels were found in 14 patients with subsequent thrombotic complications (median [IQR]: 51.4 [24.6-94.4] versus 21 [13.4-55.2]; P=0.049).ConclusionsHigh PTX3 levels in patients hospitalized with COVID-19 are associated with a worse outcome. The evaluation of this marker could be useful in prognostic stratification and identification of patients who could benefit from immunomodulant therapy.
| S-EPMC9651085 | biostudies-literature
Project description:BackgroundDuring a pandemic, it is important for clinicians to stratify patients and decide who receives limited medical resources. Machine learning models have been proposed to accurately predict COVID-19 disease severity. Previous studies have typically tested only one machine learning algorithm and limited performance evaluation to area under the curve analysis. To obtain the best results possible, it may be important to test different machine learning algorithms to find the best prediction model.ObjectiveIn this study, we aimed to use automated machine learning (autoML) to train various machine learning algorithms. We selected the model that best predicted patients' chances of surviving a SARS-CoV-2 infection. In addition, we identified which variables (ie, vital signs, biomarkers, comorbidities, etc) were the most influential in generating an accurate model.MethodsData were retrospectively collected from all patients who tested positive for COVID-19 at our institution between March 1 and July 3, 2020. We collected 48 variables from each patient within 36 hours before or after the index time (ie, real-time polymerase chain reaction positivity). Patients were followed for 30 days or until death. Patients' data were used to build 20 machine learning models with various algorithms via autoML. The performance of machine learning models was measured by analyzing the area under the precision-recall curve (AUPCR). Subsequently, we established model interpretability via Shapley additive explanation and partial dependence plots to identify and rank variables that drove model predictions. Afterward, we conducted dimensionality reduction to extract the 10 most influential variables. AutoML models were retrained by only using these 10 variables, and the output models were evaluated against the model that used 48 variables.ResultsData from 4313 patients were used to develop the models. The best model that was generated by using autoML and 48 variables was the stacked ensemble model (AUPRC=0.807). The two best independent models were the gradient boost machine and extreme gradient boost models, which had an AUPRC of 0.803 and 0.793, respectively. The deep learning model (AUPRC=0.73) was substantially inferior to the other models. The 10 most influential variables for generating high-performing models were systolic and diastolic blood pressure, age, pulse oximetry level, blood urea nitrogen level, lactate dehydrogenase level, D-dimer level, troponin level, respiratory rate, and Charlson comorbidity score. After the autoML models were retrained with these 10 variables, the stacked ensemble model still had the best performance (AUPRC=0.791).ConclusionsWe used autoML to develop high-performing models that predicted the survival of patients with COVID-19. In addition, we identified important variables that correlated with mortality. This is proof of concept that autoML is an efficient, effective, and informative method for generating machine learning-based clinical decision support tools.
| S-EPMC7919846 | biostudies-literature
Project description:New York City quickly became an epicentre of the COVID-19 pandemic. An ability to triage patients was needed due to a sudden and massive increase in patients during the COVID-19 pandemic as healthcare providers incurred an exponential increase in workload,which created a strain on the staff and limited resources. Further, methods to better understand and characterise the predictors of morbidity and mortality was needed. METHODS: We developed a prediction model to predict patients at risk for mortality using only laboratory, vital and demographic information readily available in the electronic health record on more than 3395 hospital admissions with COVID-19. Multiple methods were applied, and final model was selected based on performance. A variable importance algorithm was used for interpretability, and understanding of performance and predictors was applied to the best model. We built a model with an area under the receiver operating characteristic curve of 83-97 to identify predictors and patients with high risk of mortality due to COVID-19. Oximetry, respirations, blood urea nitrogen, lymphocyte per cent, calcium, troponin and neutrophil percentage were important features, and key ranges were identified that contributed to a 50% increase in patients' mortality prediction score. With an increasing negative predictive value starting 0.90 after the second day of admission suggests we might be able to more confidently identify likely survivors DISCUSSION: This study serves as a use case of a machine learning methods with visualisations to aide clinicians with a better understanding of the model and predictors of mortality. CONCLUSION: As we continue to understand COVID-19, computer assisted algorithms might be able to improve the care of patients.
| S-EPMC8108129 | biostudies-literature