Dataset Information

An Artificial Intelligence Model to Predict the Mortality of COVID-19 Patients at Hospital Admission Time Using Routine Blood Samples: Development and Validation of an Ensemble Model.

ABSTRACT:

Background

COVID-19, which is accompanied by acute respiratory distress, multiple organ failure, and death, has spread worldwide much faster than previously thought. However, at present, it has limited treatments.

Objective

To overcome this issue, we developed an artificial intelligence (AI) model of COVID-19, named EDRnet (ensemble learning model based on deep neural network and random forest models), to predict in-hospital mortality using a routine blood sample at the time of hospital admission.

Methods

We selected 28 blood biomarkers and used the age and gender information of patients as model inputs. To improve the mortality prediction, we adopted an ensemble approach combining deep neural network and random forest models. We trained our model with a database of blood samples from 361 COVID-19 patients in Wuhan, China, and applied it to 106 COVID-19 patients in three Korean medical institutions.

Results

In the testing data sets, EDRnet provided high sensitivity (100%), specificity (91%), and accuracy (92%). To extend the number of patient data points, we developed a web application (BeatCOVID19) where anyone can access the model to predict mortality and can register his or her own blood laboratory results.

Conclusions

Our new AI model, EDRnet, accurately predicts the mortality rate for COVID-19. It is publicly available and aims to help health care providers fight COVID-19 and improve patients' outcomes.

SUBMITTER: Ko H

PROVIDER: S-EPMC7759509 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

An Artificial Intelligence Model to Predict the Mortality of COVID-19 Patients at Hospital Admission Time Using Routine Blood Samples: Development and Validation of an Ensemble Model.

Ko Hoon H Chung Heewon H Kang Wu Seong WS Park Chul C Kim Do Wan DW Kim Seong Eun SE Chung Chi Ryang CR Ko Ryoung Eun RE Lee Hooseok H Seo Jae Ho JH Choi Tae-Young TY Jaimes Rafael R Kim Kyung Won KW Lee Jinseok J

Journal of medical Internet research 20201223 12

<h4>Background</h4>COVID-19, which is accompanied by acute respiratory distress, multiple organ failure, and death, has spread worldwide much faster than previously thought. However, at present, it has limited treatments.<h4>Objective</h4>To overcome this issue, we developed an artificial intelligence (AI) model of COVID-19, named EDRnet (ensemble learning model based on deep neural network and random forest models), to predict in-hospital mortality using a routine blood sample at the time of ho ...[more]

PMID: 33301414

Similar Datasets

Project description:ImportanceWith a shortfall in fellowship-trained breast radiologists, mammography screening programs are looking toward artificial intelligence (AI) to increase efficiency and diagnostic accuracy. External validation studies provide an initial assessment of how promising AI algorithms perform in different practice settings.ObjectiveTo externally validate an ensemble deep-learning model using data from a high-volume, distributed screening program of an academic health system with a diverse patient population.Design, setting, and participantsIn this diagnostic study, an ensemble learning method, which reweights outputs of the 11 highest-performing individual AI models from the Digital Mammography Dialogue on Reverse Engineering Assessment and Methods (DREAM) Mammography Challenge, was used to predict the cancer status of an individual using a standard set of screening mammography images. This study was conducted using retrospective patient data collected between 2010 and 2020 from women aged 40 years and older who underwent a routine breast screening examination and participated in the Athena Breast Health Network at the University of California, Los Angeles (UCLA).Main outcomes and measuresPerformance of the challenge ensemble method (CEM) and the CEM combined with radiologist assessment (CEM+R) were compared with diagnosed ductal carcinoma in situ and invasive cancers within a year of the screening examination using performance metrics, such as sensitivity, specificity, and area under the receiver operating characteristic curve (AUROC).ResultsEvaluated on 37 317 examinations from 26 817 women (mean [SD] age, 58.4 [11.5] years), individual model AUROC estimates ranged from 0.77 (95% CI, 0.75-0.79) to 0.83 (95% CI, 0.81-0.85). The CEM model achieved an AUROC of 0.85 (95% CI, 0.84-0.87) in the UCLA cohort, lower than the performance achieved in the Kaiser Permanente Washington (AUROC, 0.90) and Karolinska Institute (AUROC, 0.92) cohorts. The CEM+R model achieved a sensitivity (0.813 [95% CI, 0.781-0.843] vs 0.826 [95% CI, 0.795-0.856]; P = .20) and specificity (0.925 [95% CI, 0.916-0.934] vs 0.930 [95% CI, 0.929-0.932]; P = .18) similar to the radiologist performance. The CEM+R model had significantly lower sensitivity (0.596 [95% CI, 0.466-0.717] vs 0.850 [95% CI, 0.766-0.923]; P < .001) and specificity (0.803 [95% CI, 0.734-0.861] vs 0.945 [95% CI, 0.936-0.954]; P < .001) than the radiologist in women with a prior history of breast cancer and Hispanic women (0.894 [95% CI, 0.873-0.910] vs 0.926 [95% CI, 0.919-0.933]; P = .004).Conclusions and relevanceThis study found that the high performance of an ensemble deep-learning model for automated screening mammography interpretation did not generalize to a more diverse screening cohort, suggesting that the model experienced underspecification. This study suggests the need for model transparency and fine-tuning of AI models for specific target populations prior to their clinical adoption.

Project description:BackgroundIdentification of patients with novel coronavirus disease 2019 (COVID-19) requiring hospital admission or at high-risk of in-hospital mortality is essential to guide patient triage and to provide timely treatment for higher risk hospitalized patients.MethodsA retrospective multi-centre (8 hospital) cohort at Beaumont Health, Michigan, USA, reporting on COVID-19 patients diagnosed between 1 March and 1 April 2020 was used for score validation. The COVID-19 Risk of Complications Score was automatically computed by the EHR. Multivariate logistic regression models were built to predict hospital admission and in-hospital mortality using individual variables constituting the score. Validation was performed using both discrimination and calibration.ResultsCompared to Green scores, Yellow Scores (OR: 5.72) and Red Scores (OR: 19.1) had significantly higher odds of admission (both p < .0001). Similarly, Yellow Scores (OR: 4.73) and Red Scores (OR: 13.3) had significantly higher odds of in-hospital mortality than Green Scores (both p < .0001). The cross-validated C-Statistics for the external validation cohort showed good discrimination for both hospital admission (C = 0.79 (95% CI: 0.77-0.81)) and in-hospital mortality (C = 0.75 (95% CI: 0.71-0.78)).ConclusionsThe COVID-19 Risk of Complications Score predicts the need for hospital admission and in-hospital mortality patients with COVID-19. Key points: Can an electronic health record generated risk score predict the risk of hospital admission and in-hospital mortality in patients diagnosed with coronavirus disease 2019 (COVID-19)? In both validation cohorts of 2,025 and 1,290 COVID-19, the cross-validated C-Statistics showed good discrimination for both hospital admission (C = 0.79 (95% CI: 0.77-0.81)) and in-hospital mortality (C = 0.75 (95% CI: 0.71-0.78)), respectively. The COVID-19 Risk of Complications Score may help predict the need for hospital admission if a patient contracts SARS-CoV-2 infection and in-hospital mortality for a hospitalized patient with COVID-19.

Dataset Information

An Artificial Intelligence Model to Predict the Mortality of COVID-19 Patients at Hospital Admission Time Using Routine Blood Samples: Development and Validation of an Ensemble Model.

Background

Objective

Methods

Results

Conclusions

Publications

An Artificial Intelligence Model to Predict the Mortality of COVID-19 Patients at Hospital Admission Time Using Routine Blood Samples: Development and Validation of an Ensemble Model.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets