Development of a repeated-measures predictive model and clinical risk score for mortality in ventilated COVID-19 patients.
Ontology highlight
ABSTRACT: Purpose
The COVID-19 pandemic has caused intensive care units (ICUs) to reach capacities requiring triage. A tool to predict mortality risk in ventilated patients with COVID-19 could inform decision-making and resource allocation, and allow population-level comparisons across institutions.Methods
This retrospective cohort study included all mechanically ventilated adults with COVID-19 admitted to three tertiary care ICUs in Toronto, Ontario, between 1 March 2020 and 15 December 2020. Generalized estimating equations were used to identify variables predictive of mortality. The primary outcome was the probability of death at three-day intervals from the time of ICU admission (day 0), with risk re-calculation every three days to day 15; the final risk calculation estimated the probability of death at day 15 and beyond. A numerical algorithm was developed from the final model coefficients.Results
One hundred twenty-seven patients were eligible for inclusion. Median ICU length of stay was 26.9 (interquartile range, 15.4-52.0) days. Overall mortality was 42%. From day 0 to 15, the variables age, temperature, lactate level, ventilation tidal volume, and vasopressor use significantly predicted mortality. Our final clinical risk score had an area under the receiver-operating characteristics curve of 0.9 (95% confidence interval [CI], 0.8 to 0.9). For every ten-point increase in risk score, the relative increase in the odds of death was approximately 4, with an odds ratio of 4.1 (95% CI, 2.9 to 5.9).Conclusion
Our dynamic prediction tool for mortality in ventilated patients with COVID-19 has excellent diagnostic properties. Notwithstanding, external validation is required before widespread implementation.
SUBMITTER: Bartoszko J
PROVIDER: S-EPMC8687635 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:We retrospectively evaluated 2879 hospitalized COVID-19 patients from four hospitals to evaluate the ability of demographic data, medical history, and on-admission laboratory parameters to predict in-hospital mortality. Association of previously published risk factors (age, gender, arterial hypertension, diabetes mellitus, smoking habit, obesity, renal failure, cardiovascular/ pulmonary diseases, serum ferritin, lymphocyte count, APTT, PT, fibrinogen, D-dimer, and platelet count) with death was tested by a multivariate logistic regression, and a predictive model was created, with further validation in an independent sample. A total of 2070 hospitalized COVID-19 patients were finally included in the multivariable analysis. Age 61-70 years (p<0.001; OR: 7.69; 95%CI: 2.93 to 20.14), age 71-80 years (p<0.001; OR: 14.99; 95%CI: 5.88 to 38.22), age >80 years (p<0.001; OR: 36.78; 95%CI: 14.42 to 93.85), male gender (p<0.001; OR: 1.84; 95%CI: 1.31 to 2.58), D-dimer levels >2 ULN (p = 0.003; OR: 1.79; 95%CI: 1.22 to 2.62), and prolonged PT (p<0.001; OR: 2.18; 95%CI: 1.49 to 3.18) were independently associated with increased in-hospital mortality. A predictive model performed with these parameters showed an AUC of 0.81 in the development cohort (n = 1270) [sensitivity of 95.83%, specificity of 41.46%, negative predictive value of 98.01%, and positive predictive value of 24.85%]. These results were then validated in an independent data sample (n = 800). Our predictive model of in-hospital mortality of COVID-19 patients has been developed, calibrated and validated. The model (MRS-COVID) included age, male gender, and on-admission coagulopathy markers as positively correlated factors with fatal outcome.
| S-EPMC7932507 | biostudies-literature
Project description:ObjectiveTo develop and validate a prediction model of mortality in patients with COVID-19 attending hospital emergency rooms.DesignMultivariable prognostic prediction model.Setting127 Spanish hospitals.ParticipantsDerivation (DC) and external validation (VC) cohorts were obtained from multicentre and single-centre databases, including 4035 and 2126 patients with confirmed COVID-19, respectively.InterventionsPrognostic variables were identified using multivariable logistic regression.Main outcome measures30-day mortality.ResultsPatients' characteristics in the DC and VC were median age 70 and 61 years, male sex 61.0% and 47.9%, median time from onset of symptoms to admission 5 and 8 days, and 30-day mortality 26.6% and 15.5%, respectively. Age, low age-adjusted saturation of oxygen, neutrophil-to-lymphocyte ratio, estimated glomerular filtration rate by the Chronic Kidney Disease Epidemiology Collaboration (CKD-EPI) equation, dyspnoea and sex were the strongest predictors of mortality. Calibration and discrimination were satisfactory with an area under the receiver operating characteristic curve with a 95% CI for prediction of 30-day mortality of 0.822 (0.806-0.837) in the DC and 0.845 (0.819-0.870) in the VC. A simplified score system ranging from 0 to 30 to predict 30-day mortality was also developed. The risk was considered to be low with 0-2 points (0%-2.1%), moderate with 3-5 (4.7%-6.3%), high with 6-8 (10.6%-19.5%) and very high with 9-30 (27.7%-100%).ConclusionsA simple prediction score, based on readily available clinical and laboratory data, provides a useful tool to predict 30-day mortality probability with a high degree of accuracy among hospitalised patients with COVID-19.
| S-EPMC7908055 | biostudies-literature
Project description:Background: The coronavirus disease 2019 (COVID-19) pandemic has found the whole world unprepared for its correct management. Italy was the first European country to experience the spread of the SARS-CoV-2 virus at the end of February 2020. As a result of hospital overcrowding, the quality of care delivered was not always optimal. A substantial number of patients admitted to non-ICU units could have been treated at home. It would have been extremely useful to have a score that, based on personal and clinical characteristics and simple blood tests, could have predicted with sufficient reliability the probability that a patient had or did not have a disease that could have led to their death. This study aims to develop a scoring system to identify which patients with COVID-19 are at high mortality risk upon hospital admission, to expedite and enhance clinical decision making. Methods: A retrospective analysis was performed to develop a multivariable prognostic prediction model. Results: Derivation and external validation cohorts were obtained from two Italian University Hospital databases, including 388 (10.31% deceased) and 1357 (7.68% deceased) patients with confirmed COVID-19, respectively. A multivariable logistic model was used to select seven variables associated with in-hospital death (age, baseline oxygen saturation, hemoglobin value, white blood cell count, percentage of neutrophils, platelet count, and creatinine value). Calibration and discrimination were satisfactory with a cumulative AUC for prediction mortality of 0.924 (95% CI: 0.893-0.944) in derivation cohorts and 0.808 (95% CI: 0.886-0.828) in external validation cohorts. The risk score obtained was compared with the ISARIC 4C Mortality Score, and with all the other most important scores considered so far, to evaluate the risk of death of patients with COVID-19. It performed better than all the above scores to evaluate the predictability of dying. Its sensitivity, specificity, and AUC were higher than the other COVID-19 scoring systems when the latter were calculated for the 388 patients in our derivation cohort. Conclusions: In conclusion, the CZ-COVID-19 Score may help all physicians by identifying those COVID-19 patients who require more attention to provide better therapeutic regimens or, on the contrary, by identifying those patients for whom hospitalization is not necessary and who could therefore be sent home without overcrowding healthcare facilities. We developed and validated a new risk score based on seven variables for upon-hospital admission of COVID-19 patients. It is very simple to calculate and performs better than all the other similar scores to evaluate the predictability of dying.
| S-EPMC11012743 | biostudies-literature
Project description:The clinical course of COVID-19 is highly variable. It is therefore essential to predict as early and accurately as possible the severity level of the disease in a COVID-19 patient who is admitted to the hospital. This means identifying the contributing factors of mortality and developing an easy-to-use score that could enable a fast assessment of the mortality risk using only information recorded at the hospitalization. A large database of adult patients with a confirmed diagnosis of COVID-19 (n = 15,628; with 2,846 deceased) admitted to Spanish hospitals between December 2019 and July 2020 was analyzed. By means of multiple machine learning algorithms, we developed models that could accurately predict their mortality. We used the information about classifiers' performance metrics and about importance and coherence among the predictors to define a mortality score that can be easily calculated using a minimal number of mortality predictors and yielded accurate estimates of the patient severity status. The optimal predictive model encompassed five predictors (age, oxygen saturation, platelets, lactate dehydrogenase, and creatinine) and yielded a satisfactory classification of survived and deceased patients (area under the curve: 0.8454 with validation set). These five predictors were additionally used to define a mortality score for COVID-19 patients at their hospitalization. This score is not only easy to calculate but also to interpret since it ranges from zero to eight, along with a linear increase in the mortality risk from 0% to 80%. A simple risk score based on five commonly available clinical variables of adult COVID-19 patients admitted to hospital is able to accurately discriminate their mortality probability, and its interpretation is straightforward and useful.
| S-EPMC9499271 | biostudies-literature
Project description:BackgroundCOVID-19-associated pulmonary aspergillosis (CAPA) is a major complication of critically ill COVID-19 patients, with a high mortality rate and potentially preventable. Thus, identifying patients at high risk of CAPA would be of great interest. We intended to develop a clinical prediction score capable of stratifying patients according to the risk for CAPA at ICU admission.MethodsSingle centre retrospective case-control study. A case was defined as a patient diagnosed with CAPA according to 2020 ECMM/ISHAM consensus criteria. 2 controls were selected for each case among critically ill COVID-19 patients.Results28 CAPA patients and 56-matched controls were included. Factors associated with CAPA included old age (68 years vs. 62, p = .033), active smoking (17.9% vs. 1.8%, p = .014), chronic respiratory diseases (48.1% vs. 26.3%, p = .043), chronic renal failure (25.0% vs. 3.6%, p = .005), chronic corticosteroid treatment (28.6% vs. 1.8%, p < .001), tocilizumab therapy (92.9% vs. 66.1%, p = .008) and high APACHE II at ICU admission (median 13 vs. 10 points, p = .026). A score was created including these variables, which showed an area under the receiver operator curve of 0.854 (95% CI 0.77-0.92). A punctuation below 6 had a negative predictive value of 99.6%. A punctuation of 10 or higher had a positive predictive value of 27.9%.ConclusionWe present a clinical prediction score that allowed to stratify critically ill COVID-19 patients according to the risk for developing CAPA. This CAPA score would allow to target preventive measures. Further evaluation of the score, as well as the utility of these targeted preventive measures, is needed.
| S-EPMC9115267 | biostudies-literature
Project description:Despite the best efforts of intensive care units (ICUs) professionals, the extubation failure rates in mechanically ventilated patients remain in the range of 5%-30%. Extubation failure is associated with increased risk of death and longer ICU stay. This study aimed to identify respiratory and non-respiratory parameters predictive of extubation outcome, and to use these predictors to develop and validate an "Extubation Predictive Score (ExPreS)" that could be used to predict likelihood of extubation success in patients receiving invasive mechanical ventilation (IMV). Derivation cohort was composed by patients aged ≥18 years admitted to the ICU and receiving IMV through an endotracheal tube for >24 hours. The weaning process followed the established ICU protocol. Clinical signs and ventilator parameters of patients were recorded during IMV, in the end phase of weaning in pressure support ventilation (PSV) mode, with inspiratory pressure of 7 cm H2O over the PEEP (positive end expiratory pressure). Patients who tolerated this ventilation were submitted to spontaneous breathing trial (SBT) with T-tube for 30 minutes. Those who passed the SBT and a subsequent cuff-leak test were extubated. The primary outcome of this study was extubation success at 48 hours. Parameters that showed statistically significant association with extubation outcome were further investigated using the receiver operating characteristics (ROC) analysis to assess their predictive value. The area under the curve (AUC) values were used to select parameters for inclusion in the ExPreS. Univariable logistic regression analysis and ROC analysis were performed to evaluate the performance of ExPreS. Patients' inclusion and statistical analyses for the prospective validation cohort followed the same criteria used for the derivation cohort and the decision to extubate was based on the ExPreS result. In the derivation cohort, a total of 110 patients were extubated: extubation succeeded in 101 (91.8%) patients and failed in 9 (8.2%) patients. Rapid shallow-breathing index (RSBI) in SBT, dynamic lung compliance, duration of IMV, muscle strength, estimated GCS, hematocrit, and serum creatinine were significantly associated with extubation outcome. These parameters, along with another parameter-presence of neurologic comorbidity-were used to create the ExPreS. The AUC value for the ExPreS was 0.875, which was higher than the AUCs of the individual parameters. The total ExPreS can range from 0 to 100. ExPreS ≥59 points indicated high probability of success (OR = 23.07), while ExPreS ≤44 points indicated low probability of success (OR = 0.82). In the prospective validation cohort, 83 patients were extubated: extubation succeeded in 81 (97.6%) patients and failed in 2 (2.4%) patients. The AUC value for the ExPreS in this cohort was 0.971. The multiparameter score that we propose, ExPreS, shows good accuracy to predict extubation outcome in patients receiving IMV in the ICU. In the prospective validation, the use of ExPreS decreased the extubation failure rate from 8.2% to 2.4%, even in a cohort of more severe patients.
| S-EPMC7971695 | biostudies-literature
Project description:RationalePrediction of patients at risk for mortality can help triage patients and assist in resource allocation.ObjectivesDevelop and evaluate a machine learning-based algorithm which accurately predicts mortality in COVID-19, pneumonia, and mechanically ventilated patients.MethodsRetrospective study of 53,001 total ICU patients, including 9166 patients with pneumonia and 25,895 mechanically ventilated patients, performed on the MIMIC dataset. An additional retrospective analysis was performed on a community hospital dataset containing 114 patients positive for SARS-COV-2 by PCR test. The outcome of interest was in-hospital patient mortality.ResultsWhen trained and tested on the MIMIC dataset, the XGBoost predictor obtained area under the receiver operating characteristic (AUROC) values of 0.82, 0.81, 0.77, and 0.75 for mortality prediction on mechanically ventilated patients at 12-, 24-, 48-, and 72- hour windows, respectively, and AUROCs of 0.87, 0.78, 0.77, and 0.734 for mortality prediction on pneumonia patients at 12-, 24-, 48-, and 72- hour windows, respectively. The predictor outperformed the qSOFA, MEWS and CURB-65 risk scores at all prediction windows. When tested on the community hospital dataset, the predictor obtained AUROCs of 0.91, 0.90, 0.86, and 0.87 for mortality prediction on COVID-19 patients at 12-, 24-, 48-, and 72- hour windows, respectively, outperforming the qSOFA, MEWS and CURB-65 risk scores at all prediction windows.ConclusionsThis machine learning-based algorithm is a useful predictive tool for anticipating patient mortality at clinically useful timepoints, and is capable of accurate mortality prediction for mechanically ventilated patients as well as those diagnosed with pneumonia and COVID-19.
| S-EPMC7532803 | biostudies-literature
Project description:BackgroundDue to the possibility of asymptomatic pneumonia in children with COVID-19 leading to overexposure to radiation and problems in limited-resource settings, we conducted a nationwide, multi-center study to determine the risk factors of pneumonia in children with COVID-19 in order to create a pediatric pneumonia predictive score, with score validation.MethodsThis was a retrospective cohort study done by chart review of all children aged 0-15 years admitted to 13 medical centers across Thailand during the study period. Univariate and multivariate analyses as well as backward and forward stepwise logistic regression were used to generate a final prediction model of the pneumonia score. Data during the pre-Delta era was used to create a prediction model whilst data from the Delta one was used as a validation cohort.ResultsThe score development cohort consisted of 1,076 patients in the pre-Delta era, and the validation cohort included 2,856 patients in the Delta one. Four predictors remained after backward and forward stepwise logistic regression: age < 5 years, number of comorbidities, fever, and dyspnea symptoms. The predictive ability of the novel pneumonia score was acceptable with the area under the receiver operating characteristics curve of 0.677 and a well-calibrated goodness-of-fit test (p = 0.098). The positive likelihood ratio for pneumonia was 0.544 (95% confidence interval (CI): 0.491-0.602) in the low-risk category, 1.563 (95% CI: 1.454-1.679) in the moderate, and 4.339 (95% CI: 2.527-7.449) in the high-risk.ConclusionThis study created an acceptable clinical prediction model which can aid clinicians in performing an appropriate triage for children with COVID-19.
| S-EPMC9423652 | biostudies-literature
Project description:OBJECTIVE: Using numeric laboratory data and administrative data from hospital electronic health record (EHR) systems, to develop an inpatient mortality predictive model. METHODS: Using EHR data of 1,428,824 adult discharges from 70 hospitals in 2006-2007, we developed the Acute Laboratory Risk of Mortality Score (ALaRMS) using age, gender, and initial laboratory values on admission as candidate variables. We then added administrative variables using the Agency for Healthcare Research and Quality (AHRQ)'s clinical classification software (CCS) and comorbidity software (CS) as disease classification tools. We validated the model using 770,523 discharges in 2008. RESULTS: Mortality predictors with ORs >2.00 included age, deranged albumin, arterial pH, bands, blood urea nitrogen, oxygen partial pressure, platelets, pro-brain natriuretic peptide, troponin I, and white blood cell counts. The ALaRMS model c-statistic was 0.87. Adding the CCS and CS variables increased the c-statistic to 0.91. The relative contributions were 69% (ALaRMS), 25% (CCS), and 6% (CS). Furthermore, the integrated discrimination improvement statistic demonstrated a 127% (95% CI 122% to 133%) overall improvement when ALaRMS was added to CCS and CS variables. In contrast, only a 22% (CI 19% to 25%) improvement was seen when CCS and CS variables were added to ALaRMS. CONCLUSIONS: EHR data can generate clinically plausible mortality predictive models with excellent discrimination. ALaRMS uses automated laboratory data widely available on admission, providing opportunities to aid real-time decision support. Models that incorporate laboratory and AHRQ's CCS and CS variables have utility for risk adjustment in retrospective outcome studies.
| S-EPMC3994855 | biostudies-other
Project description:The COVID-19 pandemic is impressively challenging the healthcare system. Several prognostic models have been validated but few of them are implemented in daily practice. The objective of the study was to validate a machine-learning risk prediction model using easy-to-obtain parameters to help to identify patients with COVID-19 who are at higher risk of death. The training cohort included all patients admitted to Fondazione Policlinico Gemelli with COVID-19 from March 5, 2020, to November 5, 2020. Afterward, the model was tested on all patients admitted to the same hospital with COVID-19 from November 6, 2020, to February 5, 2021. The primary outcome was in-hospital case-fatality risk. The out-of-sample performance of the model was estimated from the training set in terms of Area under the Receiving Operator Curve (AUROC) and classification matrix statistics by averaging the results of fivefold cross validation repeated 3-times and comparing the results with those obtained on the test set. An explanation analysis of the model, based on the SHapley Additive exPlanations (SHAP), is also presented. To assess the subsequent time evolution, the change in paO2/FiO2 (P/F) at 48 h after the baseline measurement was plotted against its baseline value. Among the 921 patients included in the training cohort, 120 died (13%). Variables selected for the model were age, platelet count, SpO2, blood urea nitrogen (BUN), hemoglobin, C-reactive protein, neutrophil count, and sodium. The results of the fivefold cross-validation repeated 3-times gave AUROC of 0.87, and statistics of the classification matrix to the Youden index as follows: sensitivity 0.840, specificity 0.774, negative predictive value 0.971. Then, the model was tested on a new population (n = 1463) in which the case-fatality rate was 22.6%. The test model showed AUROC 0.818, sensitivity 0.813, specificity 0.650, negative predictive value 0.922. Considering the first quartile of the predicted risk score (low-risk score group), the case-fatality rate was 1.6%, 17.8% in the second and third quartile (high-risk score group) and 53.5% in the fourth quartile (very high-risk score group). The three risk score groups showed good discrimination for the P/F value at admission, and a positive correlation was found for the low-risk class to P/F at 48 h after admission (adjusted R-squared = 0.48). We developed a predictive model of death for people with SARS-CoV-2 infection by including only easy-to-obtain variables (abnormal blood count, BUN, C-reactive protein, sodium and lower SpO2). It demonstrated good accuracy and high power of discrimination. The simplicity of the model makes the risk prediction applicable for patients in the Emergency Department, or during hospitalization. Although it is reasonable to assume that the model is also applicable in not-hospitalized persons, only appropriate studies can assess the accuracy of the model also for persons at home.
| S-EPMC8551240 | biostudies-literature