Dataset Information

External validation of prognostic scores for COVID-19: a multicenter cohort study of patients hospitalized in Greater Paris University Hospitals.

ABSTRACT:

Purpose

The Coronavirus disease 2019 (COVID-19) has led to an unparalleled influx of patients. Prognostic scores could help optimizing healthcare delivery, but most of them have not been comprehensively validated. We aim to externally validate existing prognostic scores for COVID-19.

Methods

We used "COVID-19 Evidence Alerts" (McMaster University) to retrieve high-quality prognostic scores predicting death or intensive care unit (ICU) transfer from routinely collected data. We studied their accuracy in a retrospective multicenter cohort of adult patients hospitalized for COVID-19 from January 2020 to April 2021 in the Greater Paris University Hospitals. Areas under the receiver operating characteristic curves (AUC) were computed for the prediction of the original outcome, 30-day in-hospital mortality and the composite of 30-day in-hospital mortality or ICU transfer.

Results

We included 14,343 consecutive patients, 2583 (18%) died and 5067 (35%) died or were transferred to the ICU. We examined 274 studies and found 32 scores meeting the inclusion criteria: 19 had a significantly lower AUC in our cohort than in previously published validation studies for the original outcome; 25 performed better to predict in-hospital mortality than the composite of in-hospital mortality or ICU transfer; 7 had an AUC > 0.75 to predict in-hospital mortality; 2 had an AUC > 0.70 to predict the composite outcome.

Conclusion

Seven prognostic scores were fairly accurate to predict death in hospitalized COVID-19 patients. The 4C Mortality Score and the ABCS stand out because they performed as well in our cohort and their initial validation cohort, during the first epidemic wave and subsequent waves, and in younger and older patients.

SUBMITTER: Lombardi Y

PROVIDER: S-EPMC8478265 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The aim of this study was to evaluate the changing pattern of antibiotic usage and antimicrobial resistance of bacterial pathogens among hospitalized patients in Korea. We simultaneously investigated the correlation between antimicrobial resistance and antibiotic consumption.Data on total antibiotic prescriptions, patient days, and antimicrobial sensitivity tests among inpatients from 6 university hospitals in Korea in 2004, 2008, and 2012 were collected. The consumption of each antibiotic class was converted to defined daily dose/1000 patient-days by using the anatomical therapeutic chemical classification system by the World Health Organization. We defined third-generation cephalosporins (3rd CEPs), fourth-generation cephalosporins, beta-lactam/beta-lactamase inhibitors, and fluoroquinolones (FQs) as broad-spectrum antibiotics and carbapenems, tigecycline, glycopeptides, oxazolidinone, and polymyxin as antibiotics against multidrug-resistant (MDR) pathogens.A 15.1% decrease in total antibiotic consumption was observed in 2012 compared to that observed in 2004. In contrast, a 10.2% and 70.7% increase in broad-spectrum antibiotics and antibiotics against MDR pathogens were observed, respectively, in the same period. The resistance rate of Escherichia coli to 3rd CEPs (17.6% in 2004, 21.7% in 2008, and 33.8% in 2012, P <.001) and ciprofloxacin (37.5% in 2004, 38.7% in 2008, and 46.6% in 2012, P = .001) demonstrated a significantly increasing trend. Similarly, the resistance rate of Klebsiella pneumoniae to 3rd CEPs (34.3% in 2004, 33.7% in 2008, and 44.5% in 2012, P <.001) gradually increased. Resistance of Acinetobacter baumanii and Pseudomonas aeruginosa to imipenem significantly increased throughout the study period (A baumanii: 8.9% in 2004, 40.8% in 2008, and 65.3% in 2012, P <.001; P aeruginosa: 25.1% in 2004, 31.5% in 2008, and 29.7% in 2008, P = .050).The consumption of carbapenems and FQs demonstrated significant positive correlation for resistance of E coli or K pneumoniae to 3rd CEPs as well as E coli or K pneumoniae to ciprofloxacin. Increasing resistance of A baumanii to ciprofloxacin was significantly correlated with increasing consumption of FQs; increasing resistance of A baumanii to imipenem was significantly correlated with increasing consumption of carbapenems.In conclusion, overall antimicrobial resistance increased and consumption of broad-spectrum antibiotics and antibiotics against MDR pathogens subsequently increased in Korean hospitals.

Project description:Coronary artery disease (CAD), the most common manifestation of cardiovascular disease, remains the most common cause of mortality in the United States. Risk assessment is key for primary prevention of coronary events and coronary artery calcium (CAC) scoring using computed tomography (CT) is one such non-invasive tool. Despite the proven clinical value of CAC, the current clinical practice implementation for CAC has limitations such as the lack of insurance coverage for the test, need for capital-intensive CT machines, specialized imaging protocols, and accredited 3D imaging labs for analysis (including personnel and software). Perhaps the greatest gap is the millions of patients who undergo routine chest CT exams and demonstrate coronary artery calcification, but their presence is not often reported or quantitation is not feasible. We present two deep learning models that automate CAC scoring demonstrating advantages in automated scoring for both dedicated gated coronary CT exams and routine non-gated chest CTs performed for other reasons to allow opportunistic screening. First, we trained a gated coronary CT model for CAC scoring that showed near perfect agreement (mean difference in scores = -2.86; Cohen's Kappa = 0.89, P < 0.0001) with current conventional manual scoring on a retrospective dataset of 79 patients and was found to perform the task faster (average time for automated CAC scoring using a graphics processing unit (GPU) was 3.5 ± 2.1 s vs. 261 s for manual scoring) in a prospective trial of 55 patients with little difference in scores compared to three technologists (mean difference in scores = 3.24, 5.12, and 5.48, respectively). Then using CAC scores from paired gated coronary CT as a reference standard, we trained a deep learning model on our internal data and a cohort from the Multi-Ethnic Study of Atherosclerosis (MESA) study (total training n = 341, Stanford test n = 42, MESA test n = 46) to perform CAC scoring on routine non-gated chest CT exams with validation on external datasets (total n = 303) obtained from four geographically disparate health systems. On identifying patients with any CAC (i.e., CAC ≥ 1), sensitivity and PPV was high across all datasets (ranges: 80-100% and 87-100%, respectively). For CAC ≥ 100 on routine non-gated chest CTs, which is the latest recommended threshold to initiate statin therapy, our model showed sensitivities of 71-94% and positive predictive values in the range of 88-100% across all the sites. Adoption of this model could allow more patients to be screened with CAC scoring, potentially allowing opportunistic early preventive interventions.

Project description:BackgroundThe aim of this study was to develop and validate systematic nomograms to predict cancer specific survival (CSS) and overall survival (OS) in osteosarcoma patients aged over 60 years.MethodsWe used data from the Surveillance, Epidemiology, and End Results (SEER) database and identified 982 patients with osteosarcoma over 60 years of age diagnosed between 2004 and 2015. Overall, 306 patients met the requirements for the training group. Next, we enrolled 56 patients who met the study requirements from multiple medical centers as the external validation group to validate and analyze our model. We collected all available variables and finally selected eight that were statistically associated with CSS and OS through Cox regression analysis. Integrating the identified variables, we constructed 3- and 5-year OS and CSS nomograms, respectively, which were further evaluated by calculating the C-index. A calibration curve was used to evaluate the accuracy of the model. Receiver operating characteristic (ROC) curves measured the predictive capacity of the nomograms. The Kaplan-Meier analysis was used for all patient-based variables to explore the influence of various factors on patient survival. Finally, a decision curve analysis (DCA) curve was used to analyze whether our model would be suitable for application in clinical practice.ResultsCox regression analysis of clinical variables identified age, sex, marital status, tumor grade, tumor laterality, tumor size, M-stage, and surgical treatment as prognostic factors. Nomograms showed good predictive capacity for OS and CSS. We calculated that the C-index of the OS nomogram of the training population was 0.827 (95% CI 0.778-0.876), while that of the CSS nomogram was 0.722 (95% CI 0.665-0.779). The C-index of the OS nomogram evaluated on the external validation population was 0.716 (95% CI 0.575-0.857), while that of the CSS nomogram was 0.642 (95% CI 0.50-0.788). Furthermore, the calibration curve of our prediction models indicated the nomograms could accurately predict patient outcome.ConclusionsThe constructed nomogram is a useful tool for accurately predicting OS and CSS at 3 and 5 years for patients over 60 years of age with osteosarcoma and can assist clinicians in making appropriate decisions in practice.

Project description:BackgroundEuroLung Risk scores were established to predict postoperative morbidity and mortality in patients undergoing anatomic lung resections. We aimed to perform an external validation of the EuroLung scores, which were calculated from data of the European Society of Thoracic Surgeons database, in our video-assisted thoracoscopic surgery cohort.MethodsAll available EuroLung scores were calculated for 718 patients scheduled for anatomic video-assisted thoracoscopic surgery resections between 2009 and 2019. Morbidity and mortality according to the definitions of the EuroLung scores were analyzed in a prospectively maintained database.ResultsOverall observed complication rate was 10.45%. Scores showed weak individual correlation (η = 0.155-0.174). The EuroLung1 app score showed the biggest area under the receiver operative characteristic (ROC) curve with 0.660. Binary logistic regression analysis showed that predicted postoperative forced expiratory volume in 1 s was associated with increased complications in both EuroLung1 and parsimonious EuroLung1 scores. Thirty-day mortality was 0.7% (predicted 1.10-1.40%) and was associated with predicted postoperative forced expiratory volume in 1 s for both EuroLung2 and parsimonious EuroLung2 scores. The EuroLung2 (2016) showed the biggest area under the ROC curve with 0.673. Only a very weak eta correlation between predicted and observed mortality was found for both aggregate EuroLung2, EuroLung2 (2016), EuroLung2 (2019), and parsimonious EuroLung2 (2016) (η = 0.025/0.015/0.011/0.009).ConclusionEuroLung scores help to estimate postoperative morbidity. However, even with the highest aggregate EuroLung scores possible only 50% suffer from postoperative morbidity. Although calibration of the scores was acceptable, discrimination between predicted and observed events was poor. Therefore, individual correlation between predicted and observed events is weak. Therefore, EuroLung scores may be best used to compare institutional quality of care to the European Society of Thoracic Surgeons database but should not be used to preclude patients from surgical treatment.