External Validation and Recalibration of the CURB-65 and PSI for Predicting 30-Day Mortality and Critical Care Intervention in Multiethnic Patients with COVID-19.
Ontology highlight
ABSTRACT: Objectives
To validate and recalibrate the CURB-65 and pneumonia severity index (PSI) in predicting 30-day mortality and critical care intervention (CCI) in a multiethnic population with COVID-19, along with evaluating both models in predicting CCI.Methods
Retrospective data was collected for 1181 patients admitted to the largest hospital in Qatar with COVID-19 pneumonia. The area under the curve (AUC), calibration curves, and other metrics were bootstrapped to examine the performance of the models. Variables constituting the CURB-65 and PSI scores underwent further analysis using the Least Absolute Shrinkage and Selection Operator (LASSO) along with logistic regression to develop a model predicting CCI. Complex machine learning models were built for comparative analysis.Results
The PSI performed better than CURB-65 in predicting 30-day mortality (AUC 0.83, 0.78 respectively), while CURB-65 outperformed PSI in predicting CCI (AUC 0.78, 0.70 respectively). The modified PSI/CURB-65 model (respiratory rate, oxygen saturation, hematocrit, age, sodium, and glucose) predicting CCI had excellent accuracy (AUC 0.823) and good calibration.Conclusions
Our study recalibrated, externally validated the PSI and CURB-65 for predicting 30-day mortality and CCI, and developed a model for predicting CCI. Our tool can potentially guide clinicians in Qatar to stratify patients with COVID-19 pneumonia.
SUBMITTER: Elmoheen A
PROVIDER: S-EPMC8372428 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ObjectiveThis article aims to assess the utility of CURB-65 in predicting 30-day mortality in adult patients hospitalized with COVID-19.MethodsThis work is a cohort study conducted between March 1 and April 30, 2020 in Ecuador.ResultsA total of 247 patients were included (mean age 60 ± 14 years, 70% men, overall mortality 41.3%). Patients with CURB-65 ≥ 2 had a higher mortality rate (57 vs. 17%, p < .001) that was associated with other markers of risk: advanced age, hypertension, overweight/obesity, kidney failure, hypoxemia, requirement for mechanical ventilation, or onset of respiratory distress.ConclusionsCURB-65 ≥ 2 was associated with higher 30-day mortality on the univariate (Kaplan-Meier estimator) and multivariate (Cox regression) analysis.
| S-EPMC8086802 | biostudies-literature
Project description:ObjectiveThis article aims to assess the utility of CURB-65 in predicting 30-day mortality in adult patients hospitalized with COVID-19.MethodsThis work is a cohort study conducted between March 1 and April 30, 2020 in Ecuador.ResultsA total of 247 patients were included (mean age 60 ± 14 years, 70% men, overall mortality 41.3%). Patients with CURB-65 ≥ 2 had a higher mortality rate (57 vs. 17%, p < .001) that was associated with other markers of risk: advanced age, hypertension, overweight/obesity, kidney failure, hypoxemia, requirement for mechanical ventilation, or onset of respiratory distress.ConclusionsCURB-65 ≥ 2 was associated with higher 30-day mortality on the univariate (Kaplan-Meier estimator) and multivariate (Cox regression) analysis.
| S-EPMC7580560 | biostudies-literature
Project description:BackgroundEarly risk stratification for guiding treatment priority in the emergency department (ED) is becoming increasingly important. Existing prediction models typically use demographics, vital signs and laboratory parameters. Laboratory-based models require blood testing, which may cause substantial delay. However, these delays can be prevented by the use of point-of-care testing (POCT), where results are readily available. We aimed to externally validate a laboratory-based model for mortality and subsequently assessed whether a POCT model yields comparable performance.MethodsAll adult patients visiting the ED of a university hospital between January 1st, 2012 and December 31st, 2016 were retrospectively reviewed for inclusion. Primary outcome was defined as 30-day mortality after ED presentation. We externally validated one existing prediction model including age, glucose, urea, sodium, haemoglobin, platelet count and white blood cell count. We assessed the predictive performance by discrimination, expressed as Area under the Curve (AUC). We compared the existing model to an equivalent model using predictors that are available with POCT (i.e. glucose, urea, sodium and haemoglobin). Additionally, we internally validated these models with bootstrapping.ResultsWe included 34,437 patients of whom 1,942 (5.6%) died within 30 days. The AUC of the laboratory-based model was 0.794. We refitted this model to our ED population and found an AUC of 0.812, which decreased only slightly to 0.790 with only POCT parameters.ConclusionsOur POCT-model performs similar to existing laboratory-based models in identifying patients at high risk for mortality, with results available within minutes. Although the model needs further validation and evaluation, it shows the potential of POCT for early risk stratification in the ED.
| S-EPMC7514068 | biostudies-literature
Project description:Importance:Falls are common among older adults, particularly those with previous falls and cognitive impairment and in the postdischarge period. Hospitals have financial incentives to reduce both inpatient falls and hospital readmissions, yet little is known about whether fall-related injuries (FRIs) are common diagnoses for 30-day hospital readmissions. Objective:To compare fall-related readmissions with other leading rehospitalization diagnoses, including for patients at greatest risk of readmission. Design, Setting, and Participants:Retrospective cohort study of the Hospital Cost and Utilization Project's Nationwide Readmissions Database of nationally representative US hospital discharges among Medicare beneficiaries aged 65 years and older from January 1, 2013, to November 30, 2014. The prevalence and ranking of FRIs compared with other diagnostic factors for 30-day unplanned hospital-wide readmissions were determined, overall and for 2 acute geriatric cohorts, classified by fall injury or cognitive impairment diagnoses observed at the index admission. Analyses were also stratified by patient discharge disposition (home, home health care, skilled nursing facility). Analyses were conducted from February 1, 2018, to February 26, 2018. Main Outcomes and Measures:Unplanned hospital-wide readmission within 30 days of discharge. Results:From the database, 8?382?074 eligible index admissions were identified, including 746?397 (8.9%) in the FRI cohort and 1?367?759 (16.3%) in the cognitive impairment cohort. Among the entire 8 382 074-discharge cohort, mean (SD) age was 77.7 (7.8) years and 4?736?281 (56.5%) were female. Overall, 1?205?962 (14.4%) of index admissions resulted in readmission, with readmission rates of 12.9% for those with a previous fall and 16.0% for patients with cognitive impairment. Overall, FRIs ranked as the third-leading readmission diagnosis, accounting for 60?954 (5.1%) of all readmission diagnoses. Within the novel acute geriatric cohorts, FRIs were the second-leading diagnosis for readmission both for patients with an FRI at index admission (10.3% of all readmission diagnoses) and those with cognitive impairment (7.0% of all readmission diagnoses). For those with an FRI at index admission and discharged home or to home health care, FRIs were the leading readmission diagnosis. Conclusions and Relevance:This study found that posthospital FRIs were a leading readmission diagnosis, particularly for patients originally admitted with a FRI or cognitive impairment. Targeting at-risk hospitalized older adults, particularly those discharged to home or home health care, is an underexplored, cost-effective mechanism with potential to reduce readmissions and improve patient care.
| S-EPMC6632136 | biostudies-literature
Project description:BACKGROUND:Postoperative mortality occurs in 1-2% of patients undergoing major inpatient surgery. The currently available prediction tools using summaries of intraoperative data are limited by their inability to reflect shifting risk associated with intraoperative physiological perturbations. We sought to compare similar benchmarks to a deep-learning algorithm predicting postoperative 30-day mortality. METHODS:We constructed a multipath convolutional neural network model using patient characteristics, co-morbid conditions, preoperative laboratory values, and intraoperative numerical data from patients undergoing surgery with tracheal intubation at a single medical centre. Data for 60 min prior to a randomly selected time point were utilised. Model performance was compared with a deep neural network, a random forest, a support vector machine, and a logistic regression using predetermined summary statistics of intraoperative data. RESULTS:Of 95 907 patients, 941 (1%) died within 30 days. The multipath convolutional neural network predicted postoperative 30-day mortality with an area under the receiver operating characteristic curve of 0.867 (95% confidence interval [CI]: 0.835-0.899). This was higher than that for the deep neural network (0.825; 95% CI: 0.790-0.860), random forest (0.848; 95% CI: 0.815-0.882), support vector machine (0.836; 95% CI: 0.802-870), and logistic regression (0.837; 95% CI: 0.803-0.871). CONCLUSIONS:A deep-learning time-series model improves prediction compared with models with simple summaries of intraoperative data. We have created a model that can be used in real time to detect dynamic changes in a patient's risk for postoperative mortality.
| S-EPMC6993109 | biostudies-literature
Project description:BACKGROUND:Readmissions after hospitalization for pneumonia are common, but the few risk-prediction models have poor to modest predictive ability. Data routinely collected in the electronic health record (EHR) may improve prediction. OBJECTIVE:To develop pneumonia-specific readmission risk-prediction models using EHR data from the first day and from the entire hospital stay ("full stay"). DESIGN:Observational cohort study using stepwise-backward selection and cross-validation. SUBJECTS:Consecutive pneumonia hospitalizations from 6 diverse hospitals in north Texas from 2009-2010. MEASURES:All-cause nonelective 30-day readmissions, ascertained from 75 regional hospitals. RESULTS:Of 1463 patients, 13.6% were readmitted. The first-day pneumonia-specific model included sociodemographic factors, prior hospitalizations, thrombocytosis, and a modified pneumonia severity index; the full-stay model included disposition status, vital sign instabilities on discharge, and an updated pneumonia severity index calculated using values from the day of discharge as additional predictors. The full-stay pneumonia-specific model outperformed the first-day model (C statistic 0.731 vs 0.695; P = 0.02; net reclassification index = 0.08). Compared to a validated multi-condition readmission model, the Centers for Medicare and Medicaid Services pneumonia model, and 2 commonly used pneumonia severity of illness scores, the full-stay pneumonia-specific model had better discrimination (C statistic range 0.604-0.681; P < 0.01 for all comparisons), predicted a broader range of risk, and better reclassified individuals by their true risk (net reclassification index range, 0.09-0.18). CONCLUSIONS:EHR data collected from the entire hospitalization can accurately predict readmission risk among patients hospitalized for pneumonia. This approach outperforms a first-day pneumonia-specific model, the Centers for Medicare and Medicaid Services pneumonia model, and 2 commonly used pneumonia severity of illness scores. Journal of Hospital Medicine 2017;12:209-216.
| S-EPMC6296251 | biostudies-literature
Project description:BackgroundAccurate severity assessment is crucial to the initial management of community-acquired pneumonia (CAP). The CURB-65 (confusion, uremia, respiratory rate, BP, age ? 65 years) score contains data that are entered routinely in electronic medical records and are, thus, electronically calculable. The aim of this study was to determine whether an electronically generated severity estimate using CURB-65 elements as continuous and weighted variables better predicts 30-day mortality than the traditional CURB-65.MethodsIn a retrospective cohort study at a US university-affiliated community teaching hospital, we identified 2,069 patients aged 18 years or older with CAP confirmed by radiographic findings in the ED. CURB-65 elements were extracted from the electronic medical record, and 30-day mortality was identified with the Utah Population Database. Performance of a severity prediction model using continuous and weighted CURB-65 variables was compared with the traditional CURB-65 in the US derivation population and validated in the original 1,048 patients from the CURB-65 international derivation study.ResultsThe traditional, binary CURB-65 score predicted mortality in the US cohort with an area under the curve (AUC) of 0.82. Our severity prediction model generated from continuous, weighted CURB-65 elements was superior to the traditional CURB-65, with an out-of-bag AUC of 0.86 (P < .001). This finding was validated in the international database, with an AUC of 0.85 for the electronic model compared with 0.80 for the traditional CURB-65 (P = .01).ConclusionsUsing CURB-65 elements as continuous and weighted data improved prediction of 30-day mortality and could be used as a real-time, electronic decision support tool or to adjust outcomes by severity when comparing processes of care.
| S-EPMC3198487 | biostudies-literature
Project description:Avoidable hospital readmissions not only contribute to the high costs of healthcare in the US, but also have an impact on the quality of care for patients. Large scale adoption of Electronic Health Records (EHR) has created the opportunity to proactively identify patients with high risk of hospital readmission, and apply effective interventions to mitigate that risk. To that end, in the past, numerous machine-learning models have been employed to predict the risk of 30-day hospital readmission. However, the need for an accurate and real-time predictive model, suitable for hospital setting applications still exists. Here, using data from more than 300,000 hospital stays in California from Sutter Health's EHR system, we built and tested an artificial neural network (NN) model based on Google's TensorFlow library. Through comparison with other traditional and non-traditional models, we demonstrated that neural networks are great candidates to capture the complexity and interdependency of various data fields in EHRs. LACE, the current industry standard, showed a precision (PPV) of 0.20 in identifying high-risk patients in our database. In contrast, our NN model yielded a PPV of 0.24, which is a 20% improvement over LACE. Additionally, we discussed the predictive power of Social Determinants of Health (SDoH) data, and presented a simple cost analysis to assist hospitalists in implementing helpful and cost-effective post-discharge interventions.
| S-EPMC5510858 | biostudies-other
Project description:Reducing unplanned readmissions is a major focus of current hospital quality efforts. In order to avoid unfair penalization, administrators and policymakers use prediction models to adjust for the performance of hospitals from healthcare claims data. Regression-based models are a commonly utilized method for such risk-standardization across hospitals; however, these models often suffer in accuracy. In this study we, compare four prediction models for unplanned patient readmission for patients hospitalized with acute myocardial infarction (AMI), congestive health failure (HF), and pneumonia (PNA) within the Nationwide Readmissions Database in 2014. We evaluated hierarchical logistic regression and compared its performance with gradient boosting and two models that utilize artificial neural networks. We show that unsupervised Global Vector for Word Representations embedding representations of administrative claims data combined with artificial neural network classification models improves prediction of 30-day readmission. Our best models increased the AUC for prediction of 30-day readmissions from 0.68 to 0.72 for AMI, 0.60 to 0.64 for HF, and 0.63 to 0.68 for PNA compared to hierarchical logistic regression. Furthermore, risk-standardized hospital readmission rates calculated from our artificial neural network model that employed embeddings led to reclassification of approximately 10% of hospitals across categories of hospital performance. This finding suggests that prediction models that incorporate new methods classify hospitals differently than traditional regression-based approaches and that their role in assessing hospital performance warrants further investigation.
| S-EPMC7159221 | biostudies-literature
Project description:1) To develop a cumulative perioperative model (CPM) using the hospital clinical course of abdominal surgery cancer patients that predicts 30 and 90-day mortality risk; 2) To compare the predictive ability of this model to ten existing other models. We constructed a multivariate logistic regression model of 30 (90)-day mortality, which occurred in 106 (290) of the cases, using 13,877 major abdominal surgical cases performed at the University of Texas MD Anderson Cancer Center from January 2007 to March 2014. The model includes race, starting location (home, inpatient ward, intensive care unit or emergency center), Charlson Comorbidity Index, emergency status, ASA-PS classification, procedure, surgical Apgar score, destination after surgery (hospital ward location) and delayed intensive care unit admit within six days. We computed and compared the model mortality prediction ability (C-statistic) as we accumulated features over time. We were able to predict 30 (90)-day mortality with C-statistics from 0.70 (0.71) initially to 0.87 (0.84) within six days postoperatively. We achieved a high level of model discrimination. The CPM enables a continuous cumulative assessment of the patient's mortality risk, which could then be used as a decision support aid regarding patient care and treatment, potentially resulting in improved outcomes, decreased costs and more informed decisions.
| S-EPMC8496410 | biostudies-literature