Dataset Information

External validation of a prognostic model for intensive care unit mortality: a retrospective study using the Ontario Critical Care Information System.

ABSTRACT: PURPOSE:To externally validate an intensive care unit (ICU) mortality prediction model that was created using the Ontario Critical Care Information System (CCIS), which includes the Multiple Organ Dysfunction Score (MODS). METHODS:We applied the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) recommendations to a prospective longitudinal cohort of patients discharged between 1 July 2015 and 31 December 31 2016 from 90 adult level-3 critical care units in Ontario. We used multivariable logistic regression with measures of discrimination, calibration-in-the-large, calibration slope, and flexible calibration plots to compare prediction model performance of the entire data set and for each ICU subtype. RESULTS:Among 121,201 CCIS records with ICU mortality of 11.3%, the C-statistic for the validation data set was 0.805. The C-statistic ranged from 0.775 to 0.846 among the ICU subtypes. After intercept recalibration to adjust the baseline risk, the mean predicted risk of death matched actual ICU mortality. The calibration slope was close to 1 with all CCIS data and ICU subtypes of cardiovascular and community hospitals with low ventilation rates. Calibration slopes significantly less than 1 were found for ICUs in teaching hospitals and community hospitals with high ventilation rates whereas coronary care units had a calibration slope significantly higher than 1. Calibration plots revealed over-prediction in high risk groups to a varying degree across all cohorts. CONCLUSIONS:A risk prediction model primarily based on the MODS shows reproducibility and transportability after intercept recalibration. Risk adjusting models that use existing and feasible data collection can support performance measurement at the individual ICU level.

SUBMITTER: Priestap F

PROVIDER: S-EPMC7223438 | biostudies-literature | 2020 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

External validation of a prognostic model for intensive care unit mortality: a retrospective study using the Ontario Critical Care Information System.

Priestap Fran F Kao Raymond R Martin Claudio M CM

Canadian journal of anaesthesia = Journal canadien d'anesthesie 20200507 8

<h4>Purpose</h4>To externally validate an intensive care unit (ICU) mortality prediction model that was created using the Ontario Critical Care Information System (CCIS), which includes the Multiple Organ Dysfunction Score (MODS).<h4>Methods</h4>We applied the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) recommendations to a prospective longitudinal cohort of patients discharged between 1 July 2015 and 31 December 31 2016 from 90 adult ...[more]

PMID: 32383124

Similar Datasets

Project description:BackgroundEarly prediction model of hemodynamic instability has the potential to improve the critical care, whereas limited external validation on the generalizability. We aimed to independently validate the Hemodynamic Stability Index (HSI), a multi-parameter machine learning model, in predicting hemodynamic instability in Asian patients.MethodHemodynamic instability was marked by using inotropic, vasopressor, significant fluid therapy, and/or blood transfusions. This retrospective study included among 15,967 ICU patients who aged 20 years or older (not included 20 years) and stayed in ICU for more than 6 h admitted to Taipei Veteran General Hospital (TPEVGH) between January 1, 2010, and March 31, 2020, of whom hemodynamic instability occurred in 3053 patients (prevalence = 19%). These patients in unstable group received at least one intervention during their ICU stays, and the HSI score of both stable and unstable group was calculated in every hour before intervention. The model performance was assessed using the area under the receiver operating characteristic curve (AUROC) and was compared to single indicators like systolic blood pressure (SBP) and shock index. The hemodynamic instability alarm was set by selecting optimal threshold with high sensitivity, acceptable specificity, and lead time before intervention was calculated to indicate when patients were firstly identified as high risk of hemodynamic instability.ResultsThe AUROC of HSI was 0.76 (95% CI, 0.75-0.77), which performed significantly better than shock Index (0.7; 95% CI, 0.69-0.71) and SBP (0.69; 95% CI, 0.68-0.70). By selecting 0.7 as a threshold, HSI predicted 72% of all 3053 patients who received hemodynamic interventions with 67% in specificity. Time-varying results also showed that HSI score significantly outperformed single indicators even up to 24 h before intervention. And 95% unstable patients can be identified more than 5 h in advance.ConclusionsThe HSI has acceptable discrimination but underestimates the risk of stable patients in predicting the onset of hemodynamic instability in an external cohort.

Project description:BackgroundNo data is available on delirium prediction models in the cardiac intensive care unit (CICU), although preexisting delirium prediction models [PREdiction of DELIRium in ICu patients (PRE-DELIRIC) and Early PREdiction of DELIRium in ICu patients (E-PRE-DELIRIC)] were developed and validated based on a population admitted to the general intensive care unit (ICU). Therefore, we externally validated the usefulness of the PRE-DELIRIC and E-PRE-DELIRIC models and compared their predictive performance in patients admitted to the CICU.MethodsA total of 2,724 patients admitted to the CICU were enrolled between September 2012 and December 2018. Delirium was defined as at least one positive Confusion Assessment Method for the ICU (CAM-ICU) which was screened at least once every 8 h. The PRE-DELIRIC value was calculated within 24 h of CICU admission, and the E-PRE-DELIRIC value was calculated at CICU admission. The predictive performance of the models was evaluated by using the area under the receiver operating characteristic (AUROC) curve, and the calibration slope was assessed graphically by plotting.ResultsDelirium occurred in 677 patients (24.8%) when the patients were assessed thrice daily until 7 days of the CICU stay. The AUROC curve for the prediction of delirium was significantly greater for PRE-DELIRIC values [0.84, 95% confidence interval (CI): 0.82-0.86] than for E-PRE-DELIRIC values (0.79, 95% CI: 0.77-0.80) [z score of -6.24 (p < 0.001)]. Net reclassification improvement for the prediction of delirium increased by 0.27 (95% CI: 0.21-0.32, p < 0.001). Calibration was acceptable in the PRE-DELIRIC model (Hosmer-Lemeshow p = 0.170) but not in the E-PRE-DELIRIC model (Hosmer-Lemeshow p < 0.001).ConclusionAlthough both models have good predictive performance for the development of delirium, even in critically ill cardiac patients, the performance of the PRE-DELIRIC model might be superior to that of the E-PRE-DELIRIC model. Further studies are required to confirm our results and design a specific delirium prediction model for CICU patients.

Project description:Objectives: Multiple risk factors have been described to be related to external ventricular drain (EVD) associated infections, with results varying between studies. Former studies were limited by a non-uniform definition of EVD associated infection, thus complicating a comparison between studies. In this regard, we assessed risk factors promoting EVD associated infections and propose a modified practice-oriented definition of EVD associated infections. Methods: We performed a retrospective, single-center study on patients who were treated with an EVD, at the neurosurgical intensive care unit (ICU) at a tertiary center between 2008 and 2019. Based on microbiological findings and laboratory results, patients were assigned into an infection and a non-infection group. Patient characteristics and potential risk factors were compared between the two groups (p < 0.05). Receiver operating characteristics (ROC) for significant clinical, serum laboratory and cerebrospinal fluid (CSF) parameters were calculated. Results: In total, 396 patients treated with an EVD were included into the study with a mean age of 54.3 (range: 18-89) years. EVD associated infections were observed in 32 (8.1%) patients. EVD insertion at another hospital (OR 3.86), and an increased CSF sampling frequency of more than every third day (OR 12.91) were detected as major risk factors for an EVD associated infection. The indication for EVD insertion, surgeon's experience, the setting of EVD insertion (ICU vs. operating room) and the operating time did not show any significant differences between the two groups. Furthermore, ROC analysis showed that clinical, serum laboratory and CSF parameters did not provide specific prediction of EVD associated infections (specificity 44.4%). This explains the high overtreatment rate in our cohort with the majority of our patients who received intrathecal vancomycin (63.3%), having either negative microbiological results (n = 12) or were defined as contaminations (n = 7). Conclusions: Since clinical parameters and blood analyzes are not very predictive to detect EVD associated infections in neurosurgical patients, sequential but not too frequent microbiological and laboratory analysis of CSF are still necessary. Furthermore, we propose a uniform classification for EVD associated infections to allow comparability between studies and to sensitize the treating physician in determining the right treatment.

Project description:BACKGROUND:Majority burn mortality prognostic scores were developed and validated in western populations. The primary objective of this study was to evaluate and identify possible risk factors which may be used to predict burns mortality in a local Malaysian burns intensive care unit. The secondary objective was to validate the five well known burn prognostic scores (Baux score, Abbreviated Burn Severity Index (ABSI) score, Ryan score, Belgium Outcome Burn Injury (BOBI) score and revised Baux score) to predict burn mortality prediction. METHODS:Patients that were treated at the Hospital Sultan Ismail's Burns Intensive Care (BICU) unit for acute burn injuries between 1 January 2010 to 31 December 2017 were included. Risk factors to predict in-patient burn mortality were gender, age, mechanism of injury, total body surface area burn (TBSA), inhalational injury, mechanical ventilation, presence of tracheotomy, time from of burn injury to BICU admission and initial centre of first emergency treatment was administered. These variables were analysed using univariate and multivariate analysis for the outcomes of death. All patients were scored retrospectively using the five-burn mortality prognostic scores. Predictive ability for burn mortality was analysed using the area under receiver operating curve (AUROC). RESULTS:A total of 525 patients (372 males and 153 females) with mean age of 34.5?±?14.6?years were included. There were 463 survivors and 62 deaths (11.8% mortality rate). The outcome of the primary objective showed that amongst the burn mortality risk factors that remained after multivariate analysis were older age (p?=?0.004), wider TBSA burn (p?<?0.001) and presence of mechanical ventilation (p?<?0.001). Outcome of secondary objective showed good AUROC value for the prediction of burn death for all five burn prediction scores (Baux score; AUROC:0.9, ABSI score; AUROC:0.92, Ryan score; AUROC:0.87, BOBI score; AUROC:0.91 and revised Baux score; AUROC:0.94). The revised Baux score had the best AUROC value of 0.94 to predict burns mortality. CONCLUSION:Current study evaluated and identified older age, total body surface area burns, and mechanical ventilation as significant predictors of burn mortality. In addition, the revised Baux score was the most accurate burn mortality risk score to predict mortality in a Malaysian burn's population.

Dataset Information

External validation of a prognostic model for intensive care unit mortality: a retrospective study using the Ontario Critical Care Information System.

Publications

External validation of a prognostic model for intensive care unit mortality: a retrospective study using the Ontario Critical Care Information System.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets