Dataset Information

Delirium prediction in the intensive care unit: comparison of two delirium prediction models.

ABSTRACT: BACKGROUND:Accurate prediction of delirium in the intensive care unit (ICU) may facilitate efficient use of early preventive strategies and stratification of ICU patients by delirium risk in clinical research, but the optimal delirium prediction model to use is unclear. We compared the predictive performance and user convenience of the prediction model for delirium (PRE-DELIRIC) and early prediction model for delirium (E-PRE-DELIRIC) in ICU patients and determined the value of a two-stage calculation. METHODS:This 7-country, 11-hospital, prospective cohort study evaluated consecutive adults admitted to the ICU who could be reliably assessed for delirium using the Confusion Assessment Method-ICU or the Intensive Care Delirium Screening Checklist. The predictive performance of the models was measured using the area under the receiver operating characteristic curve. Calibration was assessed graphically. A physician questionnaire evaluated user convenience. For the two-stage calculation we used E-PRE-DELIRIC immediately after ICU admission and updated the prediction using PRE-DELIRIC after 24 h. RESULTS:In total 2178 patients were included. The area under the receiver operating characteristic curve was significantly greater for PRE-DELIRIC (0.74 (95% confidence interval 0.71-0.76)) compared to E-PRE-DELIRIC (0.68 (95% confidence interval 0.66-0.71)) (z score of -?2.73 (p?

SUBMITTER: Wassenaar A

PROVIDER: S-EPMC5935943 | biostudies-literature | 2018 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Delirium prediction in the intensive care unit: comparison of two delirium prediction models.

Wassenaar Annelies A Schoonhoven Lisette L Devlin John W JW van Haren Frank M P FMP Slooter Arjen J C AJC Jorens Philippe G PG van der Jagt Mathieu M Simons Koen S KS Egerod Ingrid I Burry Lisa D LD Beishuizen Albertus A Matos Joaquim J Donders A Rogier T ART Pickkers Peter P van den Boogaard Mark M

Critical care (London, England) 20180505 1

<h4>Background</h4>Accurate prediction of delirium in the intensive care unit (ICU) may facilitate efficient use of early preventive strategies and stratification of ICU patients by delirium risk in clinical research, but the optimal delirium prediction model to use is unclear. We compared the predictive performance and user convenience of the prediction model for delirium (PRE-DELIRIC) and early prediction model for delirium (E-PRE-DELIRIC) in ICU patients and determined the value of a two-sta ...[more]

PMID: 29728150

Similar Datasets

Project description:BackgroundNo data is available on delirium prediction models in the cardiac intensive care unit (CICU), although preexisting delirium prediction models [PREdiction of DELIRium in ICu patients (PRE-DELIRIC) and Early PREdiction of DELIRium in ICu patients (E-PRE-DELIRIC)] were developed and validated based on a population admitted to the general intensive care unit (ICU). Therefore, we externally validated the usefulness of the PRE-DELIRIC and E-PRE-DELIRIC models and compared their predictive performance in patients admitted to the CICU.MethodsA total of 2,724 patients admitted to the CICU were enrolled between September 2012 and December 2018. Delirium was defined as at least one positive Confusion Assessment Method for the ICU (CAM-ICU) which was screened at least once every 8 h. The PRE-DELIRIC value was calculated within 24 h of CICU admission, and the E-PRE-DELIRIC value was calculated at CICU admission. The predictive performance of the models was evaluated by using the area under the receiver operating characteristic (AUROC) curve, and the calibration slope was assessed graphically by plotting.ResultsDelirium occurred in 677 patients (24.8%) when the patients were assessed thrice daily until 7 days of the CICU stay. The AUROC curve for the prediction of delirium was significantly greater for PRE-DELIRIC values [0.84, 95% confidence interval (CI): 0.82-0.86] than for E-PRE-DELIRIC values (0.79, 95% CI: 0.77-0.80) [z score of -6.24 (p < 0.001)]. Net reclassification improvement for the prediction of delirium increased by 0.27 (95% CI: 0.21-0.32, p < 0.001). Calibration was acceptable in the PRE-DELIRIC model (Hosmer-Lemeshow p = 0.170) but not in the E-PRE-DELIRIC model (Hosmer-Lemeshow p < 0.001).ConclusionAlthough both models have good predictive performance for the development of delirium, even in critically ill cardiac patients, the performance of the PRE-DELIRIC model might be superior to that of the E-PRE-DELIRIC model. Further studies are required to confirm our results and design a specific delirium prediction model for CICU patients.

Project description:BackgroundDelirium frequently occurs among patients admitted to the intensive care unit (ICU). There is limited evidence to support interventions to treat or resolve delirium in patients who have already developed delirium. Therefore, the early recognition and prevention of delirium are important in the management of critically ill patients.ObjectiveThis study aims to develop and validate a delirium prediction model within 24 hours of admission to the ICU using electronic health record data. The algorithm was named the Prediction of ICU Delirium (PRIDE).MethodsThis is a retrospective cohort study performed at a tertiary referral hospital with 120 ICU beds. We only included patients who were 18 years or older at the time of admission and who stayed in the medical or surgical ICU. Patients were excluded if they lacked a Confusion Assessment Method for the ICU record from the day of ICU admission or if they had a positive Confusion Assessment Method for the ICU record at the time of ICU admission. The algorithm to predict delirium was developed using patient data from the first 2 years of the study period and validated using patient data from the last 6 months. Random forest (RF), Extreme Gradient Boosting (XGBoost), deep neural network (DNN), and logistic regression (LR) were used. The algorithms were externally validated using MIMIC-III data, and the algorithm with the largest area under the receiver operating characteristics (AUROC) curve in the external data set was named the PRIDE algorithm.ResultsA total of 37,543 cases were collected. After patient exclusion, 12,409 remained as our study population, of which 3816 (30.8%) patients experienced delirium incidents during the study period. Based on the exclusion criteria, out of the 96,016 ICU admission cases in the MIMIC-III data set, 2061 cases were included, and 272 (13.2%) delirium incidents occurred. The average AUROCs and 95% CIs for internal validation were 0.916 (95% CI 0.916-0.916) for RF, 0.919 (95% CI 0.919-0.919) for XGBoost, 0.881 (95% CI 0.878-0.884) for DNN, and 0.875 (95% CI 0.875-0.875) for LR. Regarding the external validation, the best AUROC were 0.721 (95% CI 0.72-0.721) for RF, 0.697 (95% CI 0.695-0.699) for XGBoost, 0.655 (95% CI 0.654-0.657) for DNN, and 0.631 (95% CI 0.631-0.631) for LR. The Brier score of the RF model is 0.168, indicating that it is well-calibrated.ConclusionsA machine learning approach based on electronic health record data can be used to predict delirium within 24 hours of ICU admission. RF, XGBoost, DNN, and LR models were used, and they effectively predicted delirium. However, with the potential to advise ICU physicians and prevent ICU delirium, prospective studies are required to verify the algorithm's performance.

Project description:BackgroundWe aimed to develop an early warning system for real-time sepsis prediction in the ICU by machine learning methods, with tools for interpretative analysis of the predictions. In particular, we focus on the deployment of the system in a target medical center with small historical samples.MethodsLight Gradient Boosting Machine (LightGBM) and multilayer perceptron (MLP) were trained on Medical Information Mart for Intensive Care (MIMIC-III) dataset and then finetuned on the private Historical Database of local Ruijin Hospital (HDRJH) using transfer learning technique. The Shapley Additive Explanations (SHAP) analysis was employed to characterize the feature importance in the prediction inference. Ultimately, the performance of the sepsis prediction system was further evaluated in the real-world study in the ICU of the target Ruijin Hospital.ResultsThe datasets comprised 6891 patients from MIMIC-III, 453 from HDRJH, and 67 from Ruijin real-world data. The area under the receiver operating characteristic curves (AUCs) for LightGBM and MLP models derived from MIMIC-III were 0.98 - 0.98 and 0.95 - 0.96 respectively on MIMIC-III dataset, and, in comparison, 0.82 - 0.86 and 0.84 - 0.87 respectively on HDRJH, from 1 to 5 h preceding. After transfer learning and ensemble learning, the AUCs of the final ensemble model were enhanced to 0.94 - 0.94 on HDRJH and to 0.86 - 0.9 in the real-world study in the ICU of the target Ruijin Hospital. In addition, the SHAP analysis illustrated the importance of age, antibiotics, net balance, and ventilation for sepsis prediction, making the model interpretable.ConclusionsOur machine learning model allows accurate real-time prediction of sepsis within 5-h preceding. Transfer learning can effectively improve the feasibility to deploy the prediction model in the target cohort, and ameliorate the model performance for external validation. SHAP analysis indicates that the role of antibiotic usage and fluid management needs further investigation. We argue that our system and methodology have the potential to improve ICU management by helping medical practitioners identify at-sepsis-risk patients and prepare for timely diagnosis and intervention.Trial registrationNCT05088850 (retrospectively registered).

Dataset Information

Delirium prediction in the intensive care unit: comparison of two delirium prediction models.

Publications

Delirium prediction in the intensive care unit: comparison of two delirium prediction models.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets