Dataset Information

Adaptation and Validation of a Chart-Based Delirium Detection Tool for the ICU (CHART-DEL-ICU).

ABSTRACT:

Objective

To adapt and validate a chart-based delirium detection tool for use in critically ill adults.

Design

Validation study.

Setting

Medical-surgical intensive care unit (ICU) in an academic hospital.

Measurements

A chart-based delirium detection tool (CHART-DEL) was adapted for use in critically ill adults (CHART-DEL-ICU) and compared with prospective delirium assessments (i.e., clinical assessments (reference standard) by a research nurse trained by a neuropsychiatrist and routine delirium screening tools Confusion Assessment Method (CAM-ICU)) and (Intensive Care Delirium Screening Checklist (ICDSC)). The original CHART-DEL tool was adapted to include physician-reported ICDSC score (for probable delirium) and Richmond-Agitation Sedation Scale score (for altered level of consciousness and agitation). Two trained chart abstractors blinded to all delirium assessments manually abstracted delirium-related information from medical charts and electronic medical records and rated if delirium was present (four levels: uncertain, possible, probable, definite) or absent (no evidence).

Results

Charts were manually abstracted for delirium-related information for 213 patients who were included in a prospective cohort study that included prospective delirium assessments. The CHART-DEL-ICU tool had excellent interrater reliability (kappa = 0.90). Compared to the reference standard, the sensitivity was 66.0% (95% CI = 59.3-72.3%) and specificity was 82.1% (95% CI = 78.0-85.7%), with a cut-point that included definite, probable, possible, and uncertain delirium. The AUC of the CHART-DEL-ICU alone is 74.1% (95% CI = 70.4-77.8%) compared with the addition of the CAM-ICU and ICDSC (CAM-ICU/CHART-DEL-ICU: 80.9% (95% CI = 77.8-83.9%), P = .01; ICDSC/CHART-DEL-ICU: 79.2% (95% CI = 75.9-82.6%), P = .03).

Conclusion

A chart-based delirium detection tool has improved diagnostic accuracy when combined with routine delirium screening tools (CAM-ICU and ICDSC), compared to a chart-based method on its own. This presents a potential for retrospective detection of delirium from medical charts for research or to augment routine delirium screening methods to find missed cases of delirium.

SUBMITTER: Krewulak KD

PROVIDER: S-EPMC8049975 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundDelirium is a brain condition associated with poor outcomes in rehabilitation. It is therefore important to assess delirium incidence in rehabilitation.PurposeTo develop and validate a chart-based method to identify incident delirium episodes within the electronic database of a Swiss rehabilitation clinic, and to identify a study population of validated incident delirium episodes for further research purposes.DesignRetrospective validation study.SettingsRoutinely collected inpatient clinical data from ZURZACH Care.ParticipantsAll patients undergoing rehabilitation at ZURZACH Care, Rehaklinik Bad Zurzach between 2015 and 2018 were included.MethodsWithin the study population, we identified all rehabilitation stays for which ≥2 delirium-predictive key words (common terms used to describe delirious patients) were recorded in the medical charts. We excluded all prevalent delirium episodes and defined the remaining episodes to be potentially incident. At least two physicians independently confirmed or refuted each potential incident delirium episode by reviewing the patient charts. We calculated the positive predictive value (PPV) with 95% confidence interval (95% CI) for all potential incident delirium episodes and for specific subgroups.ResultsWithin 10,515 rehabilitation stays we identified 554 potential incident delirium episodes. Overall, 125 potential incident delirium episodes were confirmed by expert review. The PPV of the chart-based method varied from 0.23 (95% CI 0.19-0.26) overall to 0.69 (95% CI 0.56-0.79) in specific subgroups.ConclusionsOur chart-based method was able to capture incident delirium episodes with low to moderate accuracy. By conducting an additional expert review of the medical charts, we identified a study population of validated incident delirium episodes. Our chart-based method contributes towards an automated detection of potential incident delirium episodes that, supplemented with expert review, efficiently yields a validated population of incident delirium episodes for research purposes.

Project description:ObjectivesBoth delirium duration and delirium severity are associated with adverse patient outcomes. Serum biomarkers associated with delirium duration and delirium severity in ICU patients have not been reliably identified. We conducted our study to identify peripheral biomarkers representing systemic inflammation, impaired neuroprotection, and astrocyte activation associated with delirium duration, delirium severity, and in-hospital mortality.DesignObservational study.SettingThree Indianapolis hospitals.PatientsThree-hundred twenty-one critically ill delirious patients.InterventionsNone.Measurements and main resultsWe analyzed the associations between biomarkers collected at delirium onset and delirium-/coma-free days assessed through Richmond Agitation-Sedation Scale/Confusion Assessment Method for the ICU, delirium severity assessed through Confusion Assessment Method for the ICU-7, and in-hospital mortality. After adjusting for age, gender, Acute Physiology and Chronic Health Evaluation II score, Charlson comorbidity score, sepsis diagnosis and study intervention group, interleukin-6, -8, and -10, tumor necrosis factor-α, C-reactive protein, and S-100β levels in quartile 4 were negatively associated with delirium-/coma-free days by 1 week and 30 days post enrollment. Insulin-like growth factor-1 levels in quartile 4 were not associated with delirium-/coma-free days at both time points. Interleukin-6, -8, and -10, tumor necrosis factor-α, C-reactive protein, and S-100β levels in quartile 4 were also associated with delirium severity by 1 week. At hospital discharge, interleukin-6, -8, and -10 retained the association but tumor necrosis factor-α, C-reactive protein, and S-100β lost their associations with delirium severity. Insulin-like growth factor-1 levels in quartile 4 were not associated with delirium severity at both time points. Interleukin-8 and S-100β levels in quartile 4 were also associated with higher in-hospital mortality. Interleukin-6 and -10, tumor necrosis factor-α, and insulin-like growth factor-1 were not found to be associated with in-hospital mortality.ConclusionsBiomarkers of systemic inflammation and those for astrocyte and glial activation were associated with longer delirium duration, higher delirium severity, and in-hospital mortality. Utility of these biomarkers early in delirium onset to identify patients at a higher risk of severe and prolonged delirium, and delirium related complications during hospitalization needs to be explored in future studies.

Project description:BackgroundPostoperative delirium is an important problem for surgical inpatients and was the target of a multidisciplinary quality improvement project at our institution. We developed and tested a semiautomated delirium risk stratification instrument, Age, WORLD backwards, Orientation, iLlness severity, Surgery-specific risk (AWOL-S), in 3 independent cohorts from our tertiary care hospital and describe its performance characteristics and impact on clinical care.MethodsThe risk stratification instrument was derived with elective surgical patients who were admitted at least overnight and received at least 1 postoperative delirium screen (Nursing Delirium Screening Scale [NuDESC] or Confusion Assessment Method for the Intensive Care Unit [CAM-ICU]) and preoperative cognitive screening tests (orientation to place and ability to spell WORLD backward). Using data pragmatically collected between December 7, 2016, and June 15, 2017, we derived a logistic regression model predicting probability of delirium in the first 7 postoperative hospital days. A priori predictors included age, cognitive screening, illness severity or American Society of Anesthesiologists physical status, and surgical delirium risk. We applied model odds ratios to 2 subsequent cohorts ("validation" and "sustained performance") and assessed performance using area under the receiver operator characteristic curves (AUC-ROC). A post hoc sensitivity analysis assessed performance in emergency and preadmitted patients. Finally, we retrospectively evaluated the use of benzodiazepines and anticholinergic medications in patients who screened at high risk for delirium.ResultsThe logistic regression model used to derive odds ratios for the risk prediction tool included 2091 patients. Model AUC-ROC was 0.71 (0.67-0.75), compared with 0.65 (0.58-0.72) in the validation (n = 908) and 0.75 (0.71-0.78) in the sustained performance (n = 3168) cohorts. Sensitivity was approximately 75% in the derivation and sustained performance cohorts; specificity was approximately 59%. The AUC-ROC for emergency and preadmitted patients was 0.71 (0.67-0.75; n = 1301). After AWOL-S was implemented clinically, patients at high risk for delirium (n = 3630) had 21% (3%-36%) lower relative risk of receiving an anticholinergic medication perioperatively after controlling for secular trends.ConclusionsThe AWOL-S delirium risk stratification tool has moderate accuracy for delirium prediction in a cohort of elective surgical patients, and performance is largely unchanged in emergent/preadmitted surgical patients. Using AWOL-S risk stratification as a part of a multidisciplinary delirium reduction intervention was associated with significantly lower rates of perioperative anticholinergic but not benzodiazepine, medications in those at high risk for delirium. AWOL-S offers a feasible starting point for electronic medical record-based postoperative delirium risk stratification and may serve as a useful paradigm for other institutions.

Project description:BackgroundRisk prediction models allow clinicians to forecast which individuals are at a higher risk for developing a particular outcome. We developed and internally validated a delirium prediction model for incident delirium parameterized to patient ICU admission acuity.MethodsThis retrospective, observational, fourteen medical-surgical ICU cohort study evaluated consecutive delirium-free adults surviving hospital stay with ICU length of stay (LOS) greater than or equal to 24 hours with both an admission APACHE II score and an admission type (e.g., elective post-surgery, emergency post-surgery, non-surgical) in whom delirium was assessed using the Intensive Care Delirium Screening Checklist (ICDSC). Risk factors included in the model were readily available in electric medical records. Least absolute shrinkage and selection operator logistic (LASSO) regression was used for model development. Discrimination was determined using area under the receiver operating characteristic curve (AUC). Internal validation was performed by cross-validation. Predictive performance was determined using measures of accuracy and clinical utility was assessed by decision-curve analysis.ResultsA total of 8,878 patients were included. Delirium incidence was 49.9% (n = 4,431). The delirium prediction model was parameterized to seven patient cohorts, admission type (3 cohorts) or mean quartile APACHE II score (4 cohorts). All parameterized cohort models were well calibrated. The AUC ranged from 0.67 to 0.78 (95% confidence intervals [CI] ranged from 0.63 to 0.79). Model accuracy varied across admission types; sensitivity ranged from 53.2% to 63.9% while specificity ranged from 69.0% to 74.6%. Across mean quartile APACHE II scores, sensitivity ranged from 58.2% to 59.7% while specificity ranged from 70.1% to 73.6%. The clinical utility of the parameterized cohort prediction model to predict and prevent incident delirium was greater than preventing incident delirium by treating all or none of the patients.ConclusionsOur results support external validation of a prediction model parameterized to patient ICU admission acuity to predict a patients' risk for ICU delirium. Classification of patients' risk for ICU delirium by admission acuity may allow for efficient initiation of prevention measures based on individual risk profiles.