Dataset Information

Predicting 30-day mortality using point-of-care testing; an external validation and derivation study.

ABSTRACT: BACKGROUND:Early risk stratification for guiding treatment priority in the emergency department (ED) is becoming increasingly important. Existing prediction models typically use demographics, vital signs and laboratory parameters. Laboratory-based models require blood testing, which may cause substantial delay. However, these delays can be prevented by the use of point-of-care testing (POCT), where results are readily available. We aimed to externally validate a laboratory-based model for mortality and subsequently assessed whether a POCT model yields comparable performance. METHODS:All adult patients visiting the ED of a university hospital between January 1st, 2012 and December 31st, 2016 were retrospectively reviewed for inclusion. Primary outcome was defined as 30-day mortality after ED presentation. We externally validated one existing prediction model including age, glucose, urea, sodium, haemoglobin, platelet count and white blood cell count. We assessed the predictive performance by discrimination, expressed as Area under the Curve (AUC). We compared the existing model to an equivalent model using predictors that are available with POCT (i.e. glucose, urea, sodium and haemoglobin). Additionally, we internally validated these models with bootstrapping. RESULTS:We included 34,437 patients of whom 1,942 (5.6%) died within 30 days. The AUC of the laboratory-based model was 0.794. We refitted this model to our ED population and found an AUC of 0.812, which decreased only slightly to 0.790 with only POCT parameters. CONCLUSIONS:Our POCT-model performs similar to existing laboratory-based models in identifying patients at high risk for mortality, with results available within minutes. Although the model needs further validation and evaluation, it shows the potential of POCT for early risk stratification in the ED.

SUBMITTER: Brink A

PROVIDER: S-EPMC7514068 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Predicting 30-day mortality using point-of-care testing; an external validation and derivation study.

Brink Anniek A Schuttevaer Romy R Alsma Jelmer J Zietse Robert R Schuit Stephanie Catherine Elisabeth SCE Lingsma Hester Floor HF

PloS one 20200924 9

<h4>Background</h4>Early risk stratification for guiding treatment priority in the emergency department (ED) is becoming increasingly important. Existing prediction models typically use demographics, vital signs and laboratory parameters. Laboratory-based models require blood testing, which may cause substantial delay. However, these delays can be prevented by the use of point-of-care testing (POCT), where results are readily available. We aimed to externally validate a laboratory-based model fo ...[more]

PMID: 32970708

Similar Datasets

Project description:BackgroundClinical scores to determine early (6-month) antiretroviral therapy (ART) mortality risk have not been developed for sub-Saharan Africa (SSA), home to 70% of people living with HIV. In the absence of validated scores, WHO eligibility criteria (EC) for ART care intensification are CD4 < 200/μL or WHO stage III/IV.MethodsWe used Botswana XPRES trial data for adult ART enrollees to develop CD4-independent and CD4-dependent multivariable prognostic models for 6-month mortality. Scores were derived by rescaling coefficients. Scores were developed using the first 50% of XPRES ART enrollees, and their accuracy validated internally and externally using South African TB Fast Track (TBFT) trial data. Predictive accuracy was compared between scores and WHO EC.ResultsAmong 5553 XPRES enrollees, 2838 were included in the derivation dataset; 68% were female and 83 (3%) died by 6 months. Among 1077 TBFT ART enrollees, 55% were female and 6% died by 6 months. Factors predictive of 6-month mortality in the derivation dataset at p < 0.01 and selected for the CD4-independent score included male gender (2 points), ≥ 1 WHO tuberculosis symptom (2 points), WHO stage III/IV (2 points), severe anemia (hemoglobin < 8 g/dL) (3 points), and temperature > 37.5 °C (2 points). The same variables plus CD4 < 200/μL (1 point) were included in the CD4-dependent score. Among XPRES enrollees, a CD4-independent score of ≥ 4 would provide 86% sensitivity and 66% specificity, whereas WHO EC would provide 83% sensitivity and 58% specificity. If WHO stage alone was used, sensitivity was 48% and specificity 89%. Among TBFT enrollees, the CD4-independent score of ≥ 4 would provide 95% sensitivity and 27% specificity, whereas WHO EC would provide 100% sensitivity but 0% specificity. Accuracy was similar between CD4-independent and CD4-dependent scores. Categorizing CD4-independent scores into low (< 4), moderate (4-6), and high risk (≥ 7) gave 6-month mortality of 1%, 4%, and 17% for XPRES and 1%, 5%, and 30% for TBFT enrollees.ConclusionsSensitivity of the CD4-independent score was nearly twice that of WHO stage in predicting 6-month mortality and could be used in settings lacking CD4 testing to inform ART care intensification. The CD4-dependent score improved specificity versus WHO EC. Both scores should be considered for scale-up in SSA.

Project description:IntroductionPeople 65 years and older represent the fastest growing segment of the surgical population. Older age is associated with doubling of risk when undergoing emergency general surgery (EGS) procedures and often coexists with medical complexity and considerations of end-of-life care, creating prognostic and decisional uncertainty. Combined with the time-sensitive nature of EGS, it is challenging to gauge perioperative risk and ensure that clinical decisions are aligned with the patient values. Current preoperative risk prediction models for older EGS patients have major limitations regarding derivation and validation, and do not address the specific risk profile of older patients. Accurate and externally validated models specific to older patients are needed to inform care and decision making.Methods and analysisWe will derive, internally and externally validate a multivariable model to predict 30-day mortality in EGS patients >65 years old. Our derivation sample will be individuals enrolled in the National Surgical Quality Improvement Program (NSQIP) database between 2012 and 2016 having 1 of 7 core EGS procedures. Postulated predictor variables have been identified based on previous research, clinical and epidemiological knowledge. Our model will be derived using logistic regression penalised with elastic net regularisation and ensembled using bootstrap aggregation. The resulting model will be internally validated using k-fold cross-validation and bootstrap validation techniques and externally validated using population-based health administrative data. Discrimination and calibration will be reported at each step.Ethics and disseminationEthics for NSQIP data use was obtained from the Ottawa Hospital Research Ethics Board; external validation will use routinely collected anonymised data legally exempt from research ethics review. The final risk score will be published in a peer-reviewed journal. We plan to further disseminate the model as an online calculator or application for clinical use. Future research will be required to test the clinical application of the final model.

Project description:BackgroundThis study aimed to explore the impact of hypoxic hepatitis (HH) on survival in heart failure (HF) patients and to develop an effective machine learning model to predict 30-day mortality risk in HF patients with HH.MethodsIn the Medical Information Mart for Intensive Care (MIMIC)-III and IV databases, clinical data and survival situations of HF patients admitted to the intensive care unit (ICU) were retrospectively collected. Propensity Score Matching (PSM) analysis was used to balance baseline differences between HF patients with and without HH. Kaplan Meier analysis and multivariate Cox analysis were used to determining the effect of HH on the survival of CF patients. For developing a model that can predict 30-day mortality in CF patients with HH, the feature recurrence elimination (RFE) method was applied to feature selection, and seven machine learning algorithms were employed to model construction. After training and hyper-parameter optimization (HPO) of the model through cross-validation in the training set, a performance comparison was performed through internal and external validation. To interpret the optimal model, Shapley Additive Explanations (SHAP) were used along with the Local Interpretable Model-agnostic Explanations (LIME) and the Partial Dependence Plot (PDP) techniques.ResultsThe incidence of HH was 6.5% in HF patients in the MIMIC cohort. HF patients with HH had a 30-day mortality rate of 33% and a 1-year mortality rate of 51%, and HH was an independent risk factor for increased short-term and long-term mortality risk in HF patients. After RFE, 21 key features (21/56) were selected to build the model. Internal validation and external validation suggested that Categorical Boosting (Catboost) had a higher discriminatory capability than the other models (internal validation: AUC, 0.832; 95% CI, 0.819-0.845; external validation: AUC, 0.757 95% CI, 0.739-0.776), and the simplified Catboost model (S-Catboost) also had good performance in both internal validation and external validation (internal validation: AUC, 0.801; 95% CI, 0.787-0.813; external validation: AUC, 0.729, 95% CI, 0.711-0.745).ConclusionHH was associated with increased mortality in HF patients. Machine learning methods had good performance in identifying the 30-day mortality risk of HF with HH. With interpretability techniques, the transparency of machine learning models has been enhanced to facilitate user understanding of the prediction results.

Dataset Information

Predicting 30-day mortality using point-of-care testing; an external validation and derivation study.

Publications

Predicting 30-day mortality using point-of-care testing; an external validation and derivation study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets