Dataset Information

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy.

ABSTRACT:

Purpose

Early clinical recognition of sepsis can be challenging. With the advancement of machine learning, promising real-time models to predict sepsis have emerged. We assessed their performance by carrying out a systematic review and meta-analysis.

Methods

A systematic search was performed in PubMed, Embase.com and Scopus. Studies targeting sepsis, severe sepsis or septic shock in any hospital setting were eligible for inclusion. The index test was any supervised machine learning model for real-time prediction of these conditions. Quality of evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology, with a tailored Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklist to evaluate risk of bias. Models with a reported area under the curve of the receiver operating characteristic (AUROC) metric were meta-analyzed to identify strongest contributors to model performance.

Results

After screening, a total of 28 papers were eligible for synthesis, from which 130 models were extracted. The majority of papers were developed in the intensive care unit (ICU, n?=?15; 54%), followed by hospital wards (n?=?7; 25%), the emergency department (ED, n?=?4; 14%) and all of these settings (n?=?2; 7%). For the prediction of sepsis, diagnostic test accuracy assessed by the AUROC ranged from 0.68-0.99 in the ICU, to 0.96-0.98 in-hospital and 0.87 to 0.97 in the ED. Varying sepsis definitions limit pooling of the performance across studies. Only three papers clinically implemented models with mixed results. In the multivariate analysis, temperature, lab values, and model type contributed most to model performance.

Conclusion

This systematic review and meta-analysis show that on retrospective data, individual machine learning models can accurately predict sepsis onset ahead of time. Although they present alternatives to traditional scoring systems, between-study heterogeneity limits the assessment of pooled results. Systematic reporting and clinical implementation studies are needed to bridge the gap between bytes and bedside.

SUBMITTER: Fleuren LM

PROVIDER: S-EPMC7067741 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy.

Fleuren Lucas M LM Klausch Thomas L T TLT Zwager Charlotte L CL Schoonmade Linda J LJ Guo Tingjie T Roggeveen Luca F LF Swart Eleonora L EL Girbes Armand R J ARJ Thoral Patrick P Ercole Ari A Hoogendoorn Mark M Elbers Paul W G PWG

Intensive care medicine 20200121 3

<h4>Purpose</h4>Early clinical recognition of sepsis can be challenging. With the advancement of machine learning, promising real-time models to predict sepsis have emerged. We assessed their performance by carrying out a systematic review and meta-analysis.<h4>Methods</h4>A systematic search was performed in PubMed, Embase.com and Scopus. Studies targeting sepsis, severe sepsis or septic shock in any hospital setting were eligible for inclusion. The index test was any supervised machine learnin ...[more]

PMID: 31965266

Similar Datasets

Project description:BackgroundSystematic review is an indispensable tool for optimal evidence collection and evaluation in evidence-based medicine. However, the explosive increase of the original literatures makes it difficult to accomplish critical appraisal and regular update. Artificial intelligence (AI) algorithms have been applied to automate the literature screening procedure in medical systematic reviews. In these studies, different algorithms were used and results with great variance were reported. It is therefore imperative to systematically review and analyse the developed automatic methods for literature screening and their effectiveness reported in current studies.MethodsAn electronic search will be conducted using PubMed, Embase, ACM Digital Library, and IEEE Xplore Digital Library databases, as well as literatures found through supplementary search in Google scholar, on automatic methods for literature screening in systematic reviews. Two reviewers will independently conduct the primary screening of the articles and data extraction, in which nonconformities will be solved by discussion with a methodologist. Data will be extracted from eligible studies, including the basic characteristics of study, the information of training set and validation set, and the function and performance of AI algorithms, and summarised in a table. The risk of bias and applicability of the eligible studies will be assessed by the two reviewers independently based on Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). Quantitative analyses, if appropriate, will also be performed.DiscussionAutomating systematic review process is of great help in reducing workload in evidence-based practice. Results from this systematic review will provide essential summary of the current development of AI algorithms for automatic literature screening in medical evidence synthesis and help to inspire further studies in this field.Systematic review registrationPROSPERO CRD42020170815 (28 April 2020).

Project description:Background: Sepsis is among the leading causes of death in intensive care units (ICUs) worldwide and its recognition, particularly in the early stages of the disease, remains a medical challenge. The advent of an affluence of available digital health data has created a setting in which machine learning can be used for digital biomarker discovery, with the ultimate goal to advance the early recognition of sepsis. Objective: To systematically review and evaluate studies employing machine learning for the prediction of sepsis in the ICU. Data Sources: Using Embase, Google Scholar, PubMed/Medline, Scopus, and Web of Science, we systematically searched the existing literature for machine learning-driven sepsis onset prediction for patients in the ICU. Study Eligibility Criteria: All peer-reviewed articles using machine learning for the prediction of sepsis onset in adult ICU patients were included. Studies focusing on patient populations outside the ICU were excluded. Study Appraisal and Synthesis Methods: A systematic review was performed according to the PRISMA guidelines. Moreover, a quality assessment of all eligible studies was performed. Results: Out of 974 identified articles, 22 and 21 met the criteria to be included in the systematic review and quality assessment, respectively. A multitude of machine learning algorithms were applied to refine the early prediction of sepsis. The quality of the studies ranged from "poor" (satisfying ≤ 40% of the quality criteria) to "very good" (satisfying ≥ 90% of the quality criteria). The majority of the studies (n = 19, 86.4%) employed an offline training scenario combined with a horizon evaluation, while two studies implemented an online scenario (n = 2, 9.1%). The massive inter-study heterogeneity in terms of model development, sepsis definition, prediction time windows, and outcomes precluded a meta-analysis. Last, only two studies provided publicly accessible source code and data sources fostering reproducibility. Limitations: Articles were only eligible for inclusion when employing machine learning algorithms for the prediction of sepsis onset in the ICU. This restriction led to the exclusion of studies focusing on the prediction of septic shock, sepsis-related mortality, and patient populations outside the ICU. Conclusions and Key Findings: A growing number of studies employs machine learning to optimize the early prediction of sepsis through digital biomarker discovery. This review, however, highlights several shortcomings of the current approaches, including low comparability and reproducibility. Finally, we gather recommendations how these challenges can be addressed before deploying these models in prospective analyses. Systematic Review Registration Number: CRD42020200133.

Project description:BackgroundInvasive detection methods such as liver biopsy are currently the gold standard for diagnosing liver cirrhosis and can be used to determine the degree of liver fibrosis and cirrhosis. In contrast, non-invasive diagnostic methods, such as ultrasonography, elastography, and clinical prediction scores, can prevent patients from invasiveness-related discomfort and risks and are often chosen as alternative or supplementary diagnostic methods for liver fibrosis or cirrhosis. However, these non-invasive methods cannot specify the pathological grading and early diagnosis of the lesions. Recent studies have revealed that gut microbiome-based machine learning can be utilized as a non-invasive diagnostic technique for liver cirrhosis or fibrosis, but there is no evidence-based support. Therefore, this study conducted a systematic review and meta-analysis for the first time to investigate the accuracy of machine learning based on the gut microbiota in the prediction of liver fibrosis and cirrhosis.MethodsA comprehensive and systematic search of publications published before April 2th, 2023 in PubMed, Cochrane Library, Embase, and Web of Science was conducted for relevant studies on the application of gut microbiome-based metagenomic sequencing modeling technology to the diagnostic prediction of liver cirrhosis or fibrosis. A bivariate mixed-effects model and Stata software 15.0 were adopted for the meta-analysis.ResultsTen studies were included in the present study, involving 11 prediction trials and 838 participants, 403 of whom were fibrotic and cirrhotic patients. Meta-analysis showed the pooled sensitivity (SEN) = 0.81 [0.75, 0.85], specificity (SEP) = 0.85 [0.77, 0.91], positive likelihood ratio (PLR) = 5.5 [3.6, 8.7], negative likelihood ratio (NLR) = 0.23 [0.18, 0.29], diagnostic odds ratio (DOR) = 24 [14, 41], and area under curve (AUC) = 0.86 [0.83-0.89]. The results demonstrated that machine learning methods had excellent potential to analyze gut microbiome data and could effectively predict liver cirrhosis or fibrosis. Machine learning provides a powerful tool for non-invasive prediction and diagnosis of liver cirrhosis or liver fibrosis, with broad clinical application prospects. However, these results need to be interpreted with caution due to limited clinical data.ConclusionGut microbiome-based machine learning can be utilized as a practical, non-invasive technique for the diagnostic prediction of liver cirrhosis or fibrosis. However, most of the included studies applied the random forest algorithm in modeling, so a diversified prediction system based on microorganisms is needed to improve the non-invasive detection of liver cirrhosis or fibrosis.

Dataset Information

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy.

Purpose

Methods

Results

Conclusion

Publications

Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets