Dataset Information

Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics.

ABSTRACT:

Purpose

The aim of this systematic review was to analyse literature on artificial intelligence (AI) and radiomics, including all medical imaging modalities, for oncological and non-oncological applications, in order to assess how far the image mining research stands from routine medical application. To do this, we applied a trial phases classification inspired from the drug development process.

Methods

Among the articles we considered for inclusion from PubMed were multimodality AI and radiomics investigations, with a validation analysis aimed at relevant clinical objectives. Quality assessment of selected papers was performed according to the QUADAS-2 criteria. We developed the phases classification criteria for image mining studies.

Results

Overall 34,626 articles were retrieved, 300 were selected applying the inclusion/exclusion criteria, and 171 high-quality papers (QUADAS-2???7) were identified and analysed. In 27/171 (16%), 141/171 (82%), and 3/171 (2%) studies the development of an AI-based algorithm, radiomics model, and a combined radiomics/AI approach, respectively, was described. A total of 26/27(96%) and 1/27 (4%) AI studies were classified as phase II and III, respectively. Consequently, 13/141 (9%), 10/141 (7%), 111/141 (79%), and 7/141 (5%) radiomics studies were classified as phase 0, I, II, and III, respectively. All three radiomics/AI studies were categorised as phase II trials.

Conclusions

The results of the studies are promising but still not mature enough for image mining tools to be implemented in the clinical setting and be widely used. The transfer learning from the well-known drug development process, with some specific adaptations to the image mining discipline could represent the most effective way for radiomics and AI algorithms to become the standard of care tools.

SUBMITTER: Sollini M

PROVIDER: S-EPMC6879445 | biostudies-literature | 2019 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics.

Sollini Martina M Antunovic Lidija L Chiti Arturo A Kirienko Margarita M

European journal of nuclear medicine and molecular imaging 20190618 13

<h4>Purpose</h4>The aim of this systematic review was to analyse literature on artificial intelligence (AI) and radiomics, including all medical imaging modalities, for oncological and non-oncological applications, in order to assess how far the image mining research stands from routine medical application. To do this, we applied a trial phases classification inspired from the drug development process.<h4>Methods</h4>Among the articles we considered for inclusion from PubMed were multimodality A ...[more]

PMID: 31214791

Similar Datasets

Project description:BackgroundThe gold standard for the diagnosis of liver fibrosis and nonalcoholic fatty liver disease (NAFLD) is liver biopsy. Various noninvasive modalities, e.g., ultrasonography, elastography and clinical predictive scores, have been used as alternatives to liver biopsy, with limited performance. Recently, artificial intelligence (AI) models have been developed and integrated into noninvasive diagnostic tools to improve their performance.MethodsWe systematically searched for studies on AI-assisted diagnosis of liver fibrosis and NAFLD on MEDLINE, Scopus, Web of Science and Google Scholar. The pooled sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV) and diagnostic odds ratio (DOR) with their 95% confidence intervals (95% CIs) were calculated using a random effects model. A summary receiver operating characteristic curve and the area under the curve was generated to determine the diagnostic accuracy of the AI-assisted system. Subgroup analyses by diagnostic modalities, population and AI classifiers were performed.ResultsWe included 19 studies reporting the performances of AI-assisted ultrasonography, elastrography, computed tomography, magnetic resonance imaging and clinical parameters for the diagnosis of liver fibrosis and steatosis. For the diagnosis of liver fibrosis, the pooled sensitivity, specificity, PPV, NPV and DOR were 0.78 (0.71-0.85), 0.89 (0.81-0.94), 0.72 (0.58-0.83), 0.92 (0.88-0.94) and 31.58 (11.84-84.25), respectively, for cirrhosis; 0.86 (0.80-0.90), 0.87 (0.80-0.92), 0.85 (0.75-0.91), 0.88 (0.82-0.92) and 37.79 (16.01-89.19), respectively; for advanced fibrosis; and 0.86 (0.78-0.92), 0.81 (0.77-0.84), 0.88 (0.80-0.93), 0.77 (0.58-0.89) and 26.79 (14.47-49.62), respectively, for significant fibrosis. Subgroup analyses showed significant differences in performance for the diagnosis of fibrosis among different modalities. The pooled sensitivity, specificity, PPV, NPV and DOR were 0.97 (0.76-1.00), 0.91 (0.78-0.97), 0.95 (0.87-0.98), 0.93 (0.80-0.98) and 191.52 (38.82-944.81), respectively, for the diagnosis of liver steatosis.ConclusionsAI-assisted systems have promising potential for the diagnosis of liver fibrosis and NAFLD. Validations of their performances are warranted before implementing these AI-assisted systems in clinical practice.Trial registrationThe protocol was registered with PROSPERO (CRD42020183295).

Project description:BackgroundArtificial intelligence (AI) applications are growing at an unprecedented pace in health care, including disease diagnosis, triage or screening, risk analysis, surgical operations, and so forth. Despite a great deal of research in the development and validation of health care AI, only few applications have been actually implemented at the frontlines of clinical practice.ObjectiveThe objective of this study was to systematically review AI applications that have been implemented in real-life clinical practice.MethodsWe conducted a literature search in PubMed, Embase, Cochrane Central, and CINAHL to identify relevant articles published between January 2010 and May 2020. We also hand searched premier computer science journals and conferences as well as registered clinical trials. Studies were included if they reported AI applications that had been implemented in real-world clinical settings.ResultsWe identified 51 relevant studies that reported the implementation and evaluation of AI applications in clinical practice, of which 13 adopted a randomized controlled trial design and eight adopted an experimental design. The AI applications targeted various clinical tasks, such as screening or triage (n=16), disease diagnosis (n=16), risk analysis (n=14), and treatment (n=7). The most commonly addressed diseases and conditions were sepsis (n=6), breast cancer (n=5), diabetic retinopathy (n=4), and polyp and adenoma (n=4). Regarding the evaluation outcomes, we found that 26 studies examined the performance of AI applications in clinical settings, 33 studies examined the effect of AI applications on clinician outcomes, 14 studies examined the effect on patient outcomes, and one study examined the economic impact associated with AI implementation.ConclusionsThis review indicates that research on the clinical implementation of AI applications is still at an early stage despite the great potential. More research needs to assess the benefits and challenges associated with clinical AI applications through a more rigorous methodology.

Project description:ObjectiveTo examine the accuracy of artificial intelligence (AI) for the detection of breast cancer in mammography screening practice.DesignSystematic review of test accuracy studies.Data sourcesMedline, Embase, Web of Science, and Cochrane Database of Systematic Reviews from 1 January 2010 to 17 May 2021.Eligibility criteriaStudies reporting test accuracy of AI algorithms, alone or in combination with radiologists, to detect cancer in women's digital mammograms in screening practice, or in test sets. Reference standard was biopsy with histology or follow-up (for screen negative women). Outcomes included test accuracy and cancer type detected.Study selection and synthesisTwo reviewers independently assessed articles for inclusion and assessed the methodological quality of included studies using the QUality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. A single reviewer extracted data, which were checked by a second reviewer. Narrative data synthesis was performed.ResultsTwelve studies totalling 131 822 screened women were included. No prospective studies measuring test accuracy of AI in screening practice were found. Studies were of poor methodological quality. Three retrospective studies compared AI systems with the clinical decisions of the original radiologist, including 79 910 women, of whom 1878 had screen detected cancer or interval cancer within 12 months of screening. Thirty four (94%) of 36 AI systems evaluated in these studies were less accurate than a single radiologist, and all were less accurate than consensus of two or more radiologists. Five smaller studies (1086 women, 520 cancers) at high risk of bias and low generalisability to the clinical context reported that all five evaluated AI systems (as standalone to replace radiologist or as a reader aid) were more accurate than a single radiologist reading a test set in the laboratory. In three studies, AI used for triage screened out 53%, 45%, and 50% of women at low risk but also 10%, 4%, and 0% of cancers detected by radiologists.ConclusionsCurrent evidence for AI does not yet allow judgement of its accuracy in breast cancer screening programmes, and it is unclear where on the clinical pathway AI might be of most benefit. AI systems are not sufficiently specific to replace radiologist double reading in screening programmes. Promising results in smaller studies are not replicated in larger studies. Prospective studies are required to measure the effect of AI in clinical practice. Such studies will require clear stopping rules to ensure that AI does not reduce programme specificity.Study registrationProtocol registered as PROSPERO CRD42020213590.

Dataset Information

Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics.

Purpose

Methods

Results

Conclusions

Publications

Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets