Dataset Information

On instabilities of deep learning in image reconstruction and the potential costs of AI.

ABSTRACT: Deep learning, due to its unprecedented success in tasks such as image classification, has emerged as a new tool in image reconstruction with potential to change the field. In this paper, we demonstrate a crucial phenomenon: Deep learning typically yields unstable methods for image reconstruction. The instabilities usually occur in several forms: 1) Certain tiny, almost undetectable perturbations, both in the image and sampling domain, may result in severe artefacts in the reconstruction; 2) a small structural change, for example, a tumor, may not be captured in the reconstructed image; and 3) (a counterintuitive type of instability) more samples may yield poorer performance. Our stability test with algorithms and easy-to-use software detects the instability phenomena. The test is aimed at researchers, to test their networks for instabilities, and for government agencies, such as the Food and Drug Administration (FDA), to secure safe use of deep learning methods.

SUBMITTER: Antun V

PROVIDER: S-EPMC7720232 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

On instabilities of deep learning in image reconstruction and the potential costs of AI.

Antun Vegard V Renna Francesco F Poon Clarice C Adcock Ben B Hansen Anders C AC

Proceedings of the National Academy of Sciences of the United States of America 20200511 48

Deep learning, due to its unprecedented success in tasks such as image classification, has emerged as a new tool in image reconstruction with potential to change the field. In this paper, we demonstrate a crucial phenomenon: Deep learning typically yields unstable methods for image reconstruction. The instabilities usually occur in several forms: 1) Certain tiny, almost undetectable perturbations, both in the image and sampling domain, may result in severe artefacts in the reconstruction; 2) a s ...[more]

PMID: 32393633

Similar Datasets

Project description:ObjectivesTo perform a comprehensive within-subject image quality analysis of abdominal CT examinations reconstructed with DLIR and to evaluate diagnostic accuracy compared to the routinely applied adaptive statistical iterative reconstruction (ASiR-V) algorithm.Materials and methodsOncologic patients were prospectively enrolled and underwent contrast-enhanced CT. Images were reconstructed with DLIR with three intensity levels of reconstruction (high, medium, and low) and ASiR-V at strength levels from 10 to 100% with a 10% interval. Three radiologists characterized the lesions and two readers assessed diagnostic accuracy and calculated signal-to-noise ratio (SNR), contrast-to-noise ratio (CNR), figure of merit (FOM), and subjective image quality, the latter with a 5-point Likert scale.ResultsFifty patients (mean age: 70 ± 10 years, 23 men) were enrolled and 130 liver lesions (105 benign lesions, 25 metastases) were identified. DLIR_H achieved the highest SNR and CNR, comparable to ASiR-V 100% (p ≥ .051). DLIR_M returned the highest subjective image quality (score: 5; IQR: 4-5; p ≤ .001) and significant median increase (29%) in FOM (p < .001). Differences in detection were identified only for lesions ≤ 0.5 cm: 32/33 lesions were detected with DLIR_M and 26 lesions were detected with ASiR-V 50% (p = .031). Lesion accuracy of was 93.8% (95% CI: 88.1, 97.3; 122 of 130 lesions) for DLIR and 87.7% (95% CI: 80.8, 92.8; 114 of 130 lesions) for ASiR-V 50%.ConclusionsDLIR yields superior image quality and provides higher diagnostic accuracy compared to ASiR-V in the assessment of hypovascular liver lesions, in particular for lesions ≤ 0.5 cm.Clinical relevance statementDeep learning image reconstruction algorithm demonstrates higher diagnostic accuracy compared to iterative reconstruction in the identification of hypovascular liver lesions, especially for lesions ≤ 0.5 cm.Key points• Iterative reconstruction algorithm impacts image texture, with negative effects on diagnostic capabilities. • Medium-strength deep learning image reconstruction algorithm outperforms iterative reconstruction in the diagnostic accuracy of ≤ 0.5 cm hypovascular liver lesions (93.9% vs 78.8%), also granting higher objective and subjective image quality. • Deep learning image reconstruction algorithm can be safely implemented in routine abdominal CT protocols in place of iterative reconstruction.

Dataset Information

On instabilities of deep learning in image reconstruction and the potential costs of AI.

Publications

On instabilities of deep learning in image reconstruction and the potential costs of AI.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets