Dataset Information

Technical Note: Deriving ventilation imaging from 4DCT by deep convolutional neural network.

ABSTRACT: PURPOSE:Ventilation images can be derived from four-dimensional computed tomography (4DCT) by analyzing the change in HU values and deformable vector fields between different respiration phases of computed tomography (CT). As deformable image registration (DIR) is involved, accuracy of 4DCT-derived ventilation image is sensitive to the choice of DIR algorithms. To overcome the uncertainty associated with DIR, we develop a method based on deep convolutional neural network (CNN) to derive ventilation images directly from the 4DCT without explicit image registration. METHODS:A total of 82 sets of 4DCT and ventilation images from patients with lung cancer were used in this study. In the proposed CNN architecture, the CT two-channel input data consist of CT at the end of exhale and the end of inhale phases. The first convolutional layer has 32 different kernels of size 5 × 5 × 5, followed by another eight convolutional layers each of which is equipped with an activation layer (ReLU). The loss function is the mean-squared-error (MSE) to measure the intensity difference between the predicted and reference ventilation images. RESULTS:The predicted images were comparable to the label images of the test data. The similarity index, correlation coefficient, and Gamma index passing rate averaged over the tenfold cross validation were 0.880 ± 0.035, 0.874 ± 0.024, and 0.806 ± 0.014, respectively. CONCLUSIONS:The results demonstrate that deep CNN can generate ventilation imaging from 4DCT without explicit deformable image registration, reducing the associated uncertainty.

SUBMITTER: Zhong Y

PROVIDER: S-EPMC7098066 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Technical Note: Deriving ventilation imaging from 4DCT by deep convolutional neural network.

Zhong Yuncheng Y Vinogradskiy Yevgeniy Y Chen Liyuan L Myziuk Nick N Castillo Richard R Castillo Edward E Guerrero Thomas T Jiang Steve S Wang Jing J

Medical physics 20190312 5

<h4>Purpose</h4>Ventilation images can be derived from four-dimensional computed tomography (4DCT) by analyzing the change in HU values and deformable vector fields between different respiration phases of computed tomography (CT). As deformable image registration (DIR) is involved, accuracy of 4DCT-derived ventilation image is sensitive to the choice of DIR algorithms. To overcome the uncertainty associated with DIR, we develop a method based on deep convolutional neural network (CNN) to derive ...[more]

PMID: 30714159

Similar Datasets

Project description:PurposeThe computed tomography (CT)-derived ventilation imaging methodology employs deformable image registration (DIR) to recover respiratory motion-induced volume changes from an inhale/exhale CT image pair, as a surrogate for ventilation. The Integrated Jacobian Formulation (IJF) and Mass Conserving Volume Change (MCVC) numerical methods for volume change estimation represent two classes of ventilation methods, namely transformation based and intensity (Hounsfield Unit) based, respectively. Both the IJF and MCVC methods utilize subregional volume change measurements that satisfy a specified uncertainty tolerance. In previous publications, the ventilation images resulting from this numerical strategy demonstrated robustness to DIR variations. However, the reduced measurement uncertainty comes at the expense of measurement resolution. The purpose of this study was to examine the spatial correlation between robust CT-ventilation images and single photon emission CT-ventilation (SPECT-V).MethodsPreviously described implementations of IJF and MCVC require the solution of a large scale, constrained linear least squares problem defined by a series of robust subregional volume change measurements. We introduce a simpler parameterized implementation that reduces the number of unknowns while increasing the number of data points in the resulting least squares problem. A parameter sweep of the measurement uncertainty tolerance, τ , was conducted using the 4DCT and SPECT-V images acquired for 15 non-small cell lung cancer patients prior to radiotherapy. For each test case, MCVC and IJF CT-ventilation images were created for 30 different uncertainty parameter values, uniformly sampled from the range 0.01,0.25 . Voxel-wise Spearman correlation between the SPECT-V and the resulting CT-ventilation images was computed.ResultsThe median correlations between MCVC and SPECT-V ranged from 0.20 to 0.48 across the parameter sweep, while the median correlations for IJF and SPECT-V ranged between 0.79 and 0.82. For the optimal IJF tolerance τ=0.07 , the IJF and SPECT-V correlations across all 15 test cases ranged between 0.12 and 0.90. For the optimal MCVC tolerance τ=0.03 , the MCVC and SPECT-V correlations across all 15 test cases ranged between -0.06 and 0.84.ConclusionThe reported correlations indicate that robust methods generate ventilation images that are spatially consistent with SPECT-V, with the transformation-based IJF method yielding higher correlations than those previously reported in the literature. For both methods, overall correlations were found to marginally vary for τ∈[0.03,0.15] , indicating that the clinical utility of both methods is robust to both uncertainty tolerance and DIR solution.

Project description:OBJECTIVES:To develop a proof-of-concept "interpretable" deep learning prototype that justifies aspects of its predictions from a pre-trained hepatic lesion classifier. METHODS:A convolutional neural network (CNN) was engineered and trained to classify six hepatic tumor entities using 494 lesions on multi-phasic MRI, described in Part 1. A subset of each lesion class was labeled with up to four key imaging features per lesion. A post hoc algorithm inferred the presence of these features in a test set of 60 lesions by analyzing activation patterns of the pre-trained CNN model. Feature maps were generated that highlight regions in the original image that correspond to particular features. Additionally, relevance scores were assigned to each identified feature, denoting the relative contribution of a feature to the predicted lesion classification. RESULTS:The interpretable deep learning system achieved 76.5% positive predictive value and 82.9% sensitivity in identifying the correct radiological features present in each test lesion. The model misclassified 12% of lesions. Incorrect features were found more often in misclassified lesions than correctly identified lesions (60.4% vs. 85.6%). Feature maps were consistent with original image voxels contributing to each imaging feature. Feature relevance scores tended to reflect the most prominent imaging criteria for each class. CONCLUSIONS:This interpretable deep learning system demonstrates proof of principle for illuminating portions of a pre-trained deep neural network's decision-making, by analyzing inner layers and automatically describing features contributing to predictions. KEY POINTS:• An interpretable deep learning system prototype can explain aspects of its decision-making by identifying relevant imaging features and showing where these features are found on an image, facilitating clinical translation. • By providing feedback on the importance of various radiological features in performing differential diagnosis, interpretable deep learning systems have the potential to interface with standardized reporting systems such as LI-RADS, validating ancillary features and improving clinical practicality. • An interpretable deep learning system could potentially add quantitative data to radiologic reports and serve radiologists with evidence-based decision support.

Dataset Information

Technical Note: Deriving ventilation imaging from 4DCT by deep convolutional neural network.

Publications

Technical Note: Deriving ventilation imaging from 4DCT by deep convolutional neural network.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets