Dataset Information

Augmentation of CBCT Reconstructed From Under-Sampled Projections Using Deep Learning.

ABSTRACT: Edges tend to be over-smoothed in total variation (TV) regularized under-sampled images. In this paper, symmetric residual convolutional neural network (SR-CNN), a deep learning based model, was proposed to enhance the sharpness of edges and detailed anatomical structures in under-sampled cone-beam computed tomography (CBCT). For training, CBCT images were reconstructed using TV-based method from limited projections simulated from the ground truth CT, and were fed into SR-CNN, which was trained to learn a restoring pattern from under-sampled images to the ground truth. For testing, under-sampled CBCT was reconstructed using TV regularization and was then augmented by SR-CNN. Performance of SR-CNN was evaluated using phantom and patient images of various disease sites acquired at different institutions both qualitatively and quantitatively using structure similarity (SSIM) and peak signal-to-noise ratio (PSNR). SR-CNN substantially enhanced image details in the TV-based CBCT across all experiments. In the patient study using real projections, SR-CNN augmented CBCT images reconstructed from as low as 120 half-fan projections to image quality comparable to the reference fully-sampled FDK reconstruction using 900 projections. In the tumor localization study, improvements in the tumor localization accuracy were made by the SR-CNN augmented images compared with the conventional FDK and TV-based images. SR-CNN demonstrated robustness against noise levels and projection number reductions and generalization for various disease sites and datasets from different institutions. Overall, the SR-CNN-based image augmentation technique was efficient and effective in considerably enhancing edges and anatomical structures in under-sampled 3D/4D-CBCT, which can be very valuable for image-guided radiotherapy.

SUBMITTER: Jiang Z

PROVIDER: S-EPMC6812588 | biostudies-literature | 2019 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Augmentation of CBCT Reconstructed From Under-Sampled Projections Using Deep Learning.

Jiang Zhuoran Z Chen Yingxuan Y Zhang Yawei Y Ge Yun Y Yin Fang-Fang FF Ren Lei L

IEEE transactions on medical imaging 20190423 11

Edges tend to be over-smoothed in total variation (TV) regularized under-sampled images. In this paper, symmetric residual convolutional neural network (SR-CNN), a deep learning based model, was proposed to enhance the sharpness of edges and detailed anatomical structures in under-sampled cone-beam computed tomography (CBCT). For training, CBCT images were reconstructed using TV-based method from limited projections simulated from the ground truth CT, and were fed into SR-CNN, which was trained ...[more]

PMID: 31021791

Similar Datasets

Project description:The aims of this study were to decrease the 177Lu-SPECT acquisition time by reducing the number of projections and to circumvent image degradation by adding deep-learning-generated synthesized projections. Methods: We constructed a deep convolutional U-net-shaped neural network for generation of synthetic intermediate projections (CUSIPs). The number of SPECT investigations was 352 for training, 37 for validation, and 15 for testing. The input was every fourth projection of 120 acquired SPECT projections, that is, 30 projections. The output was 30 synthetic intermediate projections (SIPs) per CUSIP. SPECT images were reconstructed with 120 or 30 projections, or with 120 projections when 90 SIPs were generated from 30 projections (30-120SIPs), using 3 CUSIPs. The reconstructions were performed with 2 ordered-subset expectation maximization (OSEM) algorithms: attenuation-corrected (AC) OSEM, and attenuation, scatter, and collimator response-corrected (ASCC) OSEM. The quality of the SIPs and SPECT images was quantitatively evaluated with root-mean-square error, peak signal-to-noise ratio (PSNR), and structural similarity (SSIM) index metrics. From a Jaszczak SPECT phantom, the recovery and signal-to-noise ratio (SNR) were determined. In addition, an experienced observer qualitatively assessed the SPECT image quality of the test set. Kidney activity concentrations, as determined from the different SPECT images, were compared. Results: The generated SIPs had a mean SSIM value of 0.926 (SD, 0.061). For AC-OSEM, the reconstruction with 30-120SIPs had higher SSIM (0.993 vs. 0.989, P < 0.001) and PSNR (49.5 vs. 47.2, P < 0.001) values than the reconstruction with 30 projections. ASCC-OSEM had higher SSIM and PSNR values than AC-OSEM (P < 0.001). There was a minor loss in recovery for 30-120SIPs, but SNR was clearly improved compared with 30 projections. The observer assessed 27 of 30 images reconstructed with 30 projections as having unacceptable noise levels, whereas the corresponding values were 2 of 60 for 30-120SIPs and 120 projections. Image quality did not differ significantly between 30-120SIPs and 120 projections. The kidney activity concentration was similar between the different projection sets, excepting a minor reduction of 2.5% for ASCC-OSEM 30-120SIPs. Conclusion: Adopting SIPs for sparsely acquired projections considerably recovers image quality and could allow a reduced SPECT acquisition time in clinical dosimetry protocols.

Project description:Detection and diagnosis of early and subclinical stages of Alzheimer's Disease (AD) play an essential role in the implementation of intervention and prevention strategies. Neuroimaging techniques predominantly provide insight into anatomic structure changes associated with AD. Deep learning methods have been extensively applied towards creating and evaluating models capable of differentiating between cognitively unimpaired, patients with Mild Cognitive Impairment (MCI) and AD dementia. Several published approaches apply information fusion techniques, providing ways of combining several input sources in the medical domain, which contributes to knowledge of broader and enriched quality. The aim of this paper is to fuse sociodemographic data such as age, marital status, education and gender, and genetic data (presence of an apolipoprotein E (APOE)-?4 allele) with Magnetic Resonance Imaging (MRI) scans. This enables enriched multi-modal features, that adequately represent the MRI scan visually and is adopted for creating and modeling classification systems capable of detecting amnestic MCI (aMCI). To fully utilize the potential of deep convolutional neural networks, two extra color layers denoting contrast intensified and blurred image adaptations are virtually augmented to each MRI scan, completing the Red-Green-Blue (RGB) color channels. Deep convolutional activation features (DeCAF) are extracted from the average pooling layer of the deep learning system Inception_v3. These features from the fused MRI scans are used as visual representation for the Long Short-Term Memory (LSTM) based Recurrent Neural Network (RNN) classification model. The proposed approach is evaluated on a sub-study containing 120 participants (aMCI = 61 and cognitively unimpaired = 59) of the Heinz Nixdorf Recall (HNR) Study with a baseline model accuracy of 76%. Further evaluation was conducted on the ADNI Phase 1 dataset with 624 participants (aMCI = 397 and cognitively unimpaired = 227) with a baseline model accuracy of 66.27%. Experimental results show that the proposed approach achieves 90% accuracy and 0.90 F1-Score at classification of aMCI vs. cognitively unimpaired participants on the HNR Study dataset, and 77% accuracy and 0.83 F1-Score on the ADNI dataset.

Project description:PurposeCone beam computed tomography (CBCT) is a standard solution for in-room image guidance for radiation therapy. It is used to evaluate and compensate for anatomopathological changes between the dose delivery plan and the fraction delivery day. CBCT is a fast and versatile solution, but it suffers from drawbacks like low contrast and requires proper calibration to derive density values. Although these limitations are even more prominent with in-room customized CBCT systems, strategies based on deep learning have shown potential in improving image quality. As such, this article presents a method based on a convolutional neural network and a novel two-step supervised training based on the transfer learning paradigm for shading correction in CBCT volumes with narrow field of view (FOV) acquired with an ad hoc in-room system.MethodsWe designed a U-Net convolutional neural network, trained on axial slices of corresponding CT/CBCT couples. To improve the generalization capability of the network, we exploited two-stage learning using two distinct data sets. At first, the network weights were trained using synthetic CBCT scans generated from a public data set, and then only the deepest layers of the network were trained again with real-world clinical data to fine-tune the weights. Synthetic data were generated according to real data acquisition parameters. The network takes a single grayscale volume as input and outputs the same volume with corrected shading and improved HU values.ResultsEvaluation was carried out with a leave-one-out cross-validation, computed on 18 unique CT/CBCT pairs from six different patients from a real-world dataset. Comparing original CBCT to CT and improved CBCT to CT, we obtained an average improvement of 6 dB on peak signal-to-noise ratio (PSNR), +2% on structural similarity index measure (SSIM). The median interquartile range (IQR) Hounsfield unit (HU) difference between CBCT and CT improved from 161.37 (162.54) HU to 49.41 (66.70) HU. Region of interest (ROI)-based HU difference was narrowed by 75% in the spongy bone (femoral head), 89% in the bladder, 85% for fat, and 83% for muscle. The improvement in contrast-to-noise ratio for these ROIs was about 67%.ConclusionsWe demonstrated that shading correction obtaining CT-compatible data from narrow-FOV CBCTs acquired with a customized in-room system is possible. Moreover, the transfer learning approach proved particularly beneficial for such a shading correction approach.

Dataset Information

Augmentation of CBCT Reconstructed From Under-Sampled Projections Using Deep Learning.

Publications

Augmentation of CBCT Reconstructed From Under-Sampled Projections Using Deep Learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure