Natural Image Reconstruction From fMRI Using Deep Learning: A Survey.
Ontology highlight
ABSTRACT:
SUBMITTER: Rakhimberdina Z
PROVIDER: S-EPMC8722107 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Recently, deep neural networks have been widely and successfully applied in computer vision tasks and have attracted growing interest in medical imaging. One barrier for the application of deep neural networks to medical imaging is the need for large amounts of prior training pairs, which is not always feasible in clinical practice. This is especially true for medical image reconstruction problems, where raw data are needed. Inspired by the deep image prior framework, in this paper, we proposed a personalized network training method where no prior training pairs are needed, but only the patient's own prior information. The network is updated during the iterative reconstruction process using the patient-specific prior information and measured data. We formulated the maximum-likelihood estimation as a constrained optimization problem and solved it using the alternating direction method of multipliers algorithm. Magnetic resonance imaging guided positron emission tomography reconstruction was employed as an example to demonstrate the effectiveness of the proposed framework. Quantification results based on simulation and real data show that the proposed reconstruction framework can outperform Gaussian post-smoothing and anatomically guided reconstructions using the kernel method or the neural-network penalty.
| S-EPMC6584077 | biostudies-literature
Project description:Phase recovery from intensity-only measurements forms the heart of coherent imaging techniques and holography. In this study, we demonstrate that a neural network can learn to perform phase recovery and holographic image reconstruction after appropriate training. This deep learning-based approach provides an entirely new framework to conduct holographic imaging by rapidly eliminating twin-image and self-interference-related spatial artifacts. This neural network-based method is fast to compute and reconstructs phase and amplitude images of the objects using only one hologram, requiring fewer measurements in addition to being computationally faster. We validated this method by reconstructing the phase and amplitude images of various samples, including blood and Pap smears and tissue sections. These results highlight that challenging problems in imaging science can be overcome through machine learning, providing new avenues to design powerful computational imaging systems.
| S-EPMC6060068 | biostudies-other
Project description:Conventional reconstruction methods for photoacoustic images are not suitable for the scenario of sparse sensing and geometrical limitation. To overcome these challenges and enhance the quality of reconstruction, several learning-based methods have recently been introduced for photoacoustic tomography reconstruction. The goal of this study is to compare and systematically evaluate the recently proposed learning-based methods and modified networks for photoacoustic image reconstruction. Specifically, learning-based post-processing methods and model-based learned iterative reconstruction methods are investigated. In addition to comparing the differences inherently brought by the models, we also study the impact of different inputs on the reconstruction effect. Our results demonstrate that the reconstruction performance mainly stems from the effective amount of information carried by the input. The inherent difference of the models based on the learning-based post-processing method does not provide a significant difference in photoacoustic image reconstruction. Furthermore, the results indicate that the model-based learned iterative reconstruction method outperforms all other learning-based post-processing methods in terms of generalizability and robustness.
| S-EPMC8165448 | biostudies-literature
Project description:Background and Objectives: Although reducing the radiation dose level is important during diagnostic computed tomography (CT) applications, effective image quality enhancement strategies are crucial to compensate for the degradation that is caused by a dose reduction. We performed this prospective study to quantify emphysema on ultra-low-dose CT images that were reconstructed using deep learning-based image reconstruction (DLIR) algorithms, and compared and evaluated the accuracies of DLIR algorithms versus standard-dose CT. Materials and Methods: A total of 32 patients were prospectively enrolled, and all underwent standard-dose and ultra-low-dose (120 kVp; CTDIvol < 0.7 mGy) chest CT scans at the same time in a single examination. A total of six image datasets (filtered back projection (FBP) for standard-dose CT, and FBP, adaptive statistical iterative reconstruction (ASIR-V) 50%, DLIR-low, DLIR-medium, DLIR-high for ultra-low-dose CT) were reconstructed for each patient. Image noise values, emphysema indices, total lung volumes, and mean lung attenuations were measured in the six image datasets and compared (one-way repeated measures ANOVA). Results: The mean effective doses for standard-dose and ultra-low-dose CT scans were 3.43 ± 0.57 mSv and 0.39 ± 0.03 mSv, respectively (p < 0.001). The total lung volume and mean lung attenuation of five image datasets of ultra-low-dose CT scans, emphysema indices of ultra-low-dose CT scans reconstructed using ASIR-V 50 or DLIR-low, and the image noise of ultra-low-dose CT scans that were reconstructed using DLIR-low were not different from those of standard-dose CT scans. Conclusions: Ultra-low-dose CT images that were reconstructed using DLIR-low were found to be useful for emphysema quantification at a radiation dose of only 11% of that required for standard-dose CT.
| S-EPMC9317892 | biostudies-literature
Project description:Deep learning algorithms have become the first choice as an approach to medical image analysis, face recognition, and emotion recognition. In this survey, several deep-learning-based approaches applied to breast cancer, cervical cancer, brain tumor, colon and lung cancers are studied and reviewed. Deep learning has been applied in almost all of the imaging modalities used for cervical and breast cancers and MRIs for the brain tumor. The result of the review process indicated that deep learning methods have achieved state-of-the-art in tumor detection, segmentation, feature extraction and classification. As presented in this paper, the deep learning approaches were used in three different modes that include training from scratch, transfer learning through freezing some layers of the deep learning network and modifying the architecture to reduce the number of parameters existing in the network. Moreover, the application of deep learning to imaging devices for the detection of various cancer cases has been studied by researchers affiliated to academic and medical institutes in economically developed countries; while, the study has not had much attention in Africa despite the dramatic soar of cancer risks in the continent.
| S-EPMC8321208 | biostudies-literature
Project description:PurposeImage quality of positron emission tomography (PET) is limited by various physical degradation factors. Our study aims to perform PET image denoising by utilizing prior information from the same patient. The proposed method is based on unsupervised deep learning, where no training pairs are needed.MethodsIn this method, the prior high-quality image from the patient was employed as the network input and the noisy PET image itself was treated as the training label. Constrained by the network structure and the prior image input, the network was trained to learn the intrinsic structure information from the noisy image and output a restored PET image. To validate the performance of the proposed method, a computer simulation study based on the BrainWeb phantom was first performed. A 68Ga-PRGD2 PET/CT dataset containing 10 patients and a 18F-FDG PET/MR dataset containing 30 patients were later on used for clinical data evaluation. The Gaussian, non-local mean (NLM) using CT/MR image as priors, BM4D, and Deep Decoder methods were included as reference methods. The contrast-to-noise ratio (CNR) improvements were used to rank different methods based on Wilcoxon signed-rank test.ResultsFor the simulation study, contrast recovery coefficient (CRC) vs. standard deviation (STD) curves showed that the proposed method achieved the best performance regarding the bias-variance tradeoff. For the clinical PET/CT dataset, the proposed method achieved the highest CNR improvement ratio (53.35% ± 21.78%), compared with the Gaussian (12.64% ± 6.15%, P = 0.002), NLM guided by CT (24.35% ± 16.30%, P = 0.002), BM4D (38.31% ± 20.26%, P = 0.002), and Deep Decoder (41.67% ± 22.28%, P = 0.002) methods. For the clinical PET/MR dataset, the CNR improvement ratio of the proposed method achieved 46.80% ± 25.23%, higher than the Gaussian (18.16% ± 10.02%, P < 0.0001), NLM guided by MR (25.36% ± 19.48%, P < 0.0001), BM4D (37.02% ± 21.38%, P < 0.0001), and Deep Decoder (30.03% ± 20.64%, P < 0.0001) methods. Restored images for all the datasets demonstrate that the proposed method can effectively smooth out the noise while recovering image details.ConclusionThe proposed unsupervised deep learning framework provides excellent image restoration effects, outperforming the Gaussian, NLM methods, BM4D, and Deep Decoder methods.
| S-EPMC7814987 | biostudies-literature
Project description:ObjectiveTo assess the feasibility of applying a deep learning-based denoising technique to coronary CT angiography (CCTA) along with iterative reconstruction for additional noise reduction.Materials and methodsWe retrospectively enrolled 82 consecutive patients (male:female = 60:22; mean age, 67.0 ± 10.8 years) who had undergone both CCTA and invasive coronary artery angiography from March 2017 to June 2018. All included patients underwent CCTA with iterative reconstruction (ADMIRE level 3, Siemens Healthineers). We developed a deep learning based denoising technique (ClariCT.AI, ClariPI), which was based on a modified U-net type convolutional neural net model designed to predict the possible occurrence of low-dose noise in the originals. Denoised images were obtained by subtracting the predicted noise from the originals. Image noise, CT attenuation, signal-to-noise ratio (SNR), and contrast-to-noise ratio (CNR) were objectively calculated. The edge rise distance (ERD) was measured as an indicator of image sharpness. Two blinded readers subjectively graded the image quality using a 5-point scale. Diagnostic performance of the CCTA was evaluated based on the presence or absence of significant stenosis (≥ 50% lumen reduction).ResultsObjective image qualities (original vs. denoised: image noise, 67.22 ± 25.74 vs. 52.64 ± 27.40; SNR [left main], 21.91 ± 6.38 vs. 30.35 ± 10.46; CNR [left main], 23.24 ± 6.52 vs. 31.93 ± 10.72; all p < 0.001) and subjective image quality (2.45 ± 0.62 vs. 3.65 ± 0.60, p < 0.001) improved significantly in the denoised images. The average ERDs of the denoised images were significantly smaller than those of originals (0.98 ± 0.08 vs. 0.09 ± 0.08, p < 0.001). With regard to diagnostic accuracy, no significant differences were observed among paired comparisons.ConclusionApplication of the deep learning technique along with iterative reconstruction can enhance the noise reduction performance with a significant improvement in objective and subjective image qualities of CCTA images.
| S-EPMC7458859 | biostudies-literature
Project description:Conventional reconstruction algorithms (e.g., delay-and-sum) used in photoacoustic imaging (PAI) provide a fast solution while many artifacts remain, especially for limited-view with ill-posed problem. In this paper, we propose a new convolutional neural network (CNN) framework Y-Net: a CNN architecture to reconstruct the initial PA pressure distribution by optimizing both raw data and beamformed images once. The network combines two encoders with one decoder path, which optimally utilizes more information from raw data and beamformed image. We compared our result with some ablation studies, and the results of the test set show better performance compared with conventional reconstruction algorithms and other deep learning method (U-Net). Both in-vitro and in-vivo experiments are used to validated our method, which still performs better than other existing methods. The proposed Y-Net architecture also has high potential in medical image reconstruction for other imaging modalities beyond PAI.
| S-EPMC7322183 | biostudies-literature
Project description:PurposeTo evaluate the effect of a deep learning-based reconstruction (DLR) method on the conspicuity of hypovascular hepatic metastases on abdominal CT images.Materials and methodsThis retrospective study with institutional review board approval included 58 patients with hypovascular hepatic metastases. A radiologist recorded the standard deviation of attenuation in the paraspinal muscle as the image noise and the contrast-to-noise ratio (CNR). CNR was calculated as region of interest ([ROI]L - ROIT)/N, where ROIL is the mean liver parenchyma attenuation, ROIT, the mean tumor attenuation, and N, the noise. Two other radiologists graded the conspicuity of the liver lesion on a five-point scale where 1 is unidentifiable and 5 is detected without diagnostic compromise. Only the smallest liver lesion in each patient, classified as smaller or larger than 10 mm, was evaluated. The difference between hybrid iterative reconstruction (IR) and DLR images was determined by using a two-sided Wilcoxon signed-rank test.ResultsThe image noise was significantly lower, and the CNR was significantly higher on DLR images than hybrid IR images (median image noise: 19.2 vs 12.8 HU, P < .001; median CNR: tumors < 10 mm: 1.9 vs 2.5; tumors > 10 mm: 1.7 vs 2.2, both P < .001). The scores for liver lesions were significantly higher for DLR images than hybrid IR images (P < .01 for both in tumors smaller or larger than 10 mm).ConclusionDLR improved the quality of abdominal CT images for the evaluation of hypovascular hepatic metastases.© RSNA, 2019Supplemental material is available for this article.
| S-EPMC8017421 | biostudies-literature
Project description:Quantitative optical measurements of deep sub-wavelength, three-dimensional, nanometric structures with sensitivity to sub-nanometer details address an ubiquitous measurement challenge. A Fourier domain normalization approach is used in the Fourier optical imaging code to simulate the full three-dimensional scattered light field of nominally 15 nm sized structures, accurately replicating the light field as a function of the focus position. Using the full three-dimensional light field, nanometer scale details such as a 2 nm thin conformal oxide and nanometer topography are rigorously fitted for features less than 1/30th of the wavelength in size. The densely packed structures are positioned nearly an order of magnitude closer than the conventional Rayleigh resolution limit and can be measured with sub-nanometer parametric uncertainties. This approach enables a practical measurement sensitivity to size variations of only a few atoms in size using a high throughput optical configuration with broad application in measuring nanometric structures and nanoelectronic devices.
| S-EPMC4768307 | biostudies-literature