Patient-specific reconstruction of volumetric computed tomography images from a single projection view via deep learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Shen L
PROVIDER: S-EPMC6858583 | biostudies-literature | 2019 Nov
REPOSITORIES: biostudies-literature
Publications
Patient-specific reconstruction of volumetric computed tomography images from a single projection view via deep learning.
Shen Liyue L Zhao Wei W Xing Lei L
Nature biomedical engineering 20191028 11
Tomographic imaging using penetrating waves generates cross-sectional views of the internal anatomy of a living subject. For artefact-free volumetric imaging, projection views from a large number of angular positions are required. Here we show that a deep-learning model trained to map projection radiographs of a patient to the corresponding 3D anatomy can subsequently generate volumetric tomographic X-ray images of the patient from a single projection view. We demonstrate the feasibility of the ...[more]
Similar Datasets
Project description:The forces exerted by single cells in the three-dimensional (3D) environments play a crucial role in modulating cellular functions and behaviors closely related to physiological and pathological processes. Cellular force microscopy (CFM) provides a feasible solution for quantifying mechanical interactions, which usually regains cellular forces from deformation information of extracellular matrices embedded with fluorescent beads. Owing to computational complexity, traditional 3D-CFM is usually extremely time consuming, which makes it challenging for efficient force recovery and large-scale sample analysis. With the aid of deep neural networks, this study puts forward a novel, data-driven 3D-CFM to reconstruct 3D cellular force fields directly from volumetric images with random fluorescence patterns. The deep-learning-based network is established through stacking deep convolutional neural networks (DCNN) and specific function layers. Some necessary physical information associated with constitutive relation of extracellular matrix material is coupled to the data-driven network. The mini-batch stochastic-gradient-descent and back-propagation algorithms are introduced to ensure its convergence and training efficiency. The networks not only have good generalization ability and robustness but also can recover 3D cellular forces directly from the input fluorescence image pairs. Particularly, the computational efficiency of the deep-learning-based network is at least one to two orders of magnitude higher than that of traditional 3D-CFM. This study provides a novel scheme for developing high-performance 3D-CFM to quantitatively characterize mechanical interactions between single cells and surrounding extracellular matrices, which is of vital importance for quantitative investigations in biomechanics and mechanobiology.
| S-EPMC9247343 | biostudies-literature
Project description:BackgroundThe widespread application of X-ray computed tomography (CT) imaging in medical screening makes radiation safety a major concern for public health. Sparse-view CT is a promising solution to reduce the radiation dose. However, the reconstructed CT images obtained using sparse-view CT may suffer severe streaking artifacts and structural information loss.MethodsIn this study, a novel attention-based dual-branch network (ADB-Net) is proposed to solve the ill-posed problem of sparse-view CT image reconstruction. In this network, downsampled sinogram input is processed through 2 parallel branches (CT branch and signogram branch) of the ADB-Net to independently extract the distinct, high-level feature maps. These feature maps are fused in a specified attention module from 3 perspectives (channel, plane, and spatial) to allow complementary optimizations that can mitigate the streaking artifacts and the structure loss in sparse-view CT imaging.ResultsNumerical simulations, an anthropomorphic thorax phantom, and in vivo preclinical experiments were conducted to verify the sparse-view CT imaging performance of the ADB-Net. The proposed network achieved a root-mean-square error (RMSE) of 20.6160, a structural similarity (SSIM) of 0.9257, and a peak signal-to-noise ratio (PSNR) of 38.8246 on numerical data. The visualization results demonstrate that this newly developed network can consistently remove the streaking artifacts while maintaining the fine structures.ConclusionsThe proposed attention-based dual-branch deep network, ADB-Net, provides a promising alternative to reconstruct high-quality sparse-view CT images for low-dose CT imaging.
| S-EPMC10006128 | biostudies-literature
Project description:Photoacoustic computed tomography (PACT) has become a premier preclinical and clinical imaging modality. Although PACT's image quality can be dramatically improved with a large number of ultrasound (US) transducer elements and associated multiplexed data acquisition systems, the associated high system cost and/or slow temporal resolution are significant problems. Here, a deep learning-based approach is demonstrated that qualitatively and quantitively diminishes the limited-view artifacts that reduce image quality and improves the slow temporal resolution. This deep learning-enhanced multiparametric dynamic volumetric PACT approach, called DL-PACT, requires only a clustered subset of many US transducer elements on the conventional multiparametric PACT. Using DL-PACT, high-quality static structural and dynamic contrast-enhanced whole-body images as well as dynamic functional brain images of live animals and humans are successfully acquired, all in a relatively fast and cost-effective manner. It is believed that the strategy can significantly advance the use of PACT technology for preclinical and clinical applications such as neurology, cardiology, pharmacology, endocrinology, and oncology.
| S-EPMC9811490 | biostudies-literature
Project description:The accuracy of computed tomography angiography (CTA) image interpretation depends on the radiologist. This study aims to develop a new method for automatically detecting intracranial aneurysms from CTA images using deep learning, based on a convolutional neural network (CNN) implemented on the DeepMedic platform. Ninety CTA scans of patients with intracranial aneurysms are collected and divided into two datasets: training (80 subjects) and test (10 subjects) datasets. Subsequently, a deep learning architecture with a three-dimensional (3D) CNN model is implemented on the DeepMedic platform for the automatic segmentation and detection of intracranial aneurysms from the CTA images. The samples in the training dataset are used to train the CNN model, and those in the test dataset are used to assess the performance of the established system. Sensitivity, positive predictive value (PPV), and false positives are evaluated. The overall sensitivity and PPV of this system for detecting intracranial aneurysms from CTA images are 92.3% and 100%, respectively, and the segmentation sensitivity is 92.3%. The performance of the system in the detection of intracranial aneurysms is closely related to their size. The detection sensitivity for small intracranial aneurysms (≤ 3 mm) is 66.7%, whereas the sensitivity of detection for large (> 10 mm) and medium-sized (3-10 mm) intracranial aneurysms is 100%. The deep learning architecture with a 3D CNN model on the DeepMedic platform can reliably segment and detect intracranial aneurysms from CTA images with high sensitivity.
| S-EPMC9984635 | biostudies-literature
Project description:Study designRetrospective diagnostic study.ObjectiveTo automatically detect osteolytic bone metastasis lesions in the thoracolumbar region using conventional computed tomography (CT) scans, we developed a new deep learning (DL)-based computer-aided detection model.Summary of background dataRadiographic detection of bone metastasis is often difficult, even for orthopedic surgeons and diagnostic radiologists, with a consequent risk for pathologic fracture or spinal cord injury. If we can improve detection rates, we will be able to prevent the deterioration of patients' quality of life at the end stage of cancer.Materials and methodsThis study included CT scans acquired at Tokyo Medical and Dental University (TMDU) Hospital between 2016 and 2022. A total of 263 positive CT scans that included at least one osteolytic bone metastasis lesion in the thoracolumbar spine and 172 negative CT scans without bone metastasis were collected for the datasets to train and validate the DL algorithm. As a test data set, 20 positive and 20 negative CT scans were separately collected from the training and validation datasets. To evaluate the performance of the established artificial intelligence (AI) model, sensitivity, precision, F1-score, and specificity were calculated. The clinical utility of our AI model was also evaluated through observer studies involving six orthopaedic surgeons and six radiologists.ResultsOur AI model showed a sensitivity, precision, and F1-score of 0.78, 0.68, and 0.72 (per slice) and 0.75, 0.36, and 0.48 (per lesion), respectively. The observer studies revealed that our AI model had comparable sensitivity to orthopaedic or radiology experts and improved the sensitivity and F1-score of residents.ConclusionWe developed a novel DL-based AI model for detecting osteolytic bone metastases in the thoracolumbar spine. Although further improvement in accuracy is needed, the current AI model may be applied to current clinical practice.Level of evidenceLevel III.
| S-EPMC10898548 | biostudies-literature
Project description:BackgroundEarly gastric cancer (EGC) is defined as a lesion restricted to the mucosa or submucosa, independent of size or evidence of regional lymph node metastases. Although computed tomography (CT) is the main technique for determining the stage of gastric cancer (GC), the accuracy of CT for determining tumor invasion of EGC was still unsatisfactory by radiologists. In this research, we attempted to construct an AI model to discriminate EGC in portal venous phase CT images.MethodsWe retrospectively collected 658 GC patients from the first affiliated hospital of Nanchang university, and divided them into training and internal validation cohorts with a ratio of 8:2. As the external validation cohort, 93 GC patients were recruited from the second affiliated hospital of Soochow university. We developed several prediction models based on various convolutional neural networks, and compared their predictive performance.ResultsThe deep learning model based on the ResNet101 neural network represented sufficient discrimination of EGC. In two validation cohorts, the areas under the curves (AUCs) for the receiver operating characteristic (ROC) curves were 0.993 (95% CI: 0.984-1.000) and 0.968 (95% CI: 0.935-1.000), respectively, and the accuracy was 0.946 and 0.914. Additionally, the deep learning model can also differentiate between mucosa and submucosa tumors of EGC.ConclusionsThese results suggested that deep learning classifiers have the potential to be used as a screening tool for EGC, which is crucial in the individualized treatment of EGC patients.
| S-EPMC9748811 | biostudies-literature
Project description: Not available
| S-EPMC11007525 | biostudies-literature
Project description:ObjectivesDeep-learning image reconstruction (DLIR) offers unique opportunities for reducing image noise without degrading image quality or diagnostic accuracy in coronary CT angiography (CCTA). The present study aimed at exploiting the capabilities of DLIR to reduce radiation dose and assess its impact on stenosis severity, plaque composition analysis, and plaque volume quantification.MethodsThis prospective study includes 50 patients who underwent two sequential CCTA scans at normal-dose (ND) and lower-dose (LD). ND scans were reconstructed with Adaptive Statistical Iterative Reconstruction-Veo (ASiR-V) 100%, and LD scans with DLIR. Image noise (in Hounsfield units, HU) and quantitative plaque volumes (in mm3) were assessed quantitatively. Stenosis severity was visually categorized into no stenosis (0%), stenosis (< 20%, 20-50%, 51-70%, 71-90%, 91-99%), and occlusion (100%). Plaque composition was classified as calcified, non-calcified, or mixed.ResultsReduction of radiation dose from ND scans with ASiR-V 100% to LD scans with DLIR at the highest level (DLIR-H; 1.4 mSv vs. 0.8 mSv, p < 0.001) had no impact on image noise (28 vs. 27 HU, p = 0.598). Reliability of stenosis severity and plaque composition was excellent between ND scans with ASiR-V 100% and LD scans with DLIR-H (intraclass correlation coefficients of 0.995 and 0.974, respectively). Comparison of plaque volumes using Bland-Altman analysis revealed a mean difference of - 0.8 mm3 (± 2.5 mm3) and limits of agreement between - 5.8 and + 4.1 mm3.ConclusionDLIR enables a reduction in radiation dose from CCTA by 43% without significant impact on image noise, stenosis severity, plaque composition, and quantitative plaque volume.Key points•Deep-learning image reconstruction (DLIR) enables radiation dose reduction by over 40% for coronary computed tomography angiography (CCTA). •Image noise remains unchanged between a normal-dose CCTA reconstructed by ASiR-V and a lower-dose CCTA reconstructed by DLIR. •There is no impact on the assessment of stenosis severity, plaque composition, and quantitative plaque volume between the two scans.
| S-EPMC8921160 | biostudies-literature
Project description:ObjectiveStimulated Raman projection tomography (SRPT), a recently developed label-free volumetric chemical imaging technology, has been reported to quantitatively reconstruct the distribution of chemicals in a three-dimensional (3D) complex system. The current image reconstruction scheme used in SRPT is based on a filtered back projection (FBP) algorithm that requires at least 180 angular-dependent projections to rebuild a reasonable SRPT image, resulting in a long total acquisition time. This is a big limitation for longitudinal studies on live systems.MethodsWe present a sparse-view data-based sparse reconstruction scheme, in which sparsely sampled projections at 180 degrees were used to reconstruct the volumetric information. In the scheme, the simultaneous algebra reconstruction technique (SART), combined with total variation regularization, was used for iterative reconstruction. To better describe the projection process, a pixel vertex driven model (PVDM) was developed to act as projectors, whose performance was compared with those of the distance driven model (DDM).ResultsWe evaluated our scheme with numerical simulations and validated it for SRPT by mapping lipid contents in adipose cells. Simulation results showed that the PVDM performed better than the DDM in the case of using sparse-view data. Our scheme could maintain the quality of the reconstructed images even when the projection number was reduced to 15. The cell-based experimental results demonstrated that the proposed scheme can improve the imaging speed of the current FBP-based SRPT scheme by a factor of 9-12 without sacrificing discernible imaging details.ConclusionOur proposed scheme significantly reduces the total acquisition time required for SRPT at a speed of one order of magnitude faster than the currently used scheme. This significant improvement in imaging speed would potentially promote the applicability of SRPT for imaging living organisms.
| S-EPMC7329365 | biostudies-literature
Project description:BackgroundMuscle wasting (Sarcopenia) is associated with poor outcomes in cancer patients. Early identification of sarcopenia can facilitate nutritional and exercise intervention. Cross-sectional skeletal muscle (SM) area at the third lumbar vertebra (L3) slice of a computed tomography (CT) image is increasingly used to assess body composition and calculate SM index (SMI), a validated surrogate marker for sarcopenia in cancer. Manual segmentation of SM requires multiple steps, which limits use in routine clinical practice. This project aims to develop an automatic method to segment L3 muscle in CT scans.MethodsAttenuation correction CTs from full body PET-CT scans from patients enrolled in two prospective trials were used. The training set consisted of 66 non-small cell lung cancer (NSCLC) patients who underwent curative intent radiotherapy. An additional 42 NSCLC patients prescribed curative intent chemo-radiotherapy from a second trial were used for testing. Each patient had multiple CT scans taken at different time points prior to and post- treatment (147 CTs in the training and validation set and 116 CTs in the independent testing set). Skeletal muscle at L3 vertebra was manually segmented by two observers, according to the Alberta protocol to serve as ground truth labels. This included 40 images segmented by both observers to measure inter-observer variation. An ensemble of 2.5D fully convolutional neural networks (U-Nets) was used to perform the segmentation. The final layer of U-Net produced the binary classification of the pixels into muscle and non-muscle area. The model performance was calculated using Dice score and absolute percentage error (APE) in skeletal muscle area between manual and automated contours.ResultsWe trained five 2.5D U-Nets using 5-fold cross validation and used them to predict the contours in the testing set. The model achieved a mean Dice score of 0.92 and an APE of 3.1% on the independent testing set. This was similar to inter-observer variation of 0.96 and 2.9% for mean Dice and APE respectively. We further quantified the performance of sarcopenia classification using computer generated skeletal muscle area. To meet a clinical diagnosis of sarcopenia based on Alberta protocol the model achieved a sensitivity of 84% and a specificity of 95%.ConclusionsThis work demonstrates an automated method for accurate and reproducible segmentation of skeletal muscle area at L3. This is an efficient tool for large scale or routine computation of skeletal muscle area in cancer patients which may have applications on low quality CTs acquired as part of PET/CT studies for staging and surveillance of patients with cancer.
| S-EPMC8138051 | biostudies-literature