Dataset Information

Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients.

ABSTRACT: Traditional intensity-based 2D/3D registration requires near-perfect initialization in order for image similarity metrics to yield meaningful updates of X-ray pose and reduce the likelihood of getting trapped in a local minimum. The conventional approaches strongly depend on image appearance rather than content, and therefore, fail in revealing large pose offsets that substantially alter the appearance of the same structure. We complement traditional similarity metrics with a convolutional neural network-based (CNN-based) registration solution that captures large-range pose relations by extracting both local and contextual information, yielding meaningful X-ray pose updates without the need for accurate initialization. To register a 2D X-ray image and a 3D CT scan, our CNN accepts a target X-ray image and a digitally reconstructed radiograph at the current pose estimate as input and iteratively outputs pose updates in the direction of the pose gradient on the Riemannian Manifold. Our approach integrates seamlessly with conventional image-based registration frameworks, where long-range relations are captured primarily by our CNN-based method while short-range offsets are recovered accurately with an image similarity-based method. On both synthetic and real X-ray images of the human pelvis, we demonstrate that the proposed method can successfully recover large rotational and translational offsets, irrespective of initialization.

SUBMITTER: Gu W

PROVIDER: S-EPMC7605345 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients.

Gu Wenhao W Gao Cong C Grupp Robert R Fotouhi Javad J Unberath Mathias M

Machine learning in medical imaging. MLMI (Workshop) 20200929

Traditional intensity-based 2D/3D registration requires near-perfect initialization in order for image similarity metrics to yield meaningful updates of X-ray pose and reduce the likelihood of getting trapped in a local minimum. The conventional approaches strongly depend on image appearance rather than content, and therefore, fail in revealing large pose offsets that substantially alter the appearance of the same structure. We complement traditional similarity metrics with a convolutional neura ...[more]

PMID: 33145587

Similar Datasets

Project description:The primary aim of this study is to investigate the performance difference of rigid and nonrigid registration schemes in matching corresponding pulmonary nodules depicted on sequential chest computed tomography (CT) examinations.A gradient descent based rigid registration algorithm with scaling was developed and it handled the involved geometric transformations (i.e., translation, rescaling, shearing, and rotation) separately instead of optimizing them in a single pass. Given two lung CT examinations, the scaling and translation parameters were simply estimated from the lung volume dimensions (e.g., size and mass center), while the rotation parameters were optimized progressively using gradient descent. To investigate the performance difference of rigid and nonrigid schemes in pulmonary nodule registration, the well-known nonrigid Demons algorithm was implemented and tested along with the developed schemes against 60 diverse low-dose clinical lung CT examinations with average 2-yr follow-up scans. A verified cancer and its correspondence in the follow-up scan as well as their spatial locations (mass center) were identified in each examination. In addition to the computational efficiency, the accuracy of these registration procedures was assessed by computing the Euclidean distances between the corresponding nodules after the registration. To demonstrate the advantage of the developed algorithm, the authors also implemented a fast iterative closest point (ICP) based rigid algorithm and compared their performance.Our experiments on the collected chest CT examinations showed that the nodule registration errors in 3D Euclidean distance for the developed rigid affine approach, the traditional ICP algorithm, and the refining nonrigid Demons algorithm were 9.6, 9.8, and 10.0 mm, respectively, and the corresponding computational costs in time were 5, 300, and 55 s, respectively.A rigid solution may be preferred in practice for the pulmonary nodule registration in longitudinal studies because of its relatively high efficiency and sufficient accuracy for the clinical need.

Project description:BACKGROUND:[18F]fluoro-2-deoxy-D-glucose ([18F]FDG) positron emission tomography (PET) is a valuable tool for monitoring response to therapy in oncology. In longitudinal studies, however, patients are not scanned in exactly the same position. Rigid and non-rigid image registration can be applied in order to reuse baseline volumes of interest (VOI) on consecutive studies of the same patient. The purpose of this study was to investigate the impact of various image registration strategies on standardized uptake value (SUV) and metabolic volume test-retest variability (TRT). METHODS:Test-retest whole-body [18F]FDG PET/CT scans were collected retrospectively for 11 subjects with advanced gastrointestinal malignancies (colorectal carcinoma). Rigid and non-rigid image registration techniques with various degrees of locality were applied to PET, CT, and non-attenuation corrected PET (NAC) data. VOI were drawn independently on both test and retest scans. VOI drawn on test scans were projected onto retest scans and the overlap between projected VOI and manually drawn retest VOI was quantified using the Dice similarity coefficient (DSC). In addition, absolute (unsigned) differences in TRT of SUVmax, SUVmean, metabolic volume and total lesion glycolysis (TLG) were calculated in on one hand the test VOI and on the other hand the retest VOI and projected VOI. Reference values were obtained by delineating VOIs on both scans separately. RESULTS:Non-rigid PET registration showed the best performance (median DSC: 0.82, other methods: 0.71-0.81). Compared with the reference, none of the registration types showed significant absolute differences in TRT of SUVmax, SUVmean and TLG (p > 0.05). Only for absolute TRT of metabolic volume, significant lower values (p < 0.05) were observed for all registration strategies when compared to delineating VOIs separately, except for non-rigid PET registrations (p = 0.1). Non-rigid PET registration provided good volume TRT (7.7%) that was smaller than the reference (16%). CONCLUSION:In particular, non-rigid PET image registration showed good performance similar to delineating VOI on both scans separately, and with smaller TRT in metabolic volume estimates.

Dataset Information

Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients.

Publications

Extended Capture Range of Rigid 2D/3D Registration by Estimating Riemannian Pose Gradients.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets