Rigid registration of medical images using 1D and 2D binary projections.
Ontology highlight
ABSTRACT:
SUBMITTER: Kotsas P
PROVIDER: S-EPMC3180551 | biostudies-literature | 2011 Oct
REPOSITORIES: biostudies-literature
Publications
Rigid registration of medical images using 1D and 2D binary projections.
Kotsas Panayiotis P Dodd Tony T
Journal of digital imaging 20111001 5
Image registration is a necessary procedure in everyday clinical practice. Several techniques for rigid and non-rigid registration have been developed and tested and the state-of-the-art is evolving from the research setting to incorporate image registration techniques into clinically useful tools. In this paper, we develop a novel rigid medical image registration technique which incorporates binary projections. This technique is tested and compared to the standard mutual information (MI) method ...[more]
Similar Datasets
Project description:Traditional intensity-based 2D/3D registration requires near-perfect initialization in order for image similarity metrics to yield meaningful updates of X-ray pose and reduce the likelihood of getting trapped in a local minimum. The conventional approaches strongly depend on image appearance rather than content, and therefore, fail in revealing large pose offsets that substantially alter the appearance of the same structure. We complement traditional similarity metrics with a convolutional neural network-based (CNN-based) registration solution that captures large-range pose relations by extracting both local and contextual information, yielding meaningful X-ray pose updates without the need for accurate initialization. To register a 2D X-ray image and a 3D CT scan, our CNN accepts a target X-ray image and a digitally reconstructed radiograph at the current pose estimate as input and iteratively outputs pose updates in the direction of the pose gradient on the Riemannian Manifold. Our approach integrates seamlessly with conventional image-based registration frameworks, where long-range relations are captured primarily by our CNN-based method while short-range offsets are recovered accurately with an image similarity-based method. On both synthetic and real X-ray images of the human pelvis, we demonstrate that the proposed method can successfully recover large rotational and translational offsets, irrespective of initialization.
| S-EPMC7605345 | biostudies-literature
Project description:In prostate radiotherapy, setup errors with respect to the patient's bony anatomy can be reduced by aligning 2D megavoltage (MV) portal images acquired during treatment to a reference 3D kilovoltage (kV) CT acquired for treatment planning purposes. The purpose of this study was to evaluate a fully automated 2D-3D registration algorithm to quantify setup errors in 3D through the alignment of line-enhanced portal images and digitally reconstructed radiographs computed from the CT. The line-enhanced images were obtained by correlating the images with a filter bank of short line segments, or "sticks" at different orientations. The proposed methods were validated on (1) accurately collected gold-standard data consisting of a 3D kV cone-beam CT scan of an anthropomorphic phantom of the pelvis and 2D MV portal images in the anterior-posterior (AP) view acquired at 15 different poses and (2) a conventional 3D kV CT scan and weekly 2D MV AP portal images of a patient over 8 weeks. The mean (and standard deviation) of the absolute registration error for rotations around the right-lateral (RL), inferior-superior (IS), and posterior-anterior (PA) axes were 0.212 degree (0.214 degree), 0.055 degree (0.033 degree) and 0.041 degree (0.039 degree), respectively. The corresponding registration errors for translations along the RL, IS, and PA axes were 0.161 (0.131) mm, 0.096 (0.033) mm, and 0.612 (0.485) mm. The mean (and standard deviation) of the total registration error was 0.778 (0.543) mm. Registration on the patient images was successful in all eight cases as determined visually. The results indicate that it is feasible to automatically enhance features in MV portal images of the pelvis for use within a completely automated 2D-3D registration framework for the accurate determination of patient setup errors. They also indicate that it is feasible to estimate all six transformation parameters from a 3D CT of the pelvis and a single portal image in the AP view.
| S-EPMC3910153 | biostudies-other
Project description:PURPOSE:To automate the estimation of swallowing motion from 2D MR cine images using deformable registration for future applications of personalized margin reduction in head and neck radiotherapy and outcome assessment of radiation-associated dysphagia. METHODS:Twenty-one patients with serial 2D FSPGR-MR cine scans of the head and neck conducted through the course of definitive radiotherapy for oropharyngeal cancer. Included patients had at least one cine scan before, during, or after radiotherapy, with a total of 52 cine scans. Contours of 7 swallowing related regions-of-interest (ROIs), including pharyngeal constrictor, epiglottis, base of tongue, geniohyoid, hyoid, soft palate, and larynx, were manually delineated from consecutive frames of the cine scan covering at least one swallowing cycle. We applied a modified thin-plate-spline robust-point-matching algorithm to register the point sets of each ROI automatically over frames. The deformation vector fields from the registration were then used to estimate the motion during swallowing for each ROI. Registration errors were estimated by comparing the deformed contours with the manual contours. RESULTS:On average 22 frames of each cine scan were contoured. The registration for one cine scan (7 ROIs over 22 frames) on average took roughly 22 minutes. A number of 8018 registrations were successfully batch processed without human interaction after the contours were drawn. The average registration error for all ROIs and all patients was 0.36 mm (range: 0.06 mm- 2.06 mm). Larynx had the average largest motion in superior direction of all structures under consideration (range: 0.0 mm- 58.7 mm). Geniohyoid had the smallest overall motion of all ROIs under consideration and the superior-inferior motion was larger than the anterior-posterior motion for all ROIs. CONCLUSION:We developed and validated a deformable registration framework to automate the estimation of swallowing motion from 2D MR cine scans.
| S-EPMC7012439 | biostudies-literature
Project description:To provide a comprehensive assessment of patient setup accuracy in 6 degrees of freedom (DOFs) using 2-dimensional/3-dimensional (2D/3D) image registration with on-board 2-dimensional kilovoltage (OB-2 DkV) radiographic images, we evaluated cranial, head and neck (HN), and thoracic and abdominal sites under clinical conditions. A fast 2D/3D image registration method using graphics processing unit GPU was modified for registration between OB-2 DkV and 3D simulation computed tomography (simCT) images, with 3D/3D registration as the gold standard for 6 DOF alignment. In 2D/3D registration, body roll rotation was obtained solely by matching orthogonal OB-2 DkV images with a series of digitally reconstructed radiographs (DRRs) from simCT with a small rotational increment along the gantry rotation axis. The window/level adjustments for optimal visualization of the bone in OB-2 DkV and DRRs were performed prior to registration. Ideal patient alignment at the isocenter was calculated and used as an initial registration position. In 3D/3D registration, cone-beam CT (CBCT) was aligned to simCT on bony structures using a bone density filter in 6DOF. Included in this retrospective study were 37 patients treated in 55 fractions with frameless stereotactic radiosurgery or stereotactic body radiotherapy for cranial and paraspinal cancer. A cranial phantom was used to serve as a control. In all cases, CBCT images were acquired for patient setup with subsequent OB-2 DkV verification. It was found that the accuracy of the 2D/3D registration was 0.0 ± 0.5 mm and 0.1° ± 0.4° in phantom. In patient, it is site dependent due to deformation of the anatomy: 0.2 ± 1.6 mm and -0.4° ± 1.2° on average for each dimension for the cranial site, 0.7 ± 1.6 mm and 0.3° ± 1.3° for HN, 0.7 ± 2.0 mm and -0.7° ± 1.1° for the thorax, and 1.1 ± 2.6 mm and -0.5° ± 1.9° for the abdomen. Anatomical deformation and presence of soft tissue in 2D/3D registration affect the consistency with 3D/3D registration in 6 DOF: the discrepancy increases in superior to inferior direction.
| S-EPMC4544868 | biostudies-literature
Project description:Medical image segmentation is a crucial step in Computer-Aided Diagnosis systems, where accurate segmentation is vital for perfect disease diagnoses. This paper proposes a multilevel thresholding technique for 2D and 3D medical image segmentation using Otsu and Kapur's entropy methods as fitness functions to determine the optimum threshold values. The proposed algorithm applies the hybridization concept between the recent Coronavirus Optimization Algorithm (COVIDOA) and Harris Hawks Optimization Algorithm (HHOA) to benefit from both algorithms' strengths and overcome their limitations. The improved performance of the proposed algorithm over COVIDOA and HHOA algorithms is demonstrated by solving 5 test problems from IEEE CEC 2019 benchmark problems. Medical image segmentation is tested using two groups of images, including 2D medical images and volumetric (3D) medical images, to demonstrate its superior performance. The utilized test images are from different modalities such as Magnetic Resonance Imaging (MRI), Computed Tomography (CT), and X-ray images. The proposed algorithm is compared with seven well-known metaheuristic algorithms, where the performance is evaluated using four different metrics, including the best fitness values, Peak Signal to Noise Ratio (PSNR), Structural Similarity Index (SSIM), and Normalized Correlation Coefficient (NCC). The experimental results demonstrate the superior performance of the proposed algorithm in terms of convergence to the global optimum and making a good balance between exploration and exploitation properties. Moreover, the quality of the segmented images using the proposed algorithm at different threshold levels is better than the other methods according to PSNR, SSIM, and NCC values. Additionally, the Wilcoxon rank-sum test is conducted to prove the statistical significance of the proposed algorithm.
| S-EPMC9398848 | biostudies-literature
Project description:BACKGROUND:Ex-vivo cardiovascular magnetic resonance (CMR) imaging has played an important role in the validation of in-vivo CMR characterization of pathological processes. However, comparison between in-vivo and ex-vivo imaging remains challenging due to shape changes occurring between the two states, which may be non-uniform across the diseased heart. A novel two-step process to facilitate registration between ex-vivo and in-vivo CMR was developed and evaluated in a porcine model of chronic myocardial infarction (MI). METHODS:Seven weeks after ischemia-reperfusion MI, 12 swine underwent in-vivo CMR imaging with late gadolinium enhancement followed by ex-vivo CMR 1 week later. Five animals comprised the control group, in which ex-vivo imaging was undertaken without any support in the LV cavity, 7 animals comprised the experimental group, in which a two-step registration optimization process was undertaken. The first step involved a heart specific flexible 3D printed scaffold generated from in-vivo CMR, which was used to maintain left ventricular (LV) shape during ex-vivo imaging. In the second step, a non-rigid co-registration algorithm was applied to align in-vivo and ex-vivo data. Tissue dimension changes between in-vivo and ex-vivo imaging were compared between the experimental and control group. In the experimental group, tissue compartment volumes and thickness were compared between in-vivo and ex-vivo data before and after non-rigid registration. The effectiveness of the alignment was assessed quantitatively using the DICE similarity coefficient. RESULTS:LV cavity volume changed more in the control group (ratio of cavity volume between ex-vivo and in-vivo imaging in control and experimental group 0.14 vs 0.56, p < 0.0001) and there was a significantly greater change in the short axis dimensions in the control group (ratio of short axis dimensions in control and experimental group 0.38 vs 0.79, p < 0.001). In the experimental group, prior to non-rigid co-registration the LV cavity contracted isotropically in the ex-vivo condition by less than 20% in each dimension. There was a significant proportional change in tissue thickness in the healthy myocardium (change = 29 ± 21%), but not in dense scar (change = - 2 ± 2%, p = 0.034). Following the non-rigid co-registration step of the process, the DICE similarity coefficients for the myocardium, LV cavity and scar were 0.93 (±0.02), 0.89 (±0.01) and 0.77 (±0.07) respectively and the myocardial tissue and LV cavity volumes had a ratio of 1.03 and 1.00 respectively. CONCLUSIONS:The pattern of the morphological changes seen between the in-vivo and the ex-vivo LV differs between scar and healthy myocardium. A 3D printed flexible scaffold based on the in-vivo shape of the LV cavity is an effective strategy to minimize morphological changes in the ex-vivo LV. The subsequent non-rigid registration step further improved the co-registration and local comparison between in-vivo and ex-vivo data.
| S-EPMC6785908 | biostudies-other
Project description:A small and weak target detection method is proposed in this work that outperforms all other methods in terms of real-time capability. It is the first time that two-dimensional (2D) images are processed using only one-dimensional1D structuring elements in a morphology-based approach, enabling the real-time hardware implementation of the whole image processing method. A parallel image readout and processing structure is introduced to achieve an ultra-low latency time on the order of nanoseconds, and a hyper-frame resolution in the time domain can be achieved by combining the row-by-row structure and the electrical rolling shutter technique. Experimental results suggest that the expected target can be successfully detected under various interferences with an accuracy of 0.1 pixels (1?) under the worst sky night test condition and that a centroiding precision of better than 0.03 pixels (1?) can be reached for static tests. The real-time detection method with high robustness and accuracy is attractive for application to all types of real-time small target detection systems, such as medical imaging, infrared surveillance, and target measurement and tracking, where an ultra-high processing speed is required.
| S-EPMC6060073 | biostudies-literature
Project description:For accurate analysis of bone formation and resorption during fracture healing, correct registration of follow-up onto baseline image is required. A per-fragment approach could improve alignment compared to standard registration based on the whole fractured region. In this exploratory study, we tested the effect of fragment size and displacement on a per-fragment registration, and compared the results of this per-fragment registration to the results of the standard registration in two stable fractures and one unstable fracture. To test the effect of fragment size and displacement, high-resolution peripheral quantitative computed tomography (HR-pQCT) scans of three unfractured radii were divided into subvolumes. Different displacements in x-, y, or z-direction or rotations around each axis were applied, and each subvolume was registered onto the initial volume to realign it. Next, registration of follow-up onto baseline scan was performed in two stable and one unstable fracture. After coarsely aligning the follow-up onto the baseline scan, a more accurate registration was performed of the whole fracture, i.e. the standard registration, and of each fracture fragment separately, i.e. per-fragment registration. Alignment was checked using overlay images showing baseline, follow-up and overlap between these scans, and by comparing correlation coefficients between the standard and per-fragment registration. Generally, subvolumes as small as 300 mm3 that were displaced up to 0.82 mm in x- or y-, or up to 1.64 mm in z-direction could be realigned correctly. For the fragments of all fractures, correlation coefficients were higher after per-fragment registration compared to standard registration. Most improvement was found in the unstable fracture and one fragment of the unstable fracture did not align correctly. This exploratory study showed that image registration of individual subvolumes, such as fracture fragments, is feasible in both stable and unstable fractures, and leads to better alignment of these fragments compared to an approach that is based on registration using the whole fractured region. This result is promising for additional analysis of bone formation and resorption in HR-pQCT studies on fracture healing.
| S-EPMC5526550 | biostudies-literature
Project description:The primary aim of this study is to investigate the performance difference of rigid and nonrigid registration schemes in matching corresponding pulmonary nodules depicted on sequential chest computed tomography (CT) examinations.A gradient descent based rigid registration algorithm with scaling was developed and it handled the involved geometric transformations (i.e., translation, rescaling, shearing, and rotation) separately instead of optimizing them in a single pass. Given two lung CT examinations, the scaling and translation parameters were simply estimated from the lung volume dimensions (e.g., size and mass center), while the rotation parameters were optimized progressively using gradient descent. To investigate the performance difference of rigid and nonrigid schemes in pulmonary nodule registration, the well-known nonrigid Demons algorithm was implemented and tested along with the developed schemes against 60 diverse low-dose clinical lung CT examinations with average 2-yr follow-up scans. A verified cancer and its correspondence in the follow-up scan as well as their spatial locations (mass center) were identified in each examination. In addition to the computational efficiency, the accuracy of these registration procedures was assessed by computing the Euclidean distances between the corresponding nodules after the registration. To demonstrate the advantage of the developed algorithm, the authors also implemented a fast iterative closest point (ICP) based rigid algorithm and compared their performance.Our experiments on the collected chest CT examinations showed that the nodule registration errors in 3D Euclidean distance for the developed rigid affine approach, the traditional ICP algorithm, and the refining nonrigid Demons algorithm were 9.6, 9.8, and 10.0 mm, respectively, and the corresponding computational costs in time were 5, 300, and 55 s, respectively.A rigid solution may be preferred in practice for the pulmonary nodule registration in longitudinal studies because of its relatively high efficiency and sufficient accuracy for the clinical need.
| S-EPMC3145224 | biostudies-other
Project description:PurposeDeformable image registration (DIR) can benefit from additional guidance using corresponding landmarks in the images. However, the benefits thereof are largely understudied, especially due to the lack of automatic landmark detection methods for three-dimensional (3D) medical images.ApproachWe present a deep convolutional neural network (DCNN), called DCNN-Match, that learns to predict landmark correspondences in 3D images in a self-supervised manner. We trained DCNN-Match on pairs of computed tomography (CT) scans containing simulated deformations. We explored five variants of DCNN-Match that use different loss functions and assessed their effect on the spatial density of predicted landmarks and the associated matching errors. We also tested DCNN-Match variants in combination with the open-source registration software Elastix to assess the impact of predicted landmarks in providing additional guidance to DIR.ResultsWe tested our approach on lower abdominal CT scans from cervical cancer patients: 121 pairs containing simulated deformations and 11 pairs demonstrating clinical deformations. The results showed significant improvement in DIR performance when landmark correspondences predicted by DCNN-Match were used in the case of simulated ( p = 0 e 0 ) as well as clinical deformations ( p = 0.030 ). We also observed that the spatial density of the automatic landmarks with respect to the underlying deformation affect the extent of improvement in DIR. Finally, DCNN-Match was found to generalize to magnetic resonance imaging scans without requiring retraining, indicating easy applicability to other datasets.ConclusionsDCNN-match learns to predict landmark correspondences in 3D medical images in a self-supervised manner, which can improve DIR performance.
| S-EPMC9957682 | biostudies-literature