A method to map errors in the deformable registration of 4DCT images.
Ontology highlight
ABSTRACT:
SUBMITTER: Vaman C
PROVIDER: S-EPMC2973991 | biostudies-other | 2010 Nov
REPOSITORIES: biostudies-other
Similar Datasets
Project description:The aim of deformable brain image registration is to align anatomical structures, which can potentially vary with large and complex deformations. Anatomical structures vary in size and shape, requiring the registration algorithm to estimate deformation fields at various degrees of complexity. Here, we present a difficulty-aware model based on an attention mechanism to automatically identify hard-to-register regions, allowing better estimation of large complex deformations. The difficulty-aware model is incorporated into a cascaded neural network consisting of three sub-networks to fully leverage both global and local contextual information for effective registration. The first sub-network is trained at the image level to predict a coarse-scale deformation field, which is then used for initializing the subsequent sub-network. The next two sub-networks progressively optimize at the patch level with different resolutions to predict a fine-scale deformation field. Embedding difficulty-aware learning into the hierarchical neural network allows harder patches to be identified in the deeper sub-networks at higher resolutions for refining the deformation field. Experiments conducted on four public datasets validate that our method achieves promising registration accuracy with better preservation of topology, compared with state-of-the-art registration methods.
| S-EPMC7725910 | biostudies-literature
Project description:Convolutional neural networks (CNNs) offer a promising means to achieve fast deformable image registration with accuracy comparable to conventional, physics-based methods. A persistent question with CNN methods, however, is whether they will be able to generalize to data outside of the training set. We investigated this question of mismatch between train and test data with respect to first- and second-order image statistics (e.g., spatial resolution, image noise, and power spectrum). A UNet-based architecture was built and trained on simulated CT images for various conditions of image noise (dose), spatial resolution, and deformation magnitude. Target registration error was measured as a function of the difference in statistical properties between the test and training data. Generally, registration error is minimized when the training data exactly match the statistics of the test data; however, networks trained with data exhibiting a diversity in statistical characteristics generalized well across the range of statistical conditions considered. Furthermore, networks trained on simulated image content with first- and second-order statistics selected to match that of real anatomical data were shown to provide reasonable registration performance on real anatomical content, offering potential new means for data augmentation. Characterizing the behavior of a CNN in the presence of statistical mismatch is an important step in understanding how these networks behave when deployed on new, unobserved data. Such characterization can inform decisions on whether retraining is necessary and can guide the data collection and/or augmentation process for training.
| S-EPMC6916745 | biostudies-literature
Project description:Joint morphogenesis is the process during which distinct and functional joint shapes emerge during pre- and post-natal joint development. In this study, a repeatable semi-automatic protocol capable of providing a 3D realistic developmental map of the prenatal mouse knee joint was designed by combining Optical Projection Tomography imaging (OPT) and a deformable registration algorithm (Sheffield Image Registration toolkit, ShIRT). Eleven left limbs of healthy murine embryos were scanned with OPT (voxel size: 14.63?m) at two different stages of development: Theiler stage (TS) 23 (approximately 14.5 embryonic days) and 24 (approximately 15.5 embryonic days). One TS23 limb was used to evaluate the precision of the displacement predictions for this specific case. The remaining limbs were then used to estimate Developmental Tibia and Femur Maps. Acceptable uncertainties of the displacement predictions computed from repeated images were found for both epiphyses (between 1.3?m and 1.4?m for the proximal tibia and between 0.7?m and 1.0?m for the femur, along all directions). The protocol was found to be reproducible with maximum Modified Housdorff Distance (MHD) differences equal to 1.9 ?m and 1.5 ?m for the tibial and femoral epiphyses respectively. The effect of the initial shape of the rudiment affected the developmental maps with MHD of 21.7 ?m and 21.9 ?m for the tibial and femoral epiphyses respectively, which correspond to 1.4 and 1.5 times the voxel size. To conclude, this study proposes a repeatable semi-automatic protocol capable of providing mean 3D realistic developmental map of a developing rudiment allowing researchers to study how growth and adaptation are directed by biological and mechanobiological factors.
| S-EPMC6317797 | biostudies-literature
Project description:PURPOSE:Magnetic resonance imaging (MRI) provides noninvasive evaluation of patient's anatomy without using ionizing radiation. Due to this and the high soft-tissue contrast, MRI use has increased and has potential for use in longitudinal studies where changes in patients' anatomy or tumors at different time points are compared. Deformable image registration can be useful for these studies. Here, we describe two datasets that can be used to evaluate the registration accuracy of systems for MR images, as it cannot be assumed to be the same as that measured on CT images. ACQUISITION AND VALIDATION METHODS:Two sets of images were created to test registration accuracy. (a) A porcine phantom was created by placing ten 0.35-mm gold markers into porcine meat. The porcine phantom was immobilized in a plastic container with movable dividers. T1-weighted, T2-weighted, and CT images were acquired with the porcine phantom compressed in four different ways. The markers were not visible on the MR images, due to the selected voxel size, so they did not interfere with the measured registration accuracy, while the markers were visible on the CT images and were used to identify the known deformation between positions. (b) Synthetic images were created using 28 head and neck squamous cell carcinoma patients who had MR scans pre-, mid-, and postradiotherapy treatment. An inter- and intrapatient variation model was created using these patient scans. Four synthetic pretreatment images were created using the interpatient model, and four synthetic post-treatment images were created for each of the pretreatment images using the intrapatient model. DATA FORMAT AND USAGE NOTES:The T1-weighted, T2-weighted, and CT scans of the porcine phantom in the four positions are provided. Four T1-weighted synthetic pretreatment images each with four synthetic post-treatment images, and four T2-weighted synthetic pretreatment images each with four synthetic post-treatment images are provided. Additionally, the applied deformation vector fields to generate the synthetic post-treatment images are provided. The data are available on TCIA under the collection MRI-DIR. POTENTIAL APPLICATIONS:The proposed database provides two sets of images (one acquired and one computer generated) for use in evaluating deformable image registration accuracy. T1- and T2-weighted images are available for each technique as the different image contrast in the two types of images may impact the registration accuracy.
| S-EPMC6331282 | biostudies-literature
Project description:PURPOSE:The deformable registration of pulmonary computed tomography images before and after radiation therapy is challenging due to anatomic changes from radiation fibrosis. We hypothesize that a line-enhanced registration algorithm can reduce landmark error over the entire lung, including the irradiated regions, when compared to an intensity-based deformable registration algorithm. MATERIALS:Two intensity-based B-spline deformable registration algorithms of pre-radiation therapy and post-radiation therapy images were compared. The first was a control intensity-based algorithm that utilized computed tomography images without modification. The second was a line enhancement algorithm that incorporated a Hessian-based line enhancement filter prior to deformable image registration. Registrations were evaluated based on the landmark error between user-identified landmark pairs and the overlap ratio. RESULTS:Twenty-one patients with pre-radiation therapy and post-radiation therapy scans were included. The median time interval between scans was 1.2 years (range: 0.3-3.3 years). Median landmark errors for the line enhancement algorithm were significantly lower than those for the control algorithm over the entire lung (1.67 vs 1.83 mm; P < .01), as well as within the 0 to 5 Gy (1.40 vs 1.57; P < .01) and >5 Gy (2.25 vs 3.31; P < .01) dose intervals. The median lung mask overlap ratio for the line enhancement algorithm (96.2%) was greater than that for the control algorithm (95.8%; P < .01). Landmark error within the >5 Gy dose interval demonstrated a significant inverse relationship with post-radiation therapy fibrosis enhancement after line enhancement filtration (Pearson correlation coefficient = -0.48; P = .03). CONCLUSION:The line enhancement registration algorithm is a promising method for registering images before and after radiation therapy.
| S-EPMC5784562 | biostudies-literature
Project description:A deformable registration method capable of accounting for missing tissue (e.g., excision) is reported for application in cone-beam CT (CBCT)-guided surgical procedures. Excisions are identified by a segmentation step performed simultaneous to the registration process. Tissue excision is explicitly modeled by increasing the dimensionality of the deformation field to allow motion beyond the dimensionality of the image. The accuracy of the model is tested in phantom, simulations, and cadaver models.A variant of the Demons deformable registration algorithm is modified to include excision segmentation and modeling. Segmentation is performed iteratively during the registration process, with initial implementation using a threshold-based approach to identify voxels corresponding to "tissue" in the moving image and "air" in the fixed image. With each iteration of the Demons process, every voxel is assigned a probability of excision. Excisions are modeled explicitly during registration by increasing the dimensionality of the deformation field so that both deformations and excisions can be accounted for by in- and out-of-volume deformations, respectively. The out-of-volume (i.e., fourth) component of the deformation field at each voxel carries a magnitude proportional to the excision probability computed in the excision segmentation step. The registration accuracy of the proposed "extra-dimensional" Demons (XDD) and conventional Demons methods was tested in the presence of missing tissue in phantom models, simulations investigating the effect of excision size on registration accuracy, and cadaver studies emulating realistic deformations and tissue excisions imparted in CBCT-guided endoscopic skull base surgery.Phantom experiments showed the normalized mutual information (NMI) in regions local to the excision to improve from 1.10 for the conventional Demons approach to 1.16 for XDD, and qualitative examination of the resulting images revealed major differences: the conventional Demons approach imparted unrealistic distortions in areas around tissue excision, whereas XDD provided accurate "ejection" of voxels within the excision site and maintained the registration accuracy throughout the rest of the image. Registration accuracy in areas far from the excision site (e.g., > ∼5 mm) was identical for the two approaches. Quantitation of the effect was consistent in analysis of NMI, normalized cross-correlation (NCC), target registration error (TRE), and accuracy of voxels ejected from the volume (true-positive and false-positive analysis). The registration accuracy for conventional Demons was found to degrade steeply as a function of excision size, whereas XDD was robust in this regard. Cadaver studies involving realistic excision of the clivus, vidian canal, and ethmoid sinuses demonstrated similar results, with unrealistic distortion of anatomy imparted by conventional Demons and accurate ejection and deformation for XDD.Adaptation of the Demons deformable registration process to include segmentation (i.e., identification of excised tissue) and an extra dimension in the deformation field provided a means to accurately accommodate missing tissue between image acquisitions. The extra-dimensional approach yielded accurate "ejection" of voxels local to the excision site while preserving the registration accuracy (typically subvoxel) of the conventional Demons approach throughout the rest of the image. The ability to accommodate missing tissue volumes is important to application of CBCT for surgical guidance (e.g., skull base drillout) and may have application in other areas of CBCT guidance.
| S-EPMC3443194 | biostudies-other
Project description:Deformable image registration is a fundamental task in medical image processing. Among its most important applications, one may cite: 1) multi-modality fusion, where information acquired by different imaging devices or protocols is fused to facilitate diagnosis and treatment planning; 2) longitudinal studies, where temporal structural or anatomical changes are investigated; and 3) population modeling and statistical atlases used to study normal anatomical variability. In this paper, we attempt to give an overview of deformable registration methods, putting emphasis on the most recent advances in the domain. Additional emphasis has been given to techniques applied to medical images. In order to study image registration methods in depth, their main components are identified and studied independently. The most recent techniques are presented in a systematic fashion. The contribution of this paper is to provide an extensive account of registration techniques in a systematic manner.
| S-EPMC3745275 | biostudies-other
Project description:To develop a statistical sampling procedure for spatially-correlated uncertainties in deformable image registration and then use it to demonstrate their effect on daily dose mapping.Sequential daily CT studies are acquired to map anatomical variations prior to fractionated external beam radiotherapy. The CTs are deformably registered to the planning CT to obtain displacement vector fields (DVFs). The DVFs are used to accumulate the dose delivered each day onto the planning CT. Each DVF has spatially-correlated uncertainties associated with it. Principal components analysis (PCA) is applied to measured DVF error maps to produce decorrelated principal component modes of the errors. The modes are sampled independently and reconstructed to produce synthetic registration error maps. The synthetic error maps are convolved with dose mapped via deformable registration to model the resulting uncertainty in the dose mapping. The results are compared to the dose mapping uncertainty that would result from uncorrelated DVF errors that vary randomly from voxel to voxel.The error sampling method is shown to produce synthetic DVF error maps that are statistically indistinguishable from the observed error maps. Spatially-correlated DVF uncertainties modeled by our procedure produce patterns of dose mapping error that are different from that due to randomly distributed uncertainties.Deformable image registration uncertainties have complex spatial distributions. The authors have developed and tested a method to decorrelate the spatial uncertainties and make statistical samples of highly correlated error maps. The sample error maps can be used to investigate the effect of DVF uncertainties on daily dose mapping via deformable image registration. An initial demonstration of this methodology shows that dose mapping uncertainties can be sensitive to spatial patterns in the DVF uncertainties.
| S-EPMC3267790 | biostudies-other
Project description:Respiratory motion introduces uncertainties in tumor location and lung deformation, which often results in difficulties calculating dose distributions in thoracic radiation therapy. Deformable image registration (DIR) has ability to describe respiratory-induced lung deformation, with which the radiotherapy techniques can deliver high dose to tumors while reducing radiation in surrounding normal tissue. The authors' goal is to propose a DIR method to overcome two main challenges of the previous biomechanical model for lung deformation, i.e., the requirement of precise boundary conditions and the lack of elasticity distribution.As opposed to typical methods in biomechanical modeling, the authors' method assumes that lung tissue is inhomogeneous. The authors thus propose a DIR method combining a varying intensity flow (VF) block-matching algorithm with the finite element method (FEM) for lung deformation from end-expiratory phase to end-inspiratory phase. Specifically, the lung deformation is formulated as a stress-strain problem, for which the boundary conditions are obtained from the VF block-matching algorithm and the element specific Young's modulus distribution is estimated by solving an optimization problem with a quasi-Newton method. The authors measure the spatial accuracy of their nonuniform model as well as a standard uniform model by applying both methods to four-dimensional computed tomography images of six patients. The spatial errors produced by the registrations are computed using large numbers (>1000) of expert-determined landmark point pairs.In right-left, anterior-posterior, and superior-inferior directions, the mean errors (standard deviation) produced by the standard uniform FEM model are 1.42(1.42), 1.06(1.05), and 1.98(2.10) mm whereas the authors' proposed nonuniform model reduces these errors to 0.59(0.61), 0.52(0.51), and 0.78(0.89) mm. The overall 3D mean errors are 3.05(2.36) and 1.30(0.97) mm for the uniform and nonuniform models, respectively.The results indicate that the proposed nonuniform model can simulate patient-specific and position-specific lung deformation via spatially varying Young's modulus estimates, which improves registration accuracy compared to the uniform model and is therefore a more suitable description of lung deformation.
| S-EPMC3716779 | biostudies-other
Project description:US image registration is an important task e.g. in Computer Aided Surgery. Due to tissue deformation occurring between pre-operative and interventional images often deformable registration is necessary. We present a registration method focused on surface structures (i.e. saliencies) of soft tissues like organ capsules or vessels. The main concept follows the idea of representative landmarks (so called leading points). These landmarks represent saliencies in each image in a certain region of interest. The determination of deformation was based on a geometric model assuming that saliencies could locally be described by planes. These planes were calculated from the landmarks using two dimensional linear regression. Once corresponding regions in both images were found, a displacement vector field representing the local deformation was computed. Finally, the deformed image was warped to match the pre-operative image. For error calculation we used a phantom representing the urinary bladder and the prostate. The phantom could be deformed to mimic tissue deformation. Error calculation was done using corresponding landmarks in both images. The resulting target registration error of this procedure amounted to 1.63 mm. With respect to patient data a full deformable registration was performed on two 3D-US images of the abdomen. The resulting mean distance error was 2.10 ± 0.66 mm compared to an error of 2.75 ± 0.57 mm from a simple rigid registration. A two-sided paired t-test showed a p-value < 0.001. We conclude that the method improves the results of the rigid registration considerably. Provided an appropriate choice of the filter there are many possible fields of applications.
| S-EPMC6420033 | biostudies-literature