Dataset Information

Using patient?specific phantoms to evaluate deformable image registration algorithms for adaptive radiation therapy

ABSTRACT: The quality of adaptive treatment planning depends on the accuracy of its underlying deformable image registration (DIR). The purpose of this study is to evaluate the performance of two DIR algorithms, B?spline?based deformable multipass (DMP) and deformable demons (Demons), implemented in a commercial software package. Evaluations were conducted using both computational and physical deformable phantoms. Based on a finite element method (FEM), a total of 11 computational models were developed from a set of CT images acquired from four lung and one prostate cancer patients. FEM generated displacement vector fields (DVF) were used to construct the lung and prostate image phantoms. Based on a fast?Fourier transform technique, image noise power spectrum was incorporated into the prostate image phantoms to create simulated CBCT images. The FEM?DVF served as a gold standard for verification of the two registration algorithms performed on these phantoms. The registration algorithms were also evaluated at the homologous points quantified in the CT images of a physical lung phantom. The results indicated that the mean errors of the DMP algorithm were in the range of 1.0~3.1mm for the computational phantoms and 1.9 mm for the physical lung phantom. For the computational prostate phantoms, the corresponding mean error was 1.0–1.9 mm in the prostate, 1.9–2.4 mm in the rectum, and 1.8–2.1 mm over the entire patient body. Sinusoidal errors induced by B?spline interpolations were observed in all the displacement profiles of the DMP registrations. Regions of large displacements were observed to have more registration errors. Patient?specific FEM models have been developed to evaluate the DIR algorithms implemented in the commercial software package. It has been found that the accuracy of these algorithms is patient?dependent and related to various factors including tissue deformation magnitudes and image intensity gradients across the regions of interest. This may suggest that DIR algorithms need to be verified for each registration instance when implementing adaptive radiation therapy. PACS numbers: 87.10.Kn, 87.55.km, 87.55.Qr, 87.57.nj

SUBMITTER: Stanley N

PROVIDER: S-EPMC5714646 | biostudies-literature | 2013 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:The quality of adaptive treatment planning depends on the accuracy of its underlying deformable image registration (DIR). The purpose of this study is to evaluate the performance of two DIR algorithms, B-spline-based deformable multipass (DMP) and deformable demons (Demons), implemented in a commercial software package. Evaluations were conducted using both computational and physical deformable phantoms. Based on a finite element method (FEM), a total of 11 computational models were developed from a set of CT images acquired from four lung and one prostate cancer patients. FEM generated displacement vector fields (DVF) were used to construct the lung and prostate image phantoms. Based on a fast-Fourier transform technique, image noise power spectrum was incorporated into the prostate image phantoms to create simulated CBCT images. The FEM-DVF served as a gold standard for verification of the two registration algorithms performed on these phantoms. The registration algorithms were also evaluated at the homologous points quantified in the CT images of a physical lung phantom. The results indicated that the mean errors of the DMP algorithm were in the range of 1.0 ~ 3.1 mm for the computational phantoms and 1.9 mm for the physical lung phantom. For the computational prostate phantoms, the corresponding mean error was 1.0-1.9 mm in the prostate, 1.9-2.4mm in the rectum, and 1.8-2.1 mm over the entire patient body. Sinusoidal errors induced by B-spline interpolations were observed in all the displacement profiles of the DMP registrations. Regions of large displacements were observed to have more registration errors. Patient-specific FEM models have been developed to evaluate the DIR algorithms implemented in the commercial software package. It has been found that the accuracy of these algorithms is patient dependent and related to various factors including tissue deformation magnitudes and image intensity gradients across the regions of interest. This may suggest that DIR algorithms need to be verified for each registration instance when implementing adaptive radiation therapy.

Project description:Purpose:Magnetic resonance-guided online adaptive radiation therapy (MRgOART) requires accurate and efficient segmentation. However, the performance of current autosegmentation tools is generally poor for magnetic resonance imaging (MRI) owing to day-to-day variations in image intensity and patient anatomy. In this study, we propose a patient-specific autosegmentation strategy using multiple-input deformable image registration (DIR; PASSMID) to improve segmentation accuracy and efficiency for MRgOART. Methods and materials:Longitudinal MRI scans acquired on a 1.5T MRI-Linac for 10 patients with abdominal cancer were used. The proposed PASSMID includes 2 steps: applying a patient-specific image processing pipeline to longitudinal MRI scans, and populating all contours from previous sessions/fractions to a new fractional MRI using multiple DIRs and combining the resulted contours using simultaneous truth and performance level estimation (STAPLE) to obtain the final consensus segmentation. Five contour propagation strategies were compared: planning computed tomography to fractional MRI scans through rigid body registration (RDR), pretreatment MRI to fractional MRI scans through RDR and DIR, and the proposed multi-input DIR/STAPLE without preprocessing, and the PASSMID. Dice similarity coefficient (DSC) and mean distance to agreement (MDA) with ground truth contours were calculated slice by slice to quantify the contour accuracy. A quantitative index, defined as the ratio of acceptable slices, was introduced using a criterion of DSC > 0.8 and MDA < 2 mm. Results:The proposed PASSMID performed well with an average 2-dimensional DSC/MDA of 0.94/1.78 mm, 0.93/1.04 mm, 0.93/1.06 mm, 0.93/1.14 mm, 0.92/0.83 mm, 0.84/1.53 mm, 0.86/2.39 mm, 0.81/2.49 mm, 0.72/5.48 mm, and 0.70/5.03 mm for the liver, left kidney, right kidney, spleen, aorta, pancreas, stomach, duodenum, small bowel, and colon, respectively. Starting from the third fractions, the contour accuracy was significantly improved with PASSMID compared with the single-DIR strategy (P < .05). The mean ratio of acceptable slices were 13.9%, 17.5%, 60.8%, 70.6%, and 71.8% for the 5 strategies, respectively. Conclusions:The proposed PASSMID solution, by combining image processing, multi-input DIRs, and STAPLE, can significantly improve the accuracy of autosegmentation for intrapatient MRI scans, reducing the time required for further contour editing, thereby facilitating the routine practice of MRgOART.

Project description:PurposeMagnetic resonance-guided online adaptive radiation therapy (MRgOART) requires accurate and efficient segmentation. However, the performance of current autosegmentation tools is generally poor for magnetic resonance imaging (MRI) owing to day-to-day variations in image intensity and patient anatomy. In this study, we propose a patient-specific autosegmentation strategy using multiple-input deformable image registration (DIR; PASSMID) to improve segmentation accuracy and efficiency for MRgOART.Methods and materialsLongitudinal MRI scans acquired on a 1.5T MRI-Linac for 10 patients with abdominal cancer were used. The proposed PASSMID includes 2 steps: applying a patient-specific image processing pipeline to longitudinal MRI scans, and populating all contours from previous sessions/fractions to a new fractional MRI using multiple DIRs and combining the resulted contours using simultaneous truth and performance level estimation (STAPLE) to obtain the final consensus segmentation. Five contour propagation strategies were compared: planning computed tomography to fractional MRI scans through rigid body registration (RDR), pretreatment MRI to fractional MRI scans through RDR and DIR, and the proposed multi-input DIR/STAPLE without preprocessing, and the PASSMID. Dice similarity coefficient (DSC) and mean distance to agreement (MDA) with ground truth contours were calculated slice by slice to quantify the contour accuracy. A quantitative index, defined as the ratio of acceptable slices, was introduced using a criterion of DSC > 0.8 and MDA < 2 mm.ResultsThe proposed PASSMID performed well with an average 2-dimensional DSC/MDA of 0.94/1.78 mm, 0.93/1.04 mm, 0.93/1.06 mm, 0.93/1.14 mm, 0.92/0.83 mm, 0.84/1.53 mm, 0.86/2.39 mm, 0.81/2.49 mm, 0.72/5.48 mm, and 0.70/5.03 mm for the liver, left kidney, right kidney, spleen, aorta, pancreas, stomach, duodenum, small bowel, and colon, respectively. Starting from the third fractions, the contour accuracy was significantly improved with PASSMID compared with the single-DIR strategy (P < .05). The mean ratio of acceptable slices were 13.9%, 17.5%, 60.8%, 70.6%, and 71.8% for the 5 strategies, respectively.ConclusionsThe proposed PASSMID solution, by combining image processing, multi-input DIRs, and STAPLE, can significantly improve the accuracy of autosegmentation for intrapatient MRI scans, reducing the time required for further contour editing, thereby facilitating the routine practice of MRgOART.

Project description:Benchmarking is a process in which standardized tests are used to assess system performance. The data produced in the process are important for comparative purposes, particularly when considering the implementation and quality assurance of DIR algorithms. In this work, five commercial DIR algorithms (MIM, Velocity, RayStation, Pinnacle, and Eclipse) were benchmarked using a set of 10 virtual phantoms. The phantoms were previously developed based on CT data collected from real head and neck patients. Each phantom includes a start of treatment CT dataset, an end of treatment CT dataset, and the ground-truth deformation vector field (DVF) which links them together. These virtual phantoms were imported into the commercial systems and registered through a deformable process. The resulting DVFs were compared to the ground-truth DVF to determine the target registration error (TRE) at every voxel within the image set. Real treatment plans were also recalculated on each end of treatment CT dataset and the dose transferred according to both the ground-truth and test DVFs. Dosimetric changes were assessed, and TRE was correlated with changes in the DVH of individual structures. In the first part of the study, results show mean TRE on the order of 0.5 mm to 3 mm for all phan-toms and ROIs. In certain instances, however, misregistrations were encountered which produced mean and max errors up to 6.8 mm and 22 mm, respectively. In the second part of the study, dosimetric error was found to be strongly correlated with TRE in the brainstem, but weakly correlated with TRE in the spinal cord. Several interesting cases were assessed which highlight the interplay between the direction and magnitude of TRE and the dose distribution, including the slope of dosimetric gradients and the distance to critical structures. This information can be used to help clinicians better implement and test their algorithms, and also understand the strengths and weaknesses of a dose adaptive approach.

Project description:PurposeDeformable image registration (DIR) is a key enabling technology in many diagnostic and therapeutic tasks, but often does not meet the required robustness and accuracy for supporting clinical tasks. This is in large part due to a lack of high-quality benchmark datasets by which new DIR algorithms can be evaluated. Our team was supported by the National Institute of Biomedical Imaging and Bioengineering to develop DIR benchmark dataset libraries for multiple anatomical sites, comprising of large numbers of highly accurate landmark pairs on matching blood vessel bifurcations. Here we introduce our lung CT DIR benchmark dataset library, which was developed to improve upon the number and distribution of landmark pairs in current public lung CT benchmark datasets.Acquisition and validation methodsThirty CT image pairs were acquired from several publicly available repositories as well as authors' institution with IRB approval. The data processing workflow included multiple steps: (1) The images were denoised. (2) Lungs, airways, and blood vessels were automatically segmented. (3) Bifurcations were directly detected on the skeleton of the segmented vessel tree. (4) Falsely identified bifurcations were filtered out using manually defined rules. (5) A DIR was used to project landmarks detected on the first image onto the second image of the image pair to form landmark pairs. (6) Landmark pairs were manually verified. This workflow resulted in an average of 1262 landmark pairs per image pair. Estimates of the landmark pair target registration error (TRE) using digital phantoms were 0.4 mm ± 0.3 mm.Data format and usage notesThe data is published in Zenodo at https://doi.org/10.5281/zenodo.8200423. Instructions for use can be found at https://github.com/deshanyang/Lung-DIR-QA.Potential applicationsThe dataset library generated in this work is the largest of its kind to date and will provide researchers with a new and improved set of ground truth benchmarks for quantitatively validating DIR algorithms within the lung.

Project description:Deformable image registration (DIR) is essential for adaptive radiotherapy (RT) for tumor sites subject to motion, changes in tumor volume, as well as changes in patient normal anatomy due to weight loss. Several methods have been published to evaluate DIR-related uncertainties but they are not widely adopted. The aim of this study was, therefore, to evaluate intra-patient DIR for two highly deformable organs-the bladder and the rectum-in prostate cancer RT using a quantitative metric based on multiple image registration, the distance discordance metric (DDM). Voxel-by-voxel DIR uncertainties of the bladder and rectum were evaluated using DDM on weekly CT scans of 38 subjects previously treated with RT for prostate cancer (six scans/subject). The DDM was obtained from group-wise B-spline registration of each patient's collection of repeat CT scans. For each structure, registration uncertainties were derived from DDM-related metrics. In addition, five other quantitative measures, including inverse consistency error (ICE), transitivity error (TE), Dice similarity (DSC) and volume ratios between corresponding structures from pre- and post- registered images were computed and compared with the DDM. The DDM varied across subjects and structures; DDMmean of the bladder ranged from 2 to 13 mm and from 1 to 11 mm for the rectum. There was a high correlation between DDMmean of the bladder and the rectum (Pearson's correlation coefficient, R p = 0.62). The correlation between DDMmean and the volume ratios post-DIR was stronger (R p = 0.51; 0.68) than the correlation with the TE (bladder: R p = 0.46; rectum: R p = 0.47), or the ICE (bladder: R p = 0.34; rectum: R p = 0.37). There was a negative correlation between DSC and DDMmean of both the bladder (R p = -0.23) and the rectum (R p = -0.63). The DDM uncertainty metric indicated considerable DIR variability across subjects and structures. Our results show a stronger correlation with volume ratios and with the DSC using DDM compared to using ICE and TE. The DDM has the potential to quantitatively identify regions of large DIR uncertainties and consequently identify anatomical/scan outliers. The DDM can, thus, be applied to improve the adaptive RT process for tumor sites subject to motion.

Project description:To develop a quality assurance (QA) workflow by using a robust, curated, manually segmented anatomic region-of-interest (ROI) library as a benchmark for quantitative assessment of different image registration techniques used for head and neck radiation therapy-simulation computed tomography (CT) with diagnostic CT coregistration.Radiation therapy-simulation CT images and diagnostic CT images in 20 patients with head and neck squamous cell carcinoma treated with curative-intent intensity-modulated radiation therapy between August 2011 and May 2012 were retrospectively retrieved with institutional review board approval. Sixty-eight reference anatomic ROIs with gross tumor and nodal targets were then manually contoured on images from each examination. Diagnostic CT images were registered with simulation CT images rigidly and by using four deformable image registration (DIR) algorithms: atlas based, B-spline, demons, and optical flow. The resultant deformed ROIs were compared with manually contoured reference ROIs by using similarity coefficient metrics (ie, Dice similarity coefficient) and surface distance metrics (ie, 95% maximum Hausdorff distance). The nonparametric Steel test with control was used to compare different DIR algorithms with rigid image registration (RIR) by using the post hoc Wilcoxon signed-rank test for stratified metric comparison.A total of 2720 anatomic and 50 tumor and nodal ROIs were delineated. All DIR algorithms showed improved performance over RIR for anatomic and target ROI conformance, as shown for most comparison metrics (Steel test, P < .008 after Bonferroni correction). The performance of different algorithms varied substantially with stratification by specific anatomic structures or category and simulation CT section thickness.Development of a formal ROI-based QA workflow for registration assessment demonstrated improved performance with DIR techniques over RIR. After QA, DIR implementation should be the standard for head and neck diagnostic CT and simulation CT allineation, especially for target delineation.

Dataset Information

Using patient?specific phantoms to evaluate deformable image registration algorithms for adaptive radiation therapy

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets