Dataset Information

Reliability of CT-based texture features: Phantom study.

ABSTRACT:

Objective

To determine the intra-, inter- and test-retest variability of CT-based texture analysis (CTTA) metrics.

Materials and methods

In this study, we conducted a series of CT imaging experiments using a texture phantom to evaluate the performance of a CTTA panel on routine abdominal imaging protocols. The phantom comprises of three different regions with various textures found in tumors. The phantom was scanned on two CT scanners viz. the Philips Brilliance 64 CT and Toshiba Aquilion Prime 160 CT scanners. The intra-scanner variability of the CTTA metrics was evaluated across imaging parameters such as slice thickness, field of view, post-reconstruction filtering, tube voltage, and tube current. For each scanner and scanning parameter combination, we evaluated the performance of eight different types of texture quantification techniques on a predetermined region of interest (ROI) within the phantom image using 235 different texture metrics. We conducted the repeatability (test-retest) and robustness (intra-scanner) test on both the scanners and the reproducibility test was conducted by comparing the inter-scanner differences in the repeatability and robustness to identify reliable CTTA metrics. Reliable metrics are those metrics that are repeatable, reproducible and robust.

Results

As expected, the robustness, repeatability and reproducibility of CTTA metrics are variably sensitive to various scanner and scanning parameters. Entropy of Fast Fourier Transform-based texture metrics was overall most reliable across the two scanners and scanning conditions. Post-processing techniques that reduce image noise while preserving the underlying edges associated with true anatomy or pathology bring about significant differences in radiomic reliability compared to when they were not used.

Conclusion

Following large-scale validation, identification of reliable CTTA metrics can aid in conducting large-scale multicenter CTTA analysis using sample sets acquired using different imaging protocols, scanners etc.

SUBMITTER: Varghese BA

PROVIDER: S-EPMC6698768 | biostudies-literature | 2019 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability of CT-based texture features: Phantom study.

Varghese Bino A BA Hwang Darryl D Cen Steven Y SY Levy Joshua J Liu Derek D Lau Christopher C Rivas Marielena M Desai Bhushan B Goodenough David J DJ Duddalwar Vinay A VA

Journal of applied clinical medical physics 20190620 8

<h4>Objective</h4>To determine the intra-, inter- and test-retest variability of CT-based texture analysis (CTTA) metrics.<h4>Materials and methods</h4>In this study, we conducted a series of CT imaging experiments using a texture phantom to evaluate the performance of a CTTA panel on routine abdominal imaging protocols. The phantom comprises of three different regions with various textures found in tumors. The phantom was scanned on two CT scanners viz. the Philips Brilliance 64 CT and Toshiba ...[more]

PMID: 31222919

Similar Datasets

Project description:ObjectiveThe objective of this study was to evaluate the robustness and reproducibility of computed tomography-based texture analysis (CTTA) metrics extracted from CT images of a customized texture phantom built for assessing the association of texture metrics to three-dimensional (3D) printed progressively increasing textural heterogeneity.Materials and methodsA custom-built 3D-printed texture phantom comprising of six texture patterns was used to evaluate the robustness and reproducibility of a radiomics panel under a variety of routine abdominal imaging protocols. The phantom was scanned on four CT scanners (Philips, Canon, GE, and Siemens) to assess reproducibility. The robustness assessment was conducted by imaging the texture phantom across different CT imaging parameters such as slice thickness, field of view (FOV), tube voltage, and tube current for each scanner. The texture panel comprised of 387 features belonging to 15 subgroups of texture extraction methods (e.g., Gray-level Co-occurrence Matrix: GLCM). Twelve unique image settings were tested on all the four scanners (e.g., FOV125). Interclass correlation two-way mixed with absolute agreement (ICC3) was used to assess the robustness and reproducibility of radiomic features. Linear regression was used to test the association between change in radiomic features and increased texture heterogeneity. Results were summarized in heat maps.ResultsA total of 5612 (23.2%) of 24 090 features showed excellent robustness and reproducibility (ICC ≥ 0.9). Intensity, GLCM 3D, and gray-level run length matrix (GLRLM) 3D features showed best performance. Among imaging variables, changes in slice thickness affected all metrics more intensely compared to other imaging variables in reducing the ICC3. From the analysis of linear trend effect of the CTTA metrics, the top three metrics with high linear correlations across all scanners and scanning settings were from the GLRLM 2D/3D and discrete cosine transform (DCT) texture family.ConclusionThe choice of scanner and imaging protocols affect texture metrics. Furthermore, not all CTTA metrics have a linear association with linearly varying texture patterns.

Project description:The purpose of this study was to explore the effects of CT slice thickness, reconstruction algorithm, and radiation dose on quantification of CT features to characterize lung nodules using a chest phantom. Spherical lung nodule phantoms of known densities (-630 and + 100 HU) were inserted into an anthropomorphic thorax phantom. CT scan was performed ten times with relocations. CT data were reconstructed using 12 different imaging settings; three different slice thicknesses of 1.25, 2.5, and 5.0 mm, two reconstruction kernels of sharp and standard, and two radiation dose of 30 mAs and 12 mAs. Lesions were segmented using a semiautomated method. Twenty representative CT quantitative features representing CT density and texture were compared using multiple regression analysis. In 100 HU nodule phantoms, 18 and 19 among 20 computer features showed significant difference between different mAs and reconstruction algorithms, respectively (p ≤ 0.05). 20, 19, and 19 computer features showed difference between slice thickness of 5.0 vs 1.25, 5.0 vs 2.5, and 2.5 vs 1.25 mm, respectively (p ≤ 0.05). In -630 HU nodule phantoms, 18 and 19 showed significant difference between different mAs and reconstruction algorithms, respectively (p ≤ 0.05). 18, 11, and 17 computer features showed difference between slice thickness of 5.0 vs 1.25, 5.0 vs 2.5, and 2.5 vs 1.25 mm, respectively (p ≤ 0.05). When comparing the absolute value of regression coefficient, the effect of slice thickness in 100 HU nodule and reconstruction algorithm in -630 HU nodule was greater than the effect of remaining scan parameters. The slice thickness, mAs, and reconstruction algorithm had a significant impact on the quantitative image features. In clinical studies involving deep learning or radiomics, it should be noted that differences in values can occur when using computer features obtained from different CT scan parameters in combination. Therefore, when interpreting the statistical analysis results, it is necessary to reflect the difference in the computer features depending on the scan parameters.

Project description:BackgroundExisting studies have demonstrated that imaging parameters may affect radiomic features. However, the influence of feature calculating parameters has been overlooked. The purpose of this study is to investigate the influence of feature calculating parameters (gray-level range and bin size) on the reproducibility of CT radiomic features.MethodsThirty-six CT scans from an anthropomorphic thoracic phantom were acquired with different imaging parameters including effective dose, pitch, slice thicknesses and reconstruction kernels. The influence of feature calculating parameters was investigated in terms of three gray-level ranges and eleven gray-level bin sizes. Feature reproducibility was assessed by the intraclass correlation coefficient (ICC) with the cutoff value of 0.8 and the coefficient of variation (CV) with the cutoff value of 20%. The agreements of reproducible features in different ranges and bin sizes were analyzed by Kendall's W test and Kappa test. The proportions of reproducible features, in terms of two calculating, four imaging and two segmentation parameters, were evaluated using Cochran's Q test and Dunn's test.ResultsFor the three gray-level ranges, 50% (44/88) of features were reproducible with a perfect agreement (Kendall's W coefficient 0.844, P<0.001). Of the 72 features that may be influenced by gray-level bin size, 33.3% (24/72) were reproducible for 11 bin sizes with a perfect agreement (Kendall's W coefficient 0.879, P<0.001). For the proportions of reproducible features, there was no statistically significant difference among three ranges (P=0.420), but there was among eleven bin sizes (P=0.013). The proportions of reproducible features in feature calculating parameters were statistically significantly lower than those in imaging parameters (adjusted P<0.05).ConclusionsFeature calculating parameters may have a greater influence than imaging parameters on the reproducibility of CT radiomic features, which should be given special attention in clinical applications.

Project description:PurposeTo design a digital phantom data set for computed tomography (CT) perfusion and perfusion-weighted imaging on the basis of the widely accepted tracer kinetic theory in which the true values of cerebral blood flow (CBF), cerebral blood volume (CBV), mean transit time (MTT), and tracer arrival delay are known and to evaluate the accuracy and reliability of postprocessing programs using this digital phantom.Materials and methodsA phantom data set was created by generating concentration-time curves reflecting true values for CBF (2.5-87.5 mL/100 g per minute), CBV (1.0-5.0 mL/100 g), MTT (3.4-24 seconds), and tracer delays (0-3.0 seconds). These curves were embedded in human brain images. The data were analyzed by using 13 algorithms each for CT and magnetic resonance (MR), including five commercial vendors and five academic programs. Accuracy was assessed by using the Pearson correlation coefficient (r) for true values. Delay-, MTT-, or CBV-dependent errors and correlations between time to maximum of residue function (Tmax) were also evaluated.ResultsIn CT, CBV was generally well reproduced (r > 0.9 in 12 algorithms), but not CBF and MTT (r > 0.9 in seven and four algorithms, respectively). In MR, good correlation (r > 0.9) was observed in one-half of commercial programs, while all academic algorithms showed good correlations for all parameters. Most algorithms had delay-dependent errors, especially for commercial software, as well as CBV dependency for CBF or MTT calculation and MTT dependency for CBV calculation. Correlation was good in Tmax except for one algorithm.ConclusionThe digital phantom readily evaluated the accuracy and characteristics of the CT and MR perfusion analysis software. All commercial programs had delay-induced errors and/or insufficient correlations with true values, while academic programs for MR showed good correlations with true values.Supplemental materialhttp://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12112618/-/DC1.

Project description:In this study we compared the image quality of a synchrotron radiation (SR) breast computed tomography (BCT) system with a clinical BCT in terms of contrast-to-noise ratio (CNR), signal-to-noise ratio (SNR), noise power spectrum (NPS), spatial resolution and detail visibility. A breast phantom consisting of several slabs of breast-adipose equivalent material with different embedded targets (i.e., masses, fibers and calcifications) was used. Phantom images were acquired using a dedicated BCT system installed at the Radboud University Medical Center (Nijmegen, The Netherlands) and the SR BCT system at the SYRMEP beamline of Elettra SR facility (Trieste, Italy) based on a photon-counting detector. Images with the SR setup were acquired mimicking the clinical BCT conditions (i.e., energy of 30?keV and radiation dose of 6.5 mGy). Images were reconstructed with an isotropic cubic voxel of 273?µm for the clinical BCT, while for the SR setup two phase-retrieval (PhR) kernels (referred to as "smooth" and "sharp") were alternatively applied to each projection before tomographic reconstruction, with voxel size of 57?×?57?×?50 µm3. The CNR for the clinical BCT system can be up to 2-times higher than SR system, while the SNR can be 3-times lower than SR system, when the smooth PhR is used. The peak frequency of the NPS for the SR BCT is 2 to 4-times higher (0.9?mm-1 and 1.4?mm-1 with smooth and sharp PhR, respectively) than the clinical BCT (0.4?mm-1). The spatial resolution (MTF10%) was estimated to be 1.3 lp/mm for the clinical BCT, and 5.0 lp/mm and 6.7 lp/mm for the SR BCT with the smooth and sharp PhR, respectively. The smallest fiber visible in the SR BCT has a diameter of 0.15?mm, while for the clinical BCT is 0.41?mm. Calcification clusters with diameter of 0.13?mm are visible in the SR BCT, while the smallest diameter for the clinical BCT is 0.29?mm. As expected, the image quality of the SR BCT outperforms the clinical BCT system, providing images with higher spatial resolution and SNR, and with finer granularity. Nevertheless, this study assesses the image quality gap quantitatively, giving indications on the benefits associated with SR BCT and providing a benchmarking basis for its clinical implementation. In addition, SR-based studies can provide a gold-standard in terms of achievable image quality, constituting an upper-limit to the potential clinical development of a given technique.

Dataset Information

Reliability of CT-based texture features: Phantom study.

Objective

Materials and methods

Results

Conclusion

Publications

Reliability of CT-based texture features: Phantom study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets