Reliability of Radiomic Features Across Multiple Abdominal CT Image Acquisition Settings: A Pilot Study Using ACR CT Phantom.
Ontology highlight
ABSTRACT:
SUBMITTER: Lu L
PROVIDER: S-EPMC6403036 | biostudies-literature | 2019 Mar
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The reliability of radiomics features (RFs) is crucial for quantifying tumour heterogeneity. We assessed the influence of imaging, segmentation, and processing conditions (quantization range, bin number, signal-to-noise ratio [SNR], and unintended outliers) on RF measurement. Low SNR and unintended outliers increased the standard deviation and mean values of histograms to calculate the first-order RFs. Variations in imaging processing conditions significantly altered the shape of the probability distribution (centre of distribution, extent of dispersion, and segmentation of probability clusters) in second-order RF matrices (i.e. grey-level co-occurrence and grey-level run length), thereby eventually causing fluctuations in RF estimation. Inconsistent imaging and processing conditions decreased the number of reliably measured RFs in terms of individual RF values (intraclass correlation coefficient ≥0.75) and inter-lesion RF ratios (coefficient of variation <15%). No RF could be reliably estimated under inconsistent SNR and inclusion of outlier conditions. By contrast, with high SNR and no outliers, all first-order RFs, 11 (42%) grey-level co-occurrence RFs and five (42%) grey-level run length RFs showed acceptable reliability. Our study suggests that optimization of SNR, exclusion of outliers, and application of relevant quantization range and bin number should be performed to ensure the robustness of radiomics studies assessing tumor heterogeneity.
| S-EPMC7052198 | biostudies-literature
Project description:ObjectiveTo determine the intra-, inter- and test-retest variability of CT-based texture analysis (CTTA) metrics.Materials and methodsIn this study, we conducted a series of CT imaging experiments using a texture phantom to evaluate the performance of a CTTA panel on routine abdominal imaging protocols. The phantom comprises of three different regions with various textures found in tumors. The phantom was scanned on two CT scanners viz. the Philips Brilliance 64 CT and Toshiba Aquilion Prime 160 CT scanners. The intra-scanner variability of the CTTA metrics was evaluated across imaging parameters such as slice thickness, field of view, post-reconstruction filtering, tube voltage, and tube current. For each scanner and scanning parameter combination, we evaluated the performance of eight different types of texture quantification techniques on a predetermined region of interest (ROI) within the phantom image using 235 different texture metrics. We conducted the repeatability (test-retest) and robustness (intra-scanner) test on both the scanners and the reproducibility test was conducted by comparing the inter-scanner differences in the repeatability and robustness to identify reliable CTTA metrics. Reliable metrics are those metrics that are repeatable, reproducible and robust.ResultsAs expected, the robustness, repeatability and reproducibility of CTTA metrics are variably sensitive to various scanner and scanning parameters. Entropy of Fast Fourier Transform-based texture metrics was overall most reliable across the two scanners and scanning conditions. Post-processing techniques that reduce image noise while preserving the underlying edges associated with true anatomy or pathology bring about significant differences in radiomic reliability compared to when they were not used.ConclusionFollowing large-scale validation, identification of reliable CTTA metrics can aid in conducting large-scale multicenter CTTA analysis using sample sets acquired using different imaging protocols, scanners etc.
| S-EPMC6698768 | biostudies-literature
Project description:ObjectivesRadiomics utilizes quantitative image features (QIFs) to characterize tumor phenotype. In practice, radiological images are obtained from different vendors' equipment using various imaging acquisition settings. Our objective was to assess the inter-setting agreement of QIFs computed from CT images by varying two parameters, slice thickness and reconstruction algorithm.Materials and methodsCT images from an IRB-approved/HIPAA-compliant study assessing thirty-two lung cancer patients were included for the analysis. Each scan's raw data were reconstructed into six imaging series using combinations of two reconstruction algorithms (Lung[L] and Standard[S]) and three slice thicknesses (1.25mm, 2.5mm and 5mm), i.e., 1.25L, 1.25S, 2.5L, 2.5S, 5L and 5S. For each imaging-setting, 89 well-defined QIFs were computed for each of the 32 tumors (one tumor per patient). The six settings led to 15 inter-setting comparisons (combinatorial pairs). To reduce QIF redundancy, hierarchical clustering was done. Concordance correlation coefficients (CCCs) were used to assess inter-setting agreement of the non-redundant feature groups. The CCC of each group was assessed by averaging CCCs of QIFs in the group.ResultsTwenty-three non-redundant feature groups were created. Across all feature groups, the best inter-setting agreements (CCCs>0.8) were 1.25S vs 2.5S, 1.25L vs 2.5L, and 2.5S vs 5S; the worst (CCCs<0.51) belonged to 1.25L vs 5S and 2.5L vs 5S. Eight of the feature groups related to size, shape, and coarse texture had an average CCC>0.8 across all imaging settings.ConclusionsVarying degrees of inter-setting disagreements of QIFs exist when features are computed from CT images reconstructed using different algorithms and slice thicknesses. Our findings highlight the importance of harmonizing imaging acquisition for obtaining consistent QIFs to study tumor imaging phonotype.
| S-EPMC5199063 | biostudies-literature
Project description:The purpose of this study was to explore the effects of CT slice thickness, reconstruction algorithm, and radiation dose on quantification of CT features to characterize lung nodules using a chest phantom. Spherical lung nodule phantoms of known densities (-630 and + 100 HU) were inserted into an anthropomorphic thorax phantom. CT scan was performed ten times with relocations. CT data were reconstructed using 12 different imaging settings; three different slice thicknesses of 1.25, 2.5, and 5.0 mm, two reconstruction kernels of sharp and standard, and two radiation dose of 30 mAs and 12 mAs. Lesions were segmented using a semiautomated method. Twenty representative CT quantitative features representing CT density and texture were compared using multiple regression analysis. In 100 HU nodule phantoms, 18 and 19 among 20 computer features showed significant difference between different mAs and reconstruction algorithms, respectively (p ≤ 0.05). 20, 19, and 19 computer features showed difference between slice thickness of 5.0 vs 1.25, 5.0 vs 2.5, and 2.5 vs 1.25 mm, respectively (p ≤ 0.05). In -630 HU nodule phantoms, 18 and 19 showed significant difference between different mAs and reconstruction algorithms, respectively (p ≤ 0.05). 18, 11, and 17 computer features showed difference between slice thickness of 5.0 vs 1.25, 5.0 vs 2.5, and 2.5 vs 1.25 mm, respectively (p ≤ 0.05). When comparing the absolute value of regression coefficient, the effect of slice thickness in 100 HU nodule and reconstruction algorithm in -630 HU nodule was greater than the effect of remaining scan parameters. The slice thickness, mAs, and reconstruction algorithm had a significant impact on the quantitative image features. In clinical studies involving deep learning or radiomics, it should be noted that differences in values can occur when using computer features obtained from different CT scan parameters in combination. Therefore, when interpreting the statistical analysis results, it is necessary to reflect the difference in the computer features depending on the scan parameters.
| S-EPMC6381551 | biostudies-literature
Project description:The American College of Radiology (ACR) Computed Tomography (CT) Accreditation Program requires submission of phantom scans acquired with the ACR accreditation phantom. There is a known issue with some wide-beam scanners in which the Hounsfield unit (HU) value of water may be correct when using the scanner manufacturer's phantom, but will be out of range in some scan modes when scanning the accreditation phantom. The phantom manufacturer has developed a product known as Extension Plates to eliminate the water HU value issue. The purpose of this technical note is to evaluate the effectiveness of the Extension Plates in alleviating the water HU issue. The ACR phantom was scanned on nine different CT scanners representing four CT manufacturers at eight different facilities. Scanner models included 16- and 64-channel geometries from each manufacturer. All scanners passed routine daily water HU testing per the manufacturer's instructions. The accreditation phantom was scanned in helical and axial modes both with and without the Extension Plates present. Regions of interest were placed on the linearity test objects as well as the water HU test object in Module 1 of the phantom. Mean values were recorded and compared with the acceptable ranges specified by the ACR accreditation phantom testing instructions. Water HU values failed for one scanner model when scanned in helical mode using the widest collimation available and the Extension Plates were not present. All other scanner models passed the water HU linearity test with or without the Extension Plates in both axial and helical scan modes. Three of the four manufacturers tested failed the linearity test for different materials. The presence of the Extension Plates only affected the HU measurement for the water test object.
| S-EPMC5690207 | biostudies-literature
Project description:We aimed to evaluate radiomic features' stability across different region of interest (ROI) sizes in CT and MR images. We chose a phantom with a homogenous internal structure so no differences for a feature extracted from ROIs of different sizes would be expected. For this, we scanned a plastic cup filled with sodium chloride solution ten times in CT and per MR sequence (T1-weighted-gradient-echo and T2-weighted-turbo-inversion-recovery-magnitude). We placed sphere-shaped ROIs of different diameters (4, 8, and 16 mm, and 4, 8, and 16 pixels) into the phantom's center. Features were extracted using PyRadiomics. We assessed feature stability across ROI sizes with overall concordance correlation coefficients (OCCCs). Differences were tested for significance with the Mann-Whitney U-test. Of 93 features, 87 T1w-derived, 87 TIRM-derived, and 70 CT-derived features were significantly different between ROI sizes. Among MR-derived features, OCCCs showed excellent (>0.90) agreement for mean, median, and root mean squared for ROI sizes between 4 and 16 mm and pixels. We further observed excellent agreement for 10th and 90th percentile in T1w and 10th percentile in T2w TIRM images. There was no excellent agreement among the OCCCs of CT-derived features. In summary, many features indicated significant differences and only few showed excellent agreement across varying ROI sizes, although we examined a homogenous phantom. Since we considered a small phantom in an experimental setting, further studies to investigate this size effect would be necessary for a generalization. Nevertheless, we believe knowledge about this effect is crucial in interpreting radiomics studies, as features that supposedly discriminate disease entities may only indicate a systematic difference in ROI size.
| S-EPMC8293351 | biostudies-literature
Project description:BackgroundExisting studies have demonstrated that imaging parameters may affect radiomic features. However, the influence of feature calculating parameters has been overlooked. The purpose of this study is to investigate the influence of feature calculating parameters (gray-level range and bin size) on the reproducibility of CT radiomic features.MethodsThirty-six CT scans from an anthropomorphic thoracic phantom were acquired with different imaging parameters including effective dose, pitch, slice thicknesses and reconstruction kernels. The influence of feature calculating parameters was investigated in terms of three gray-level ranges and eleven gray-level bin sizes. Feature reproducibility was assessed by the intraclass correlation coefficient (ICC) with the cutoff value of 0.8 and the coefficient of variation (CV) with the cutoff value of 20%. The agreements of reproducible features in different ranges and bin sizes were analyzed by Kendall's W test and Kappa test. The proportions of reproducible features, in terms of two calculating, four imaging and two segmentation parameters, were evaluated using Cochran's Q test and Dunn's test.ResultsFor the three gray-level ranges, 50% (44/88) of features were reproducible with a perfect agreement (Kendall's W coefficient 0.844, P<0.001). Of the 72 features that may be influenced by gray-level bin size, 33.3% (24/72) were reproducible for 11 bin sizes with a perfect agreement (Kendall's W coefficient 0.879, P<0.001). For the proportions of reproducible features, there was no statistically significant difference among three ranges (P=0.420), but there was among eleven bin sizes (P=0.013). The proportions of reproducible features in feature calculating parameters were statistically significantly lower than those in imaging parameters (adjusted P<0.05).ConclusionsFeature calculating parameters may have a greater influence than imaging parameters on the reproducibility of CT radiomic features, which should be given special attention in clinical applications.
| S-EPMC7417756 | biostudies-literature
Project description:Background Results of recent phantom studies show that variation in CT acquisition parameters and reconstruction techniques may make radiomic features largely nonreproduceable and of limited use for prognostic clinical studies. Purpose To investigate the effect of CT radiation dose and reconstruction settings on the reproducibility of radiomic features, as well as to identify correction factors for mitigating these sources of variability. Materials and Methods This was a secondary analysis of a prospective study of metastatic liver lesions in patients who underwent staging with single-energy dual-source contrast material-enhanced staging CT between September 2011 and April 2012. Technique parameters were altered, resulting in 28 CT data sets per patient that included different dose levels, section thicknesses, kernels, and reconstruction algorithm settings. By using a training data set (n = 76), reproducible intensity, shape, and texture radiomic features (reproducibility threshold, R2 ≥ 0.95) were selected and correction factors were calculated by using a linear model to convert each radiomic feature to its estimated value in a reference technique. By using a test data set (n = 75), the reproducibility of hierarchical clustering based on 106 radiomic features measured with different CT techniques was assessed. Results Data in 78 patients (mean age, 60 years ± 10; 33 women) with 151 liver lesions were included. The percentage of radiomic features deemed reproducible for any variation of the different technical parameters was 11% (12 of 106). Of all technical parameters, reconstructed section thickness had the largest impact on the reproducibility of radiomic features (12.3% [13 of 106]) if only one technical parameter was changed while all other technical parameters were kept constant. The results of the hierarchical cluster analysis showed improved clustering reproducibility when reproducible radiomic features with dedicated correction factors were used (ρ = 0.39-0.71 vs ρ = 0.14-0.47). Conclusion Most radiomic features are highly affected by CT acquisition and reconstruction settings, to the point of being nonreproducible. Selecting reproducible radiomic features along with study-specific correction factors offers improved clustering reproducibility. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Sosna in this issue.
| S-EPMC10860741 | biostudies-literature
Project description:OBJECTIVES:To systematically evaluate the influence of acquisition settings in conjunction with raw-data based iterative image reconstruction (IR) on lung densitometry based on multi-row detector computed tomography (CT) in an anthropomorphic chest phantom. MATERIALS AND METHODS:Ten porcine heart-lung explants were mounted in an ex vivo chest phantom shell, six with highly and four with low attenuating chest wall. CT (Somatom Definition Flash, Siemens Healthineers) was performed at 120kVp and 80kVp, each combined with current-time products of 120, 60, 30, and 12mAs, and was reconstructed with filtered back projection (FBP) and IR (Safire, Siemens Healthineers). Mean lung density (LD), air density (AD) and noise were measured by semi-automated region-of interest (ROI) analysis, with 120kVp/120 mAs serving as the standard of reference. RESULTS:Using IR, noise in lung parenchyma was reduced by ~ 31% at high attenuating chest wall and by ~ 22% at low attenuating chest wall compared to FBP, respectively (p<0.05). IR induced changes in the order of ±1 HU to mean absolute LD and AD compared to corresponding FBP reconstructions which were statistically significant (p<0.05). CONCLUSIONS:Densitometry is influenced by acquisition parameters and reconstruction algorithms to a degree that may be clinically negligible. However, in longitudinal studies and clinical research identical protocols and potentially other measures for calibration may be required.
| S-EPMC7428081 | biostudies-literature
Project description:Image features need to be robust against differences in positioning, acquisition and segmentation to ensure reproducibility. Radiomic models that only include robust features can be used to analyse new images, whereas models with non-robust features may fail to predict the outcome of interest accurately. Test-retest imaging is recommended to assess robustness, but may not be available for the phenotype of interest. We therefore investigated 18 combinations of image perturbations to determine feature robustness, based on noise addition (N), translation (T), rotation (R), volume growth/shrinkage (V) and supervoxel-based contour randomisation (C). Test-retest and perturbation robustness were compared for combined total of 4032 morphological, statistical and texture features that were computed from the gross tumour volume in two cohorts with computed tomography imaging: I) 31 non-small-cell lung cancer (NSCLC) patients; II): 19 head-and-neck squamous cell carcinoma (HNSCC) patients. Robustness was determined using the 95% confidence interval (CI) of the intraclass correlation coefficient (1, 1). Features with CI???0:90 were considered robust. The NTCV, TCV, RNCV and RCV perturbation chain produced similar results and identified the fewest false positive robust features (NSCLC: 0.2-0.9%; HNSCC: 1.7-1.9%). Thus, these perturbation chains may be used as an alternative to test-retest imaging to assess feature robustness.
| S-EPMC6345842 | biostudies-other