Reproducibility of radiomic features in CT images of NSCLC patients: an integrative analysis on the impact of acquisition and reconstruction parameters.
Ontology highlight
ABSTRACT: Background
We investigated to what extent tube voltage, scanner model, and reconstruction algorithm affect radiomic feature reproducibility in a single-institution retrospective database of computed tomography images of non-small-cell lung cancer patients.Methods
This study was approved by the Institutional Review Board (UID 2412). Images of 103 patients were considered, being acquired on either among two scanners, at 100 or 120 kVp. For each patient, images were reconstructed with six iterative blending levels, and 1414 features were extracted from each reconstruction. At univariate analysis, Wilcoxon-Mann-Whitney test was applied to evaluate feature differences within scanners and voltages, whereas the impact of the reconstruction was established with the overall concordance correlation coefficient (OCCC). A multivariable mixed model was also applied to investigate the independent contribution of each acquisition/reconstruction parameter. Univariate and multivariable analyses were combined to analyse feature behaviour.Results
Scanner model and voltage did not affect features significantly. The reconstruction blending level showed a significant impact at both univariate analysis (154/1414 features yielding an OCCC < 0.85) and multivariable analysis, with most features (1042/1414) revealing a systematic trend with the blending level (multiple comparisons adjusted p < 0.05). Reproducibility increased in association to image processing with smooth filters, nonetheless specific investigation in relation to clinical endpoints should be performed to ensure that textural information is not removed.Conclusions
Combining univariate and multivariable models is allowed to identify features for which corrections may be applied to reduce the trend with the algorithm and increase reproducibility. Subsequent clustering may be applied to eliminate residual redundancy.
SUBMITTER: Rinaldi L
PROVIDER: S-EPMC8786992 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Background Results of recent phantom studies show that variation in CT acquisition parameters and reconstruction techniques may make radiomic features largely nonreproduceable and of limited use for prognostic clinical studies. Purpose To investigate the effect of CT radiation dose and reconstruction settings on the reproducibility of radiomic features, as well as to identify correction factors for mitigating these sources of variability. Materials and Methods This was a secondary analysis of a prospective study of metastatic liver lesions in patients who underwent staging with single-energy dual-source contrast material-enhanced staging CT between September 2011 and April 2012. Technique parameters were altered, resulting in 28 CT data sets per patient that included different dose levels, section thicknesses, kernels, and reconstruction algorithm settings. By using a training data set (n = 76), reproducible intensity, shape, and texture radiomic features (reproducibility threshold, R2 ≥ 0.95) were selected and correction factors were calculated by using a linear model to convert each radiomic feature to its estimated value in a reference technique. By using a test data set (n = 75), the reproducibility of hierarchical clustering based on 106 radiomic features measured with different CT techniques was assessed. Results Data in 78 patients (mean age, 60 years ± 10; 33 women) with 151 liver lesions were included. The percentage of radiomic features deemed reproducible for any variation of the different technical parameters was 11% (12 of 106). Of all technical parameters, reconstructed section thickness had the largest impact on the reproducibility of radiomic features (12.3% [13 of 106]) if only one technical parameter was changed while all other technical parameters were kept constant. The results of the hierarchical cluster analysis showed improved clustering reproducibility when reproducible radiomic features with dedicated correction factors were used (ρ = 0.39-0.71 vs ρ = 0.14-0.47). Conclusion Most radiomic features are highly affected by CT acquisition and reconstruction settings, to the point of being nonreproducible. Selecting reproducible radiomic features along with study-specific correction factors offers improved clustering reproducibility. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Sosna in this issue.
| S-EPMC10860741 | biostudies-literature
Project description:BackgroundExisting studies have demonstrated that imaging parameters may affect radiomic features. However, the influence of feature calculating parameters has been overlooked. The purpose of this study is to investigate the influence of feature calculating parameters (gray-level range and bin size) on the reproducibility of CT radiomic features.MethodsThirty-six CT scans from an anthropomorphic thoracic phantom were acquired with different imaging parameters including effective dose, pitch, slice thicknesses and reconstruction kernels. The influence of feature calculating parameters was investigated in terms of three gray-level ranges and eleven gray-level bin sizes. Feature reproducibility was assessed by the intraclass correlation coefficient (ICC) with the cutoff value of 0.8 and the coefficient of variation (CV) with the cutoff value of 20%. The agreements of reproducible features in different ranges and bin sizes were analyzed by Kendall's W test and Kappa test. The proportions of reproducible features, in terms of two calculating, four imaging and two segmentation parameters, were evaluated using Cochran's Q test and Dunn's test.ResultsFor the three gray-level ranges, 50% (44/88) of features were reproducible with a perfect agreement (Kendall's W coefficient 0.844, P<0.001). Of the 72 features that may be influenced by gray-level bin size, 33.3% (24/72) were reproducible for 11 bin sizes with a perfect agreement (Kendall's W coefficient 0.879, P<0.001). For the proportions of reproducible features, there was no statistically significant difference among three ranges (P=0.420), but there was among eleven bin sizes (P=0.013). The proportions of reproducible features in feature calculating parameters were statistically significantly lower than those in imaging parameters (adjusted P<0.05).ConclusionsFeature calculating parameters may have a greater influence than imaging parameters on the reproducibility of CT radiomic features, which should be given special attention in clinical applications.
| S-EPMC7417756 | biostudies-literature
Project description:PurposeAccurate lesion segmentation is a prerequisite for radiomic feature extraction. It helps to reduce the features variability so as to improve the reporting quality of radiomics study. In this research, we aimed to conduct a radiomic feature reproducibility test of inter-/intra-observer delineation variability in hepatocellular carcinoma using 3D-CT images, 4D-CT images and multiple-parameter MR images.Materials and methodsFor this retrospective study, 19 HCC patients undergoing 3D-CT, 4D-CT and multiple-parameter MR scans were included in this study. The gross tumor volume (GTV) was independently delineated twice by two observers based on contrast-enhanced computed tomography (CECT), maximum intensity projection (MIP), LAVA-Flex, T2W FRFSE and DWI-EPI images. We also delineated the peritumoral region, which was defined as 0 to 5 mm radius surrounding the GTV. 107 radiomic features were automatically extracted from CECT images using 3D-Slicer software. Quartile coefficient of dispersion (QCD) and intraclass correlation coefficient (ICC) were applied to assess the variability of each radiomic feature. QCD<10% and ICC≥0.75 were considered small variations and excellent reliability. Finally, the principal component analysis (PCA) was used to test the feasibility of dimensionality reduction.ResultsFor tumor tissues, the numbers of radiomic features with QCD<10% indicated no obvious inter-/intra-observer differences or discrepancies in 3D-CT, 4D-CT and multiple-parameter MR delineation. However, the number of radiomic features (mean 89) with ICC≥0.75 was the highest in the multiple-parameter MR group, followed by the 3DCT group (mean 77) and the MIP group (mean 73). The peritumor tissues also showed similar results. A total of 15 and 7 radiomic features presented excellent reproducibility and small variation in tumor and peritumoral tissues, respectively. Two robust features showed excellent reproducibility and small variation in tumor and peritumoral tissues. In addition, the values of the two features both represented statistically significant differences among tumor and peritumoral tissues (P<0.05). The PCA results indicated that the first seven principal components could preserve at least 90% of the variance of the original set of features.ConclusionDelineation on multiple-parameter MR images could help to improve the reproducibility of the HCC CT radiomic features and weaken the inter-/intra-observer influence.
| S-EPMC9047864 | biostudies-literature
Project description:Consistency and duplicability in Computed Tomography (CT) output is essential to quantitative imaging for lung cancer detection and monitoring. This study of CT-detected lung nodules investigated the reproducibility of volume-, density-, and texture-based features (outcome variables) over routine ranges of radiation dose, reconstruction kernel, and slice thickness. CT raw data of 23 nodules were reconstructed using 320 acquisition/reconstruction conditions (combinations of 4 doses, 10 kernels, and 8 thicknesses). Scans at 12.5%, 25%, and 50% of protocol dose were simulated; reduced-dose and full-dose data were reconstructed using conventional filtered back-projection and iterative-reconstruction kernels at a range of thicknesses (0.6-5.0 mm). Full-dose/B50f kernel reconstructions underwent expert segmentation for reference Region-Of-Interest (ROI) and nodule volume per thickness; each ROI was applied to 40 corresponding images (combinations of 4 doses and 10 kernels). Typical texture analysis metrics (including 5 histogram features, 13 Gray Level Co-occurrence Matrix, 5 Run Length Matrix, 2 Neighboring Gray-Level Dependence Matrix, and 3 Neighborhood Gray-Tone Difference Matrix) were computed per ROI. Reconstruction conditions resulting in no significant change in volume, density, or texture metrics were identified as "compatible pairs" for a given outcome variable. Our results indicate that as thickness increases, volumetric reproducibility decreases, while reproducibility of histogram- and texture-based features across different acquisition and reconstruction parameters improves. To achieve concomitant reproducibility of volumetric and radiomic results across studies, balanced standardization of the imaging acquisition parameters is required.
| S-EPMC7561205 | biostudies-literature
Project description:We study the reproducibility of quantitative imaging features that are used to describe tumor shape, size, and texture from computed tomography (CT) scans of non-small cell lung cancer (NSCLC). CT images are dependent on various scanning factors. We focus on characterizing image features that are reproducible in the presence of variations due to patient factors and segmentation methods. Thirty-two NSCLC nonenhanced lung CT scans were obtained from the Reference Image Database to Evaluate Response data set. The tumors were segmented using both manual (radiologist expert) and ensemble (software-automated) methods. A set of features (219 three-dimensional and 110 two-dimensional) was computed, and quantitative image features were statistically filtered to identify a subset of reproducible and nonredundant features. The variability in the repeated experiment was measured by the test-retest concordance correlation coefficient (CCCTreT). The natural range in the features, normalized to variance, was measured by the dynamic range (DR). In this study, there were 29 features across segmentation methods found with CCCTreT and DR ≥ 0.9 and R(2) Bet ≥ 0.95. These reproducible features were tested for predicting radiologist prognostic score; some texture features (run-length and Laws kernels) had an area under the curve of 0.9. The representative features were tested for their prognostic capabilities using an independent NSCLC data set (59 lung adenocarcinomas), where one of the texture features, run-length gray-level nonuniformity, was statistically significant in separating the samples into survival groups (P ≤ .046).
| S-EPMC3998690 | biostudies-literature
Project description:PurposeTo investigate the effect of ComBat harmonization methods on the robustness of cardiac MRI-derived radiomic features to variations in imaging parameters.Materials and methodsThis Health Insurance Portability and Accountability Act-compliant retrospective study used a publicly available data set of 11 healthy controls (mean age, 33 years ± 16 [SD]; six men) and five patients (mean age, 52 years ± 16; four men). A single midventricular short-axis section was acquired with 3-T MRI using cine balanced steady-state free precision, T1-weighted, T2-weighted, T1 mapping, and T2 mapping imaging sequences. Each sequence was acquired using baseline parameters and after variations in flip angle, spatial resolution, section thickness, and parallel imaging. Image registration was performed for all sequences at a per-individual level. Manual myocardial contouring was performed, and 1652 radiomic features per sequence were extracted using baseline and variations in imaging parameters. Radiomic feature stability to change in imaging parameters was assessed using Cohen d sensitivity. The stability of radiomic features was assessed both without and after ComBat harmonization of radiomic features. Three ComBat methods were studied: parametric, nonparametric, and Gaussian mixture model (GMM).ResultsFor all sequences combined, 51.4% of features were robust to changes in imaging parameters when no ComBat method was applied. ComBat harmonization substantially increased the number of stable features to 95.1% (95% CI: 94.9, 95.3) when parametric ComBat was used and 90.9% (95% CI: 90.6, 91.2) when nonparametric ComBat was used. GMM combat resulted in only 52.6% stable features.ConclusionComBat harmonization improved the stability of radiomic features to changes in imaging parameters across all cardiac MRI sequences.Keywords: Cardiac MRI, Radiomics, ComBat, Harmonization Supplemental material is available for this article. © RSNA, 2023.
| S-EPMC10483256 | biostudies-literature
Project description:Purpose To evaluate ability of radiomic (computer-extracted imaging) features to distinguish non-small cell lung cancer adenocarcinomas from granulomas at noncontrast CT. Materials and Methods For this retrospective study, screening or standard diagnostic noncontrast CT images were collected for 290 patients (mean age, 68 years; range, 18-92 years; 125 men [mean age, 67 years; range, 18-90 years] and 165 women [mean age, 68 years; range, 33-92 years]) from two institutions between 2007 and 2013. Histopathologic analysis was available for one nodule per patient. Corresponding nodule of interest was identified on axial CT images by a radiologist with manual annotation. Nodule shape, wavelet (Gabor), and texture-based (Haralick and Laws energy) features were extracted from intra- and perinodular regions. Features were pruned to train machine learning classifiers with 145 patients. In a test set of 145 patients, classifier results were compared against a convolutional neural network (CNN) and diagnostic readings of two radiologists. Results Support vector machine classifier with intranodular radiomic features achieved an area under the receiver operating characteristic curve (AUC) of 0.75 on the test set. Combining radiomics of intranodular with perinodular regions improved the AUC to 0.80. On the same test set, CNN resulted in an AUC of 0.76. Radiologist readers achieved AUCs of 0.61 and 0.60, respectively. Conclusion Radiomic features from intranodular and perinodular regions of nodules can distinguish non-small cell lung cancer adenocarcinomas from benign granulomas at noncontrast CT. © RSNA, 2018 Online supplemental material is available for this article. See also the editorial by Nishino in this issue.
| S-EPMC6394783 | biostudies-literature
Project description:We studied the reliability of radiomic features on abdominal computed tomography (CT) images reconstructed with multiple CT image acquisition settings using the ACR (American College of Radiology) CT Phantom. Twenty-four sets of CT images of the ACR CT phantom were attained from a GE Discovery 750HD scanner using 24 different image acquisition settings, combinations of 4 tube currents (25, 50, 100, 200 Effective mAs), 3 slice thicknesses (1.25, 2.5, 5 mm), and 2 convolution kernels (STANDARD and SOFT). Polyethylene (-95 HU) and acrylic (120 HU) of the phantom model were selected for calculating real feature value; a noise-free, computer-generated phantom image series that reproduced the 2 objects and the background was used for calculating reference feature value. Feature reliability was defined as the degree of predicting reference feature value from real feature value. Radiomic features mean, std, skewness, kurtosis, gray-level co-occurrence matrix (GLCM)-energy, GLCM-contrast, GLCM-correlation, GLCM-homogeneity were investigated. The value of R 2 ? 0.85 was considered to be of high reliability. The reliability of mean and std were high across all image acquisition settings. At 200 Effective mAs, all features except GLCM-homogeneity showed high reliability, whereas at 25 Effective mAs, most features (except mean and std) showed low reliability. From high to low, reliability was ranked in the following order: mean, std, skewness, kurtosis, GLCM-energy, correlation, contrast and homogeneity. CT image acquisition settings affected the reliability of radiomic features. High reliable features were attained from images reconstructed at high tube current and thick slice thickness.
| S-EPMC6403036 | biostudies-literature
Project description:The purpose of this study was to explore the effects of CT slice thickness, reconstruction algorithm, and radiation dose on quantification of CT features to characterize lung nodules using a chest phantom. Spherical lung nodule phantoms of known densities (-630 and + 100 HU) were inserted into an anthropomorphic thorax phantom. CT scan was performed ten times with relocations. CT data were reconstructed using 12 different imaging settings; three different slice thicknesses of 1.25, 2.5, and 5.0 mm, two reconstruction kernels of sharp and standard, and two radiation dose of 30 mAs and 12 mAs. Lesions were segmented using a semiautomated method. Twenty representative CT quantitative features representing CT density and texture were compared using multiple regression analysis. In 100 HU nodule phantoms, 18 and 19 among 20 computer features showed significant difference between different mAs and reconstruction algorithms, respectively (p ≤ 0.05). 20, 19, and 19 computer features showed difference between slice thickness of 5.0 vs 1.25, 5.0 vs 2.5, and 2.5 vs 1.25 mm, respectively (p ≤ 0.05). In -630 HU nodule phantoms, 18 and 19 showed significant difference between different mAs and reconstruction algorithms, respectively (p ≤ 0.05). 18, 11, and 17 computer features showed difference between slice thickness of 5.0 vs 1.25, 5.0 vs 2.5, and 2.5 vs 1.25 mm, respectively (p ≤ 0.05). When comparing the absolute value of regression coefficient, the effect of slice thickness in 100 HU nodule and reconstruction algorithm in -630 HU nodule was greater than the effect of remaining scan parameters. The slice thickness, mAs, and reconstruction algorithm had a significant impact on the quantitative image features. In clinical studies involving deep learning or radiomics, it should be noted that differences in values can occur when using computer features obtained from different CT scan parameters in combination. Therefore, when interpreting the statistical analysis results, it is necessary to reflect the difference in the computer features depending on the scan parameters.
| S-EPMC6381551 | biostudies-literature
Project description:PURPOSE:To evaluate the short-term reproducibility of radiomic features in liver parenchyma and liver cancers in patients who underwent consecutive contrast-enhanced CT (CECT) with intravenous iodinated contrast within 2 weeks by chance. METHODS:The Institutional Review Board approved this HIPAA-compliant retrospective study and waived the requirement for patients' informed consent. Patients were included if they had a liver malignancy (liver metastasis, n?=?22, intrahepatic cholangiocarcinoma, n?=?10, and hepatocellular carcinoma, n?=?6), had two consecutive CECT within 14 days, and had no prior or intervening therapy. Liver tumors and liver parenchyma were segmented and radiomic features (n?=?254) were extracted. The number of reproducible features (with concordance correlation coefficients?>?0.9) was calculated for patient subgroups with different variations in contrast injection rate and pixel resolution. RESULTS:The number of reproducible radiomic features decreased with increasing variations in contrast injection rate and pixel resolution. When including all CECTs with injection rates differences of less than 15% vs. up to 50%, 63/254 vs. 0/254 features were reproducible for liver parenchyma and 68/254 vs. 50/254 features were reproducible for malignancies. When including all CT with pixel resolution differences of 0-5% or 0-15%, 20/254 vs. 0/254 features were reproducible for liver parenchyma; 34/254 liver malignancy features were reproducible with pixel differences up to 15%. CONCLUSION:A greater number of liver malignancy radiomic features were reproducible compared to liver parenchyma features, but the proportion of reproducible features decreased with increasing variations in contrast injection rates and pixel resolution.
| S-EPMC6209534 | biostudies-literature