Reproducibility of CT-Based Hepatocellular Carcinoma Radiomic Features across Different Contrast Imaging Phases: A Proof of Concept on SORAMIC Trial Data.
Ontology highlight
ABSTRACT:
SUBMITTER: Ibrahim A
PROVIDER: S-EPMC8468150 | biostudies-literature | 2021 Sep
REPOSITORIES: biostudies-literature
Publications
Reproducibility of CT-Based Hepatocellular Carcinoma Radiomic Features across Different Contrast Imaging Phases: A Proof of Concept on SORAMIC Trial Data.
Ibrahim Abdalla A Widaatalla Yousif Y Refaee Turkey T Primakov Sergey S Miclea Razvan L RL Öcal Osman O Fabritius Matthias P MP Ingrisch Michael M Ricke Jens J Hustinx Roland R Mottaghy Felix M FM Woodruff Henry C HC Seidensticker Max M Lambin Philippe P
Cancers 20210916 18
Handcrafted radiomic features (HRFs) are quantitative imaging features extracted from regions of interest on medical images which can be correlated with clinical outcomes and biologic characteristics. While HRFs have been used to train predictive and prognostic models, their reproducibility has been reported to be affected by variations in scan acquisition and reconstruction parameters, even within the same imaging vendor. In this work, we evaluated the reproducibility of HRFs across the arteria ...[more]
Similar Datasets
Project description:PURPOSE:To evaluate the short-term reproducibility of radiomic features in liver parenchyma and liver cancers in patients who underwent consecutive contrast-enhanced CT (CECT) with intravenous iodinated contrast within 2 weeks by chance. METHODS:The Institutional Review Board approved this HIPAA-compliant retrospective study and waived the requirement for patients' informed consent. Patients were included if they had a liver malignancy (liver metastasis, n?=?22, intrahepatic cholangiocarcinoma, n?=?10, and hepatocellular carcinoma, n?=?6), had two consecutive CECT within 14 days, and had no prior or intervening therapy. Liver tumors and liver parenchyma were segmented and radiomic features (n?=?254) were extracted. The number of reproducible features (with concordance correlation coefficients?>?0.9) was calculated for patient subgroups with different variations in contrast injection rate and pixel resolution. RESULTS:The number of reproducible radiomic features decreased with increasing variations in contrast injection rate and pixel resolution. When including all CECTs with injection rates differences of less than 15% vs. up to 50%, 63/254 vs. 0/254 features were reproducible for liver parenchyma and 68/254 vs. 50/254 features were reproducible for malignancies. When including all CT with pixel resolution differences of 0-5% or 0-15%, 20/254 vs. 0/254 features were reproducible for liver parenchyma; 34/254 liver malignancy features were reproducible with pixel differences up to 15%. CONCLUSION:A greater number of liver malignancy radiomic features were reproducible compared to liver parenchyma features, but the proportion of reproducible features decreased with increasing variations in contrast injection rates and pixel resolution.
| S-EPMC6209534 | biostudies-literature
Project description:PurposeAccurate lesion segmentation is a prerequisite for radiomic feature extraction. It helps to reduce the features variability so as to improve the reporting quality of radiomics study. In this research, we aimed to conduct a radiomic feature reproducibility test of inter-/intra-observer delineation variability in hepatocellular carcinoma using 3D-CT images, 4D-CT images and multiple-parameter MR images.Materials and methodsFor this retrospective study, 19 HCC patients undergoing 3D-CT, 4D-CT and multiple-parameter MR scans were included in this study. The gross tumor volume (GTV) was independently delineated twice by two observers based on contrast-enhanced computed tomography (CECT), maximum intensity projection (MIP), LAVA-Flex, T2W FRFSE and DWI-EPI images. We also delineated the peritumoral region, which was defined as 0 to 5 mm radius surrounding the GTV. 107 radiomic features were automatically extracted from CECT images using 3D-Slicer software. Quartile coefficient of dispersion (QCD) and intraclass correlation coefficient (ICC) were applied to assess the variability of each radiomic feature. QCD<10% and ICC≥0.75 were considered small variations and excellent reliability. Finally, the principal component analysis (PCA) was used to test the feasibility of dimensionality reduction.ResultsFor tumor tissues, the numbers of radiomic features with QCD<10% indicated no obvious inter-/intra-observer differences or discrepancies in 3D-CT, 4D-CT and multiple-parameter MR delineation. However, the number of radiomic features (mean 89) with ICC≥0.75 was the highest in the multiple-parameter MR group, followed by the 3DCT group (mean 77) and the MIP group (mean 73). The peritumor tissues also showed similar results. A total of 15 and 7 radiomic features presented excellent reproducibility and small variation in tumor and peritumoral tissues, respectively. Two robust features showed excellent reproducibility and small variation in tumor and peritumoral tissues. In addition, the values of the two features both represented statistically significant differences among tumor and peritumoral tissues (P<0.05). The PCA results indicated that the first seven principal components could preserve at least 90% of the variance of the original set of features.ConclusionDelineation on multiple-parameter MR images could help to improve the reproducibility of the HCC CT radiomic features and weaken the inter-/intra-observer influence.
| S-EPMC9047864 | biostudies-literature
Project description:Background Results of recent phantom studies show that variation in CT acquisition parameters and reconstruction techniques may make radiomic features largely nonreproduceable and of limited use for prognostic clinical studies. Purpose To investigate the effect of CT radiation dose and reconstruction settings on the reproducibility of radiomic features, as well as to identify correction factors for mitigating these sources of variability. Materials and Methods This was a secondary analysis of a prospective study of metastatic liver lesions in patients who underwent staging with single-energy dual-source contrast material-enhanced staging CT between September 2011 and April 2012. Technique parameters were altered, resulting in 28 CT data sets per patient that included different dose levels, section thicknesses, kernels, and reconstruction algorithm settings. By using a training data set (n = 76), reproducible intensity, shape, and texture radiomic features (reproducibility threshold, R2 ≥ 0.95) were selected and correction factors were calculated by using a linear model to convert each radiomic feature to its estimated value in a reference technique. By using a test data set (n = 75), the reproducibility of hierarchical clustering based on 106 radiomic features measured with different CT techniques was assessed. Results Data in 78 patients (mean age, 60 years ± 10; 33 women) with 151 liver lesions were included. The percentage of radiomic features deemed reproducible for any variation of the different technical parameters was 11% (12 of 106). Of all technical parameters, reconstructed section thickness had the largest impact on the reproducibility of radiomic features (12.3% [13 of 106]) if only one technical parameter was changed while all other technical parameters were kept constant. The results of the hierarchical cluster analysis showed improved clustering reproducibility when reproducible radiomic features with dedicated correction factors were used (ρ = 0.39-0.71 vs ρ = 0.14-0.47). Conclusion Most radiomic features are highly affected by CT acquisition and reconstruction settings, to the point of being nonreproducible. Selecting reproducible radiomic features along with study-specific correction factors offers improved clustering reproducibility. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Sosna in this issue.
| S-EPMC10860741 | biostudies-literature
Project description:BackgroundExisting studies have demonstrated that imaging parameters may affect radiomic features. However, the influence of feature calculating parameters has been overlooked. The purpose of this study is to investigate the influence of feature calculating parameters (gray-level range and bin size) on the reproducibility of CT radiomic features.MethodsThirty-six CT scans from an anthropomorphic thoracic phantom were acquired with different imaging parameters including effective dose, pitch, slice thicknesses and reconstruction kernels. The influence of feature calculating parameters was investigated in terms of three gray-level ranges and eleven gray-level bin sizes. Feature reproducibility was assessed by the intraclass correlation coefficient (ICC) with the cutoff value of 0.8 and the coefficient of variation (CV) with the cutoff value of 20%. The agreements of reproducible features in different ranges and bin sizes were analyzed by Kendall's W test and Kappa test. The proportions of reproducible features, in terms of two calculating, four imaging and two segmentation parameters, were evaluated using Cochran's Q test and Dunn's test.ResultsFor the three gray-level ranges, 50% (44/88) of features were reproducible with a perfect agreement (Kendall's W coefficient 0.844, P<0.001). Of the 72 features that may be influenced by gray-level bin size, 33.3% (24/72) were reproducible for 11 bin sizes with a perfect agreement (Kendall's W coefficient 0.879, P<0.001). For the proportions of reproducible features, there was no statistically significant difference among three ranges (P=0.420), but there was among eleven bin sizes (P=0.013). The proportions of reproducible features in feature calculating parameters were statistically significantly lower than those in imaging parameters (adjusted P<0.05).ConclusionsFeature calculating parameters may have a greater influence than imaging parameters on the reproducibility of CT radiomic features, which should be given special attention in clinical applications.
| S-EPMC7417756 | biostudies-literature
Project description:OBJECTIVE:To retrospectively assess the effect of CT slice thickness on the reproducibility of radiomic features (RFs) of lung cancer, and to investigate whether convolutional neural network (CNN)-based super-resolution (SR) algorithms can improve the reproducibility of RFs obtained from images with different slice thicknesses. MATERIALS AND METHODS:CT images with 1-, 3-, and 5-mm slice thicknesses obtained from 100 pathologically proven lung cancers between July 2017 and December 2017 were evaluated. CNN-based SR algorithms using residual learning were developed to convert thick-slice images into 1-mm slices. Lung cancers were semi-automatically segmented and a total of 702 RFs (tumor intensity, texture, and wavelet features) were extracted from 1-, 3-, and 5-mm slices, as well as the 1-mm slices generated from the 3- and 5-mm images. The stabilities of the RFs were evaluated using concordance correlation coefficients (CCCs). RESULTS:The mean CCCs for the comparisons of original 1 mm vs. 3 mm, 1 mm vs. 5 mm, and 3 mm vs. 5 mm images were 0.41, 0.27, and 0.65, respectively (p < 0.001 for all comparisons). Tumor intensity features showed the best reproducibility while wavelets showed the lowest reproducibility. The majority of RFs failed to achieve reproducibility (CCC ≥ 0.85; 3.6%, 1.0%, and 21.5%, respectively). After applying the CNN-based SR algorithms, the reproducibility significantly improved in all three pairings (mean CCCs: 0.58, 0.45, and 0.72; p < 0.001 for all comparisons). The reproducible RFs also increased (36.3%, 17.4%, and 36.9%, respectively). CONCLUSION:The reproducibility of RFs in lung cancer is significantly influenced by CT slice thickness, which can be improved by the CNN-based SR algorithms.
| S-EPMC6757001 | biostudies-literature
Project description:BACKGROUND:We aimed to develop radiomic models based on different phases of computed tomography (CT) imaging and to investigate the efficacy of models for diagnosing mediastinal metastatic lymph nodes (LNs) in non-small cell lung cancer (NSCLC). METHODS:Eighty-six NSCLC patients were enrolled in this study, and we selected 231 mediastinal LNs confirmed by pathology results as the subjects which were divided into training (n?=?163) and validation cohorts (n?=?68). The regions of interest (ROIs) were delineated on CT scans in the plain phase, arterial phase and venous phase, respectively. Radiomic features were extracted from the CT images in each phase. A least absolute shrinkage and selection operator (LASSO) algorithm was used to select features, and multivariate logistic regression analysis was used to build models. We constructed six models (orders 1-6) based on the radiomic features of the single- and dual-phase CT images. The performance of the radiomic model was evaluated by the area under the receiver operating characteristic curve (AUC), sensitivity, specificity, accuracy, positive predictive value (PPV) and negative predictive value (NPV). RESULTS:A total of 846 features were extracted from each ROI, and 10, 9, 5, 2, 2, and 9 features were chosen to develop models 1-6, respectively. All of the models showed excellent discrimination, with AUCs greater than 0.8. The plain CT radiomic model, model 1, yielded the highest AUC, specificity, accuracy and PPV, which were 0.926 and 0.925; 0.860 and 0.769; 0.871 and 0.882; and 0.906 and 0.870 in the training and validation sets, respectively. When the plain and venous phase CT radiomic features were combined with the arterial phase CT images, the sensitivity increased from 0.879 and 0.919 to 0.949 and 0979 and the NPV increased from 0.821 and 0.789 to 0.878 and 0.900 in the training group, respectively. CONCLUSIONS:All of the CT radiomic models based on different phases all showed high accuracy and precision for the diagnosis of LN metastasis (LNM) in NSCLC patients. When combined with arterial phase CT, the sensitivity and NPV of the model was be further improved.
| S-EPMC7003415 | biostudies-literature
Project description:PurposeAn ever-growing number of predictive models used to inform clinical decision making have included quantitative, computer-extracted imaging biomarkers, or "radiomic features." Broadly generalizable validity of radiomics-assisted models may be impeded by concerns about reproducibility. We offer a qualitative synthesis of 41 studies that specifically investigated the repeatability and reproducibility of radiomic features, derived from a systematic review of published peer-reviewed literature.Methods and materialsThe PubMed electronic database was searched using combinations of the broad Haynes and Ingui filters along with a set of text words specific to cancer, radiomics (including texture analyses), reproducibility, and repeatability. This review has been reported in compliance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. From each full-text article, information was extracted regarding cancer type, class of radiomic feature examined, reporting quality of key processing steps, and statistical metric used to segregate stable features.ResultsAmong 624 unique records, 41 full-text articles were subjected to review. The studies primarily addressed non-small cell lung cancer and oropharyngeal cancer. Only 7 studies addressed in detail every methodologic aspect related to image acquisition, preprocessing, and feature extraction. The repeatability and reproducibility of radiomic features are sensitive at various degrees to processing details such as image acquisition settings, image reconstruction algorithm, digital image preprocessing, and software used to extract radiomic features. First-order features were overall more reproducible than shape metrics and textural features. Entropy was consistently reported as one of the most stable first-order features. There was no emergent consensus regarding either shape metrics or textural features; however, coarseness and contrast appeared among the least reproducible.ConclusionsInvestigations of feature repeatability and reproducibility are currently limited to a small number of cancer types. Reporting quality could be improved regarding details of feature extraction software, digital image manipulation (preprocessing), and the cutoff value used to distinguish stable features.
| S-EPMC6690209 | biostudies-literature
Project description:ObjectivesThis study aims to measure the reproducibility of radiomic features in pancreatic parenchyma and ductal adenocarcinomas (PDAC) in patients who underwent consecutive contrast-enhanced computed tomography (CECT) scans.MethodsIn this IRB-approved and HIPAA-compliant retrospective study, 37 pairs of scans from 37 unique patients who underwent CECTs within a 2-week interval were included in the analysis of the reproducibility of features derived from pancreatic parenchyma, and a subset of 18 pairs of scans were further analyzed for the reproducibility of features derived from PDAC. In each patient, pancreatic parenchyma and pancreatic tumor (when present) were manually segmented by two radiologists independently. A total of 266 radiomic features were extracted from the pancreatic parenchyma and tumor region and also the volume and diameter of the tumor. The concordance correlation coefficient (CCC) was calculated to assess feature reproducibility for each patient in three scenarios: (1) different radiologists, same CECT; (2) same radiologist, different CECTs; and (3) different radiologists, different CECTs.ResultsAmong pancreatic parenchyma-derived features, using a threshold of CCC > 0.90, 58/266 (21.8%) and 48/266 (18.1%) features met the threshold for scenario 1, 14/266 (5.3%) and 15/266 (5.6%) for scenario 2, and 14/266 (5.3%) and 10/266 (3.8%) for scenario 3. Among pancreatic tumor-derived features, 11/268 (4.1%) and 17/268 (6.3%) features met the threshold for scenario 1, 1/268 (0.4%) and 5/268 (1.9%) features met the threshold for scenario 2, and no features for scenario 3 met the threshold, respectively.ConclusionsVariations between CECT scans affected radiomic feature reproducibility to a greater extent than variation in segmentation. A smaller number of pancreatic tumor-derived radiomic features were reproducible compared with pancreatic parenchyma-derived radiomic features under the same conditions.Key points• For pancreatic-derived radiomic features from contrast-enhanced CT (CECT), fewer than 25% are reproducible (with a threshold of CCC < 0.9) in a clinical heterogeneous dataset. • Variations between CECT scans affected the number of reproducible radiomic features to a greater extent than variations in radiologist segmentation. • A smaller number of pancreatic tumor-derived radiomic features were reproducible compared with pancreatic parenchyma-derived radiomic features under the same conditions.
| S-EPMC7127865 | biostudies-literature
Project description:PurposeTo investigate reproducibility of myocardial radiomic features with cardiac MRI.Materials and methodsTest-retest studies were performed with a 3-T MRI system using commonly used cardiac MRI sequences of cine balanced steady-state free precession (cine bSSFP), T1-weighted and T2-weighted imaging, and quantitative T1 and T2 mapping in phantom experiments and 10 healthy participants (mean ± standard deviation age, 29 years ± 13). In addition, this study assessed repeatability in 51 patients (56 years ± 14) who underwent imaging twice during the same session. Three readers independently delineated the myocardium to investigate inter- and intraobserver reproducibility of radiomic features. A total of 1023 radiomic features were extracted by using PyRadiomics (https://pyradiomics.readthedocs.io/) with 11 image filters and six feature families. The intraclass correlation coefficient (ICC) was estimated to assess reproducibility and repeatability, and features with ICCs greater than or equal to 0.8 were considered reproducible.ResultsDifferent reproducibility patterns were observed among sequences in in vivo test-retest studies. In cine bSSFP, the gray-level run-length matrix was the most reproducible feature family, and the wavelet low-pass filter applied horizontally and vertically was the most reproducible image filter. In T1 and T2 maps, intensity-based statistics (first-order) and gray-level co-occurrence matrix features were the most reproducible feature families, without a dominant reproducible image filter. Across all sequences, gray-level nonuniformity was the most frequently identified reproducible feature name. In inter- and intraobserver reproducibility studies, respectively, only 32%-47% and 61%-73% of features were identified as reproducible.ConclusionOnly a small subset of myocardial radiomic features was reproducible, and these reproducible radiomic features varied among different sequences. Supplemental material is available for this article. © RSNA, 2020See also the commentary by Leiner in this issue.
| S-EPMC7377242 | biostudies-literature
Project description:The aim of this work was to investigate radiomic analysis of contrast and non-contrast enhanced planning CT images of oesophageal cancer (OC) patients in terms of stability, dimensionality and contrast agent dependency. The prognostic significance of CT-based radiomic features was also evaluated. Different 2D and 3D radiomic features were extracted from contrast and non-contrast enhanced CT images of 213 patients from the multi-centre SCOPE1 randomised controlled trial (RCT) in OC. Feature stability was evaluated by randomly dividing patients into three groups and identifying textures with similar distributions among groups with a Kruskal-Wallis analysis. A paired two-sided Wilcoxon signed rank test was used to assess for significant differences in the remaining corresponding 2D and 3D stable features. A prognostic model was constructed using clinical characteristics and remaining filtered features. The discriminative ability of significant variables was tested using Kaplan-Meier analysis. A total of 238 2D and 3D radiomic features were computed from oesophageal CT images. More than 75 features were stable if extracted from homogeneous cohort (contrast or non-contrast enhanced CT images) and inhomogeneous cohort (contrast and non-contrast enhanced CT images). Among the remaining corresponding stable features computed from both cohorts, only 4 features did not show a statistically significant difference if obtained in 2D or in 3D (p-value < 0.05). A Cox regression model constructed using 5 clinical variables (age, sex, tumour, node and metastasis (TNM) stage, WHO performance status and contrast administration) and 4 radiomic variables (inverse varianceGLCM, large distance emphasisGLDZM, zone distance non uniformity normGLDZM, zone distance varianceGLDZM), identified one radiomic feature (zone distance varianceGLDZM) that was significantly associated with overall survival (p-value = 0.032, HR = 1.25, 95% CI = 1.02-1.52). A significant difference in overall survival between groups was found when considering a threshold of zone distance varianceGLDZM equals to 1.70 (X2 = 7.692, df = 1, p-value = 0.006). Zone distance varianceGLDZM was identified as the only stable CT radiomic feature statistically correlated with overall survival, independent of dimensionality and contrast administration. This feature was able to identify high-risk patients and if validated, could be the subject of a future clinical trial aiming to improve clinical decision making and personalise OC treatment.
| S-EPMC6874382 | biostudies-literature