The Effects of In-Plane Spatial Resolution on CT-Based Radiomic Features' Stability with and without ComBat Harmonization.
Ontology highlight
ABSTRACT:
SUBMITTER: Ibrahim A
PROVIDER: S-EPMC8103509 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:We read with great interest the paper by Ibrahim et al. [...].
| S-EPMC8234074 | biostudies-literature
Project description:PurposeTo investigate the effect of ComBat harmonization methods on the robustness of cardiac MRI-derived radiomic features to variations in imaging parameters.Materials and methodsThis Health Insurance Portability and Accountability Act-compliant retrospective study used a publicly available data set of 11 healthy controls (mean age, 33 years ± 16 [SD]; six men) and five patients (mean age, 52 years ± 16; four men). A single midventricular short-axis section was acquired with 3-T MRI using cine balanced steady-state free precision, T1-weighted, T2-weighted, T1 mapping, and T2 mapping imaging sequences. Each sequence was acquired using baseline parameters and after variations in flip angle, spatial resolution, section thickness, and parallel imaging. Image registration was performed for all sequences at a per-individual level. Manual myocardial contouring was performed, and 1652 radiomic features per sequence were extracted using baseline and variations in imaging parameters. Radiomic feature stability to change in imaging parameters was assessed using Cohen d sensitivity. The stability of radiomic features was assessed both without and after ComBat harmonization of radiomic features. Three ComBat methods were studied: parametric, nonparametric, and Gaussian mixture model (GMM).ResultsFor all sequences combined, 51.4% of features were robust to changes in imaging parameters when no ComBat method was applied. ComBat harmonization substantially increased the number of stable features to 95.1% (95% CI: 94.9, 95.3) when parametric ComBat was used and 90.9% (95% CI: 90.6, 91.2) when nonparametric ComBat was used. GMM combat resulted in only 52.6% stable features.ConclusionComBat harmonization improved the stability of radiomic features to changes in imaging parameters across all cardiac MRI sequences.Keywords: Cardiac MRI, Radiomics, ComBat, Harmonization Supplemental material is available for this article. © RSNA, 2023.
| S-EPMC10483256 | biostudies-literature
Project description:Multicenter studies are needed to demonstrate the clinical potential value of radiomics as a prognostic tool. However, variability in scanner models, acquisition protocols and reconstruction settings are unavoidable and radiomic features are notoriously sensitive to these factors, which hinders pooling them in a statistical analysis. A statistical harmonization method called ComBat was developed to deal with the "batch effect" in gene expression microarray data and was used in radiomics studies to deal with the "center-effect". Our goal was to evaluate modifications in ComBat allowing for more flexibility in choosing a reference and improving robustness of the estimation. Two modified ComBat versions were evaluated: M-ComBat allows to transform all features distributions to a chosen reference, instead of the overall mean, providing more flexibility. B-ComBat adds bootstrap and Monte Carlo for improved robustness in the estimation. BM-ComBat combines both modifications. The four versions were compared regarding their ability to harmonize features in a multicenter context in two different clinical datasets. The first contains 119 locally advanced cervical cancer patients from 3 centers, with magnetic resonance imaging and positron emission tomography imaging. In that case ComBat was applied with 3 labels corresponding to each center. The second one contains 98 locally advanced laryngeal cancer patients from 5 centers with contrast-enhanced computed tomography. In that specific case, because imaging settings were highly heterogeneous even within each of the five centers, unsupervised clustering was used to determine two labels for applying ComBat. The impact of each harmonization was evaluated through three different machine learning pipelines for the modelling step in predicting the clinical outcomes, across two performance metrics (balanced accuracy and Matthews correlation coefficient). Before harmonization, almost all radiomic features had significantly different distributions between labels. These differences were successfully removed with all ComBat versions. The predictive ability of the radiomic models was always improved with harmonization and the improved ComBat provided the best results. This was observed consistently in both datasets, through all machine learning pipelines and performance metrics. The proposed modifications allow for more flexibility and robustness in the estimation. They also slightly but consistently improve the predictive power of resulting radiomic models.
| S-EPMC7314795 | biostudies-literature
Project description:Radiomic features have a wide range of clinical applications, but variability due to image acquisition factors can affect their performance. The harmonization tool ComBat is a promising solution but is limited by inability to harmonize multimodal distributions, unknown imaging parameters, and multiple imaging parameters. In this study, we propose two methods for addressing these limitations. We propose a sequential method that allows for harmonization of radiomic features by multiple imaging parameters (Nested ComBat). We also employ a Gaussian Mixture Model (GMM)-based method (GMM ComBat) where scans are split into groupings based on the shape of the distribution used for harmonization as a batch effect and subsequent harmonization by a known imaging parameter. These two methods were evaluated on features extracted with CapTK and PyRadiomics from two public lung computed tomography datasets. We found that Nested ComBat exhibited similar performance to standard ComBat in reducing the percentage of features with statistically significant differences in distribution attributable to imaging parameters. GMM ComBat improved harmonization performance over standard ComBat (- 11%, - 10% for Lung3/CAPTK, Lung3/PyRadiomics harmonizing by kernel resolution). Features harmonized with a variant of the Nested method and the GMM split method demonstrated similar c-statistics and Kaplan-Meier curves when used in survival analyses.
| S-EPMC8927332 | biostudies-literature
Project description:PurposeTo facilitate the demonstration of the prognostic value of radiomics, multicenter radiomics studies are needed. Pooling radiomic features of such data in a statistical analysis is however challenging, as they are sensitive to the variability in scanner models, acquisition protocols and reconstruction settings, which is often unavoidable in a multicentre retrospective analysis. A statistical harmonization strategy called ComBat was utilized in radiomics studies to deal with the "center-effect". The goal of the present work was to integrate a transfer learning (TL) technique within ComBat-and recently developed alternate versions of ComBat with improved flexibility (M-ComBat) and robustness (B-ComBat)-to allow the use of a previously determined harmonization transform to the radiomic feature values of new patients from an already known center.Material and methodsThe proposed TL approach were incorporated in the four versions of ComBat (standard, B, M, and B-M ComBat). The proposed approach was evaluated using a dataset of 189 locally advanced cervical cancer patients from 3 centers, with magnetic resonance imaging (MRI) and positron emission tomography (PET) images, with the clinical endpoint of predicting local failure. The impact performance of the TL approach was evaluated by comparing the harmonization achieved using only parts of the data to the reference (harmonization achieved using all the available data). It was performed through three different machine learning pipelines.ResultsThe proposed TL technique was successful in harmonizing features of new patients from a known center in all versions of ComBat, leading to predictive models reaching similar performance as the ones developed using the features harmonized with all the data available.ConclusionThe proposed TL approach enables applying a previously determined ComBat transform to new, previously unseen data.
| S-EPMC8248970 | biostudies-literature
Project description:IntroductionAccurate segmentation of tumors and quantification of tumor features are important for cancer detection, diagnosis, monitoring, and planning therapeutic intervention. Due to inherent noise components in multi-parametric imaging and inter-observer and intra-observer variations, it is common that various segmentation methods may produce large segmentation errors in tumor volumes and their associated radiomic features. The purpose of this study is to carry out the stability analysis for radiomic features with respect to segmentation variation in oropharyngeal cancer (OPC).MethodsIn this study, 436 contrast-enhanced computed tomography (CT) axial images were collected from patients with OPC. In order to derive various segmentations of tumor volumes, two additional segmentations were obtained via resizing the original segmented regions of interest (ROIs) based on their geometric information on the boundary. For three ROI image groups, we calculated 109 radiomic features. Then, a logistic regression model was built to investigate the correlation between the radiomic features extracted from GTVp and the response to chemotherapy and radiation in terms of overall survival (OS). Finally, in order to evaluate the stability of each feature with respect to segmentation results, based on the prediction probabilities, we assessed the inter-rater reliability and reproducibility by calculating the intra-class correlation coefficients (ICC) and concordance correlation coefficients (CCC).ResultsMost radiomic features in this study varied a lot when the ROIs were not well segmented. For both the representation agreement and predictive agreement, the ICC and CCC were below 0.5 for all the features. We still found some robust features with relatively high ICC and CCC compared to most features. For example, 25percentile (ICC = 0.38, CCC = 0.37 in representation agreement and ICC = CCC = 0.27 in predictive agreement) is a quantile based feature, which is robust to the extremely high or low values; and Hu_1_std (ICC = 0.31, CCC = 0.31 in representation agreement) is a feature calculated based on the first Hu moment, which is invariant to the transformation of ROIs.ConclusionIn OPC studies, the tumor segmentation variation affects the radiomic features from CT images in terms of both representation and prediction. Some features that are robust to the extreme values or invariant to the transformation of ROIs may be treated as radiomic markers to assist with OPC treatment monitoring and prognostic prediction.
| S-EPMC6920497 | biostudies-literature
Project description:We aimed to evaluate radiomic features' stability across different region of interest (ROI) sizes in CT and MR images. We chose a phantom with a homogenous internal structure so no differences for a feature extracted from ROIs of different sizes would be expected. For this, we scanned a plastic cup filled with sodium chloride solution ten times in CT and per MR sequence (T1-weighted-gradient-echo and T2-weighted-turbo-inversion-recovery-magnitude). We placed sphere-shaped ROIs of different diameters (4, 8, and 16 mm, and 4, 8, and 16 pixels) into the phantom's center. Features were extracted using PyRadiomics. We assessed feature stability across ROI sizes with overall concordance correlation coefficients (OCCCs). Differences were tested for significance with the Mann-Whitney U-test. Of 93 features, 87 T1w-derived, 87 TIRM-derived, and 70 CT-derived features were significantly different between ROI sizes. Among MR-derived features, OCCCs showed excellent (>0.90) agreement for mean, median, and root mean squared for ROI sizes between 4 and 16 mm and pixels. We further observed excellent agreement for 10th and 90th percentile in T1w and 10th percentile in T2w TIRM images. There was no excellent agreement among the OCCCs of CT-derived features. In summary, many features indicated significant differences and only few showed excellent agreement across varying ROI sizes, although we examined a homogenous phantom. Since we considered a small phantom in an experimental setting, further studies to investigate this size effect would be necessary for a generalization. Nevertheless, we believe knowledge about this effect is crucial in interpreting radiomics studies, as features that supposedly discriminate disease entities may only indicate a systematic difference in ROI size.
| S-EPMC8293351 | biostudies-literature
Project description:Pooling radiomic features coming from different centers in a statistical framework is challenging due to the variability in scanner models, acquisition protocols, and reconstruction settings. To remove technical variability, commonly called batch effects, different statistical harmonization strategies have been widely used in genomics but less considered in radiomics. The aim of this work was to develop a framework of analysis to facilitate the harmonization of multicenter radiomic features extracted from prostate T2-weighted magnetic resonance imaging (MRI) and to improve the power of radiomics for prostate cancer (PCa) management in order to develop robust non-invasive biomarkers translating into clinical practice. To remove technical variability and correct for batch effects, we investigated four different statistical methods (ComBat, SVA, Arsynseq, and mixed effect). The proposed approaches were evaluated using a dataset of 210 prostate cancer (PCa) patients from two centers. The impacts of the different statistical approaches were evaluated by principal component analysis and classification methods (LogitBoost, random forest, K-nearest neighbors, and decision tree). The ComBat method outperformed all other methods by achieving 70% accuracy and 78% AUC with the random forest method to automatically classify patients affected by PCa. The proposed statistical framework enabled us to define and develop a standardized pipeline of analysis to harmonize multicenter T2W radiomic features, yielding great promise to support PCa clinical practice.
| S-EPMC9821561 | biostudies-literature
Project description:IntroductionThe standardized uptake value ratio (SUVR) is used to measure amyloid beta-positron emission tomography (Aβ-PET) uptake in the brainDifferences in PET scanner technologies and image reconstruction techniques can lead to variability in PET images across scanners. This poses a challenge for Aβ-PET studies conducted in multiple centers. The aim of harmonization is to achieve consistent Aβ-PET measurements across different scanners. In this study, we propose an Aβ-PET harmonization method of matching spatial resolution, as measured via a barrel phantom, across PET scanners. Our approach was validated using paired subject data, for which patients were imaged on multiple scanners.MethodsIn this study, three different PET scanners were evaluated: the Siemens Biograph Vision 600, Siemens Biograph molecular computed tomography (mCT), and Philips Gemini TF64. A total of five, eight, and five subjects were each scanned twice with [18F]-NAV4694 across Vision-mCT, mCT-Philips, and Vision-Philips scanner pairs. The Vision and mCT scans were reconstructed using various iterations, subsets, and post-reconstruction Gaussian smoothing, whereas only one reconstruction configuration was used for the Philips scans. The full-width at half-maximum (FWHM) of each reconstruction configuration was calculated using [18F]-filled barrel phantom scans with the Society of Nuclear Medicine and Molecular Imaging (SNMMI) phantom analysis toolkit. Regional SUVRs were calculated from 72 brain regions using the automated anatomical labelling atlas 3 (AAL3) atlas for each subject and reconstruction configuration. Statistical similarity between SUVRs was assessed using paired (within subject) t-tests for each pair of reconstructions across scanners; the higher the p-value, the greater the similarity between the SUVRs.ResultsVision-mCT harmonization: Vision reconstruction with FWHM = 4.10 mm and mCT reconstruction with FWHM = 4.30 mm gave the maximal statistical similarity (maximum p-value) between regional SUVRs. Philips-mCT harmonization: The FWHM of the Philips reconstruction was 8.2 mm and the mCT reconstruction with the FWHM of 9.35 mm, which gave the maximal statistical similarity between regional SUVRs. Philips-Vision harmonization: The Vision reconstruction with an FWHM of 9.1 mm gave the maximal statistical similarity between regional SUVRs when compared with the Philips reconstruction of 8.2 mm and were selected as the harmonized for each scanner pair.ConclusionBased on data obtained from three sets of participants, each scanned on a pair of PET scanners, it has been verified that using reconstruction configurations that produce matched-barrel, phantom spatial resolutions results in maximally harmonized Aβ-PET quantitation between scanner pairs. This finding is encouraging for the use of PET scanners in multi-center trials or updates during longitudinal studies.HighlightsQuestion: Does the process of matching the barrel phantom-derived spatial resolution between scanners harmonize amyloid beta-standardized uptake value ratio (Aβ-SUVR) quantitation? Pertinent findings: It has been validated that reconstruction pairs with matched barrel phantom-derived spatial resolution maximize the similarity between subjects paired Aβ-PET (positron emission tomography) SUVR values recorded on two scanners. Implications for patient care: Harmonization between scanners in multi-center trials and PET camera updates in longitudinal studies can be achieved using a simple and efficient phantom measurement procedure, beneficial for the validity of Aβ-PET quantitation measurements.
| S-EPMC10927914 | biostudies-literature
Project description:ObjectiveThis study aimed to identify robust radiomic features in multiultrasonography of the submandibular gland and normalize the interdevice discrepancies by applying a machine-learning-based harmonization method.MethodsUltrasonographic images of normal submandibular gland of young healthy adults, aged between 20 and 40 years, were selected from two different devices. In a total of 30 images, the region of interest was determined along the border of gland parenchyma, and 103 radiomic features were extracted using A-VIEW. The coefficient of variation (CV) was obtained for individual features, and the features showing CV less than 10% were selected. For the selected features, the interdevice discrepancy was normalized using machine-learning method, called the ComBat harmonization. Median differences of the features between the two scanners, before and after harmonization, were compared using Mann-Whitney U-test; confidence interval of 95%.ResultsAmong total 103 radiomic features, 17 features were selected as robust, showing CV less than 10% in both scanners. All values of selected features, except two, showed a statistical difference between the two devices. After applying the ComBat harmonization method, the median and distribution of the 16 features were harmonized to show no significant difference between the two scanners (p > 0.05). One feature remained different (p ≤ 0.05).ConclusionOn ultrasonographic examination, robust radiomic features for normal submandibular gland were obtained and interdevice normalization was efficiently conducted using ComBat harmonization. Our findings would be useful for multidevices or multicenter studies based on clinical ultrasonographic imaging data to improve the accuracy of the overall diagnostic model.
| S-EPMC9974233 | biostudies-literature