Dataset Information

Experimental Multicenter and Multivendor Evaluation of the Performance of PET Radiomic Features Using 3-Dimensionally Printed Phantom Inserts.

ABSTRACT: The sensitivity of radiomic features to several confounding factors, such as reconstruction settings, makes clinical use challenging. To investigate the impact of harmonized image reconstructions on feature consistency, a multicenter phantom study was performed using 3-dimensionally printed phantom inserts reflecting realistic tumor shapes and heterogeneity uptakes. Methods: Tumors extracted from real PET/CT scans of patients with non-small cell lung cancer served as model for three 3-dimensionally printed inserts. Different heterogeneity pattern were realized by printing separate compartments that could be filled with different activity solutions. The inserts were placed in the National Electrical Manufacturers Association image-quality phantom and scanned various times. First, a list-mode scan was acquired and 5 statistically equal replicates were reconstructed. Second, the phantom was scanned 4 times on the same scanner. Third, the phantom was scanned on 6 PET/CT systems. All images were reconstructed using EANM Research Ltd. (EARL)-compliant and locally clinically preferred reconstructions. EARL-compliant reconstructions were performed without (EARL1) or with (EARL2) point-spread function. Images were analyzed with and without resampling to 2-mm cubic voxels. Images were discretized with a fixed bin width (FBW) of 0.25 and a fixed bin number (FBN) of 64. The intraclass correlation coefficient (ICC) of each scan setup was calculated and compared across reconstruction settings. An ICC above 0.75 was regarded as high. Results: The percentage of features yielding a high ICC was largest for the statistically equal replicates (70%-91% for FBN; 90%-96% for FBW discretization). For scans acquired on the same system, the percentage decreased, but most features still resulted in a high ICC (FBN, 52%-63%; FBW, 75%-85%). The percentage of features yielding a high ICC decreased more in the multicenter setting. In this case, the percentage of features yielding a high ICC was larger for images reconstructed with EARL-compliant reconstructions: for example, 40% for EARL1 and 60% for EARL2 versus 21% for the clinically preferred setting for FBW discretization. When discretized with FBW and resampled to isotropic voxels, this benefit was more pronounced. Conclusion: EARL-compliant reconstructions harmonize a wide range of radiomic features. FBW discretization and a sampling to isotropic voxels enhances the benefits of EARL-compliant reconstructions.

SUBMITTER: Pfaehler E

PROVIDER: S-EPMC7067530 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Experimental Multicenter and Multivendor Evaluation of the Performance of PET Radiomic Features Using 3-Dimensionally Printed Phantom Inserts.

Pfaehler Elisabeth E van Sluis Joyce J Merema Bram B J BBJ van Ooijen Peter P Berendsen Ralph C M RCM van Velden Floris H P FHP Boellaard Ronald R

Journal of nuclear medicine : official publication, Society of Nuclear Medicine 20190816 3

The sensitivity of radiomic features to several confounding factors, such as reconstruction settings, makes clinical use challenging. To investigate the impact of harmonized image reconstructions on feature consistency, a multicenter phantom study was performed using 3-dimensionally printed phantom inserts reflecting realistic tumor shapes and heterogeneity uptakes. <b>Methods:</b> Tumors extracted from real PET/CT scans of patients with non-small cell lung cancer served as model for three 3-dim ...[more]

PMID: 31420497

Similar Datasets

Project description:BackgroundRadiomics analysis usually involves, especially in multicenter and large hospital studies, different imaging protocols for acquisition, reconstruction, and processing of data. Differences in protocols can lead to differences in the quantification of the biomarker distribution, leading to radiomic feature variability. The aim of our study was to identify those radiomic features robust to the different degrading factors in positron emission tomography (PET) studies. We proposed the use of the standardized measurements of the European Association Research Ltd. (EARL) accreditation to retrospectively identify the radiomic features having low variability to the different systems and reconstruction protocols. In addition, we presented a reproducible procedure to identify PET radiomic features robust to PET/CT imaging metal artifacts. In 27 heterogeneous homemade phantoms for which ground truth was accurately defined by CT segmentation, we evaluated the segmentation accuracy and radiomic feature reliability given by the contrast-oriented algorithm (COA) and the 40% threshold PET segmentation. In the comparison of two data sets, robustness was defined by Wilcoxon rank tests, bias was quantified by Bland-Altman (BA) plot analysis, and strong correlations were identified by Spearman correlation test (r > 0.8 and p satisfied multiple test Bonferroni correction).ResultsForty-eight radiomic features were robust to system, 22 to resolution, 102 to metal artifacts, and 42 to different PET segmentation tools. Overall, only 4 radiomic features were simultaneously robust to all degrading factors. Although both segmentation approaches significantly underestimated the volume with respect to the ground truth, with relative deviations of -62 ± 36% for COA and -50 ± 44% for 40%, radiomic features derived from the ground truth were strongly correlated and/or robust to 98 radiomic features derived from COA and to 102 from 40%.ConclusionIn multicenter studies, we recommend the analysis of EARL accreditation measurements in order to retrospectively identify the robust PET radiomic features. Furthermore, 4 radiomic features (area under the curve of the cumulative SUV volume histogram, skewness, kurtosis, and gray-level variance derived from GLRLM after application of an equal probability quantization algorithm on the voxels within lesion) were robust to all degrading factors. In addition, the feasibility of 40% and COA segmentations for their use in radiomics analysis has been demonstrated.

Project description:BackgroundRadiomic features, extracted from positron emission tomography, aim to characterize tumour biology based on tracer intensity, tumour geometry and/or tracer uptake heterogeneity. Currently, radiomic features are derived from static images. However, temporal changes in tracer uptake might reveal new aspects of tumour biology. This study aims to explore additional information of these novel dynamic radiomic features compared to those derived from static or metabolic rate images.MethodsThirty-five patients with non-small cell lung carcinoma underwent dynamic [18F]FDG PET/CT scans. Spatial intensity, shape and texture radiomic features were derived from volumes of interest delineated on static PET and parametric metabolic rate PET. Dynamic grey level cooccurrence matrix (GLCM) and grey level run length matrix (GLRLM) features, assessing the temporal domain unidirectionally, were calculated on eight and sixteen time frames of equal length. Spearman's rank correlations of parametric and dynamic features with static features were calculated to identify features with potential additional information. Survival analysis was performed for the non-redundant temporal features and a selection of static features using Kaplan-Meier analysis.ResultsThree out of 90 parametric features showed moderate correlations with corresponding static features (ρ≥0.61), all other features showed high correlations (ρ>0.7). Dynamic features are robust independent of frame duration. Five out of 22 dynamic GLCM features showed a negligible to moderate correlation with any static feature, suggesting additional information. All sixteen dynamic GLRLM features showed high correlations with static features, implying redundancy. Log-rank analyses of Kaplan-Meier survival curves for all features dichotomised at the median were insignificant.ConclusionThis study suggests that, compared to static features, some dynamic GLCM radiomic features show different information, whereas parametric features provide minimal additional information. Future studies should be conducted in larger populations to assess whether there is a clinical benefit of radiomics using the temporal domain over traditional radiomics.

Project description:IntroductionOne major challenge in PET radiomics is its sensitivity to noise. Low signal-to-noise ratio (SNR) affects not only the precision but also the accuracy of quantitative metrics extracted from the images resulting in noise-induced bias. This phantom study aims to identify the radiomic features that are robust to noise in terms of precision and accuracy and to explore some methods that might help to correct noise-induced bias.MethodsA phantom containing three 18F-FDG filled 3D printed inserts, reflecting heterogeneous tracer uptake and realistic tumor shapes, was used in the study. The three different phantom inserts were filled and scanned with three different tumor-to-background ratios, simulating a total of nine different tumors. From the 40-minute list-mode data, ten frames each for 5 s, 10 s, 30 s, and 120 s frame duration were reconstructed to generate images with different noise levels. Under these noise conditions, the precision and accuracy of the radiomic features were analyzed using intraclass correlation coefficient (ICC) and similarity distance metric (SDM) respectively. Based on the ICC and SDM values, the radiomic features were categorized into four groups: poor, moderate, good, and excellent precision and accuracy. A "difference image" created by subtracting two statistically equivalent replicate images was used to develop a model to correct the noise-induced bias. Several regression methods (e.g., linear, exponential, sigmoid, and power-law) were tested. The best fitting model was chosen based on Akaike information criteria.ResultsSeveral radiomic features derived from low SNR images have high repeatability, with 68% of radiomic features having ICC ≥ 0.9 for images with a frame duration of 5 s. However, most features show a systematic bias that correlates with the increase in noise level. Out of 143 features with noise-induced bias, the SDM values were improved based on a regression model (53 features to excellent and 67 to good) indicating that the noise-induced bias of these features can be, at least partially, corrected.ConclusionTo have a predictive value, radiomic features should reflect tumor characteristics and be minimally affected by noise. The present study has shown that it is possible to correct for noise-induced bias, at least in a subset of the features, using a regression model based on the local image noise estimates.

Project description:Boron-10-containing positron emission tomography (PET) radio-tracer, 18F-FBPA, has been used to evaluate the feasibility and treatment outcomes of Boron neutron capture therapy (BNCT). The clinical use of PET/MR is increasing and reveals its benefit in certain applications. However, the PET/CT is still the most widely used modality for daily PET practice due to its high quantitative accuracy and relatively low cost. Considering the different attenuation correction maps between PET/CT and PET/MR, comparison of derived image features from these two modalities is critical to identify quantitative imaging biomarkers for diagnosis and prognosis. This study aimed to investigate the comparability of image features extracted from 18F-FBPA PET/CT and PET/MR. A total of 15 patients with malignant brain tumor who underwent 18F-FBPA examinations using both PET/CT and PET/MR on the same day were retrospectively analyzed. Overall, four conventional imaging characteristics and 449 radiomic features were calculated from PET/CT and PET/MR, respectively. A linear regression model and intraclass correlation coefficient (ICC) were estimated to evaluate the comparability of derived features between two modalities. Features were classified into strong, moderate, and weak comparability based on coefficient of determination (r2) and ICC. All of the conventional features, 81.2% of histogram, 37.5% of geometry, 51.5% of texture, and 25% of wavelet-based features, showed strong comparability between PET/CT and PET/MR. With regard to the wavelet filtering, radiomic features without filtering (61.2%) or with low-pass filtering (59.2%) along three axes produced strong comparability between the two modalities. However, only 8.2% of the features with high-pass filtering showed strong comparability. The linear regression models were provided for the features with strong and moderate consensus to interchange the quantitative features between the PET/CT and the PET/MR. All of the conventional and 71% of the radiomic (mostly histogram and texture) features were sufficiently stable and could be interchanged between 18F-FBPA PET with different hybrid modalities using the proposed equations. Our findings suggested that the image features high interchangeability may facilitate future studies in comparing PET/CT and PET/MR.

Dataset Information

Experimental Multicenter and Multivendor Evaluation of the Performance of PET Radiomic Features Using 3-Dimensionally Printed Phantom Inserts.

Publications

Experimental Multicenter and Multivendor Evaluation of the Performance of PET Radiomic Features Using 3-Dimensionally Printed Phantom Inserts.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets