Dataset Information

Multicenter CT phantoms public dataset for radiomics reproducibility tests.

ABSTRACT:

Purpose

The aim of this paper is to describe a public, open-access, computed tomography (CT) phantom image set acquired at three centers and collected especially for radiomics reproducibility research. The dataset is useful to test radiomic features reproducibility with respect to various parameters, such as acquisition settings, scanners, and reconstruction algorithms.

Acquisition and validation methods

Three phantoms were scanned in three independent institutions. Images of the following phantoms were acquired: Catphan 700 and COPDGene Phantom II (Phantom Laboratory, Greenwich, NY, USA), and the Triple modality 3D Abdominal Phantom (CIRS, Norfolk, VA, USA). Data were collected at three Dutch medical centers: MAASTRO Clinic (Maastricht, NL), Radboud University Medical Center (Nijmegen, NL), and University Medical Center Groningen (Groningen, NL) with scanners from two different manufacturers Siemens Healthcare and Philips Healthcare. The following acquisition parameter were varied in the phantom scans: slice thickness, reconstruction kernels, and tube current.

Data format and usage notes

We made the dataset publically available on the Dutch instance of "Extensible Neuroimaging Archive Toolkit-XNAT" (https://xnat.bmia.nl). The dataset is freely available and reusable with attribution (Creative Commons 3.0 license).

Potential applications

Our goal was to provide a findable, open-access, annotated, and reusable CT phantom dataset for radiomics reproducibility studies. Reproducibility testing and harmonization are fundamental requirements for wide generalizability of radiomics-based clinical prediction models. It is highly desirable to include only reproducible features into models, to be more assured of external validity across hitherto unseen contexts. In this view, phantom data from different centers represent a valuable source of information to exclude CT radiomic features that may already be unstable with respect to simplified structures and tightly controlled scan settings. The intended extension of our shared dataset is to include other modalities and phantoms with more realistic lesion simulations.

SUBMITTER: Kalendralis P

PROVIDER: S-EPMC6849778 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Multicenter CT phantoms public dataset for radiomics reproducibility tests.

Kalendralis Petros P Traverso Alberto A Shi Zhenwei Z Zhovannik Ivan I Monshouwer René R Starmans Martijn P A MPA Klein Stefan S Pfaehler Elisabeth E Boellaard Ronald R Dekker Andre A Wee Leonard L

Medical physics 20190129 3

<h4>Purpose</h4>The aim of this paper is to describe a public, open-access, computed tomography (CT) phantom image set acquired at three centers and collected especially for radiomics reproducibility research. The dataset is useful to test radiomic features reproducibility with respect to various parameters, such as acquisition settings, scanners, and reconstruction algorithms.<h4>Acquisition and validation methods</h4>Three phantoms were scanned in three independent institutions. Images of the ...[more]

PMID: 30629299

Similar Datasets

Project description:BackgroundAs a means to extract biomarkers from medical imaging, radiomics has attracted increased attention from researchers. However, reproducibility and performance of radiomics in low-dose CT scans are still poor, mostly due to noise. Deep learning generative models can be used to denoise these images and in turn improve radiomics' reproducibility and performance. However, most generative models are trained on paired data, which can be difficult or impossible to collect.PurposeIn this article, we investigate the possibility of denoising low-dose CTs using cycle generative adversarial networks (GANs) to improve radiomics reproducibility and performance based on unpaired datasets.Methods and materialsTwo cycle GANs were trained: (1) from paired data, by simulating low-dose CTs (i.e., introducing noise) from high-dose CTs and (2) from unpaired real low dose CTs. To accelerate convergence, during GAN training, a slice-paired training strategy was introduced. The trained GANs were applied to three scenarios: (1) improving radiomics reproducibility in simulated low-dose CT images and (2) same-day repeat low dose CTs (RIDER dataset), and (3) improving radiomics performance in survival prediction. Cycle GAN results were compared with a conditional GAN (CGAN) and an encoder-decoder network (EDN) trained on simulated paired data.ResultsThe cycle GAN trained on simulated data improved concordance correlation coefficients (CCC) of radiomic features from 0.87 (95%CI, [0.833,0.901]) to 0.93 (95%CI, [0.916,0.949]) on simulated noise CT and from 0.89 (95%CI, [0.881,0.914]) to 0.92 (95%CI, [0.908,0.937]) on the RIDER dataset, as well improving the area under the receiver operating characteristic curve (AUC) of survival prediction from 0.52 (95%CI, [0.511,0.538]) to 0.59 (95%CI, [0.578,0.602]). The cycle GAN trained on real data increased the CCCs of features in RIDER to 0.95 (95%CI, [0.933,0.961]) and the AUC of survival prediction to 0.58 (95%CI, [0.576,0.596]).ConclusionThe results show that cycle GANs trained on both simulated and real data can improve radiomics' reproducibility and performance in low-dose CT and achieve similar results compared to CGANs and EDNs.

Project description:ObjectivesTo investigate sources of variation in a multicenter rectal cancer MRI dataset focusing on hardware and image acquisition, segmentation methodology, and radiomics feature extraction software.MethodsT2W and DWI/ADC MRIs from 649 rectal cancer patients were retrospectively acquired in 9 centers. Fifty-two imaging features (14 first-order/6 shape/32 higher-order) were extracted from each scan using whole-volume (expert/non-expert) and single-slice segmentations using two different software packages (PyRadiomics/CapTk). Influence of hardware, acquisition, and patient-intrinsic factors (age/gender/cTN-stage) on ADC was assessed using linear regression. Feature reproducibility was assessed between segmentation methods and software packages using the intraclass correlation coefficient.ResultsImage features differed significantly (p < 0.001) between centers with more substantial variations in ADC compared to T2W-MRI. In total, 64.3% of the variation in mean ADC was explained by differences in hardware and acquisition, compared to 0.4% by patient-intrinsic factors. Feature reproducibility between expert and non-expert segmentations was good to excellent (median ICC 0.89-0.90). Reproducibility for single-slice versus whole-volume segmentations was substantially poorer (median ICC 0.40-0.58). Between software packages, reproducibility was good to excellent (median ICC 0.99) for most features (first-order/shape/GLCM/GLRLM) but poor for higher-order (GLSZM/NGTDM) features (median ICC 0.00-0.41).ConclusionsSignificant variations are present in multicenter MRI data, particularly related to differences in hardware and acquisition, which will likely negatively influence subsequent analysis if not corrected for. Segmentation variations had a minor impact when using whole volume segmentations. Between software packages, higher-order features were less reproducible and caution is warranted when implementing these in prediction models.Key points• Features derived from T2W-MRI and in particular ADC differ significantly between centers when performing multicenter data analysis. • Variations in ADC are mainly (> 60%) caused by hardware and image acquisition differences and less so (< 1%) by patient- or tumor-intrinsic variations. • Features derived using different image segmentations (expert/non-expert) were reproducible, provided that whole-volume segmentations were used. When using different feature extraction software packages with similar settings, higher-order features were less reproducible.

Project description:ObjectiveTo evaluate the efficacy of the CT-based intratumoral, peritumoral, and combined radiomics signatures in predicting progression-free survival (PFS) of patients with chondrosarcoma (CS).MethodsIn this study, patients diagnosed with CS between January 2009 and January 2022 were retrospectively screened, and 214 patients with CS from two centers were respectively enrolled into the training cohorts (institution 1, n = 113) and test cohorts (institution 2, n = 101). The intratumoral and peritumoral radiomics features were extracted from CT images. The intratumoral, peritumoral, and combined radiomics signatures were constructed respectively, and their radiomics scores (Rad-score) were calculated. The performance of intratumoral, peritumoral, and combined radiomics signatures in PFS prediction in patients with CS was evaluated by C-index, time-dependent area under the receiver operating characteristics curve (time-AUC), and time-dependent C-index (time C-index).ResultsEleven, 7, and 16 features were used to construct the intratumoral, peritumoral, and combined radiomics signatures, respectively. The combined radiomics signature showed the best prediction ability in the training cohort (C-index, 0.835; 95%; confidence interval [CI], 0.764-0.905) and the test cohort (C-index, 0.800; 95% CI, 0.681-0.920). Time-AUC and time C-index showed that the combined signature outperformed the intratumoral and peritumoral radiomics signatures in the prediction of PFS.ConclusionThe CT-based combined signature incorporating intratumoral and peritumoral radiomics features can predict PFS in patients with CS, which might assist clinicians in selecting individualized surveillance and treatment plans for CS patients.Critical relevance statementDevelop and validate CT-based intratumoral, peritumoral, and combined radiomics signatures to evaluate the efficacy in predicting prognosis of patients with CS.Key points• Reliable prognostic models for preoperative chondrosarcoma are lacking. • Combined radiomics signature incorporating intratumoral and peritumoral features can predict progression-free survival in patients with chondrosarcoma. • Combined radiomics signature may facilitate individualized stratification and management of patients with chondrosarcoma.

Project description:ObjectiveTo systematically review radiomic feature reproducibility and model validation strategies in recent studies dealing with CT and MRI radiomics of bone and soft-tissue sarcomas, thus updating a previous version of this review which included studies published up to 2020.MethodsA literature search was conducted on EMBASE and PubMed databases for papers published between January 2021 and March 2023. Data regarding radiomic feature reproducibility and model validation strategies were extracted and analyzed.ResultsOut of 201 identified papers, 55 were included. They dealt with radiomics of bone (n = 23) or soft-tissue (n = 32) tumors. Thirty-two (out of 54 employing manual or semiautomatic segmentation, 59%) studies included a feature reproducibility analysis. Reproducibility was assessed based on intra/interobserver segmentation variability in 30 (55%) and geometrical transformations of the region of interest in 2 (4%) studies. At least one machine learning validation technique was used for model development in 34 (62%) papers, and K-fold cross-validation was employed most frequently. A clinical validation of the model was reported in 38 (69%) papers. It was performed using a separate dataset from the primary institution (internal test) in 22 (40%), an independent dataset from another institution (external test) in 14 (25%) and both in 2 (4%) studies.ConclusionsCompared to papers published up to 2020, a clear improvement was noted with almost double publications reporting methodological aspects related to reproducibility and validation. Larger multicenter investigations including external clinical validation and the publication of databases in open-access repositories could further improve methodology and bring radiomics from a research area to the clinical stage.Critical relevance statementAn improvement in feature reproducibility and model validation strategies has been shown in this updated systematic review on radiomics of bone and soft-tissue sarcomas, highlighting efforts to enhance methodology and bring radiomics from a research area to the clinical stage.Key points• 2021-2023 radiomic studies on CT and MRI of musculoskeletal sarcomas were reviewed. • Feature reproducibility was assessed in more than half (59%) of the studies. • Model clinical validation was performed in 69% of the studies. • Internal (44%) and/or external (29%) test datasets were employed for clinical validation.

Dataset Information

Multicenter CT phantoms public dataset for radiomics reproducibility tests.

Purpose

Acquisition and validation methods

Data format and usage notes

Potential applications

Publications

Multicenter CT phantoms public dataset for radiomics reproducibility tests.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets