Dataset Information

Reproducibility of radiomics for deciphering tumor phenotype with imaging.

ABSTRACT: Radiomics (radiogenomics) characterizes tumor phenotypes based on quantitative image features derived from routine radiologic imaging to improve cancer diagnosis, prognosis, prediction and response to therapy. Although radiomic features must be reproducible to qualify as biomarkers for clinical care, little is known about how routine imaging acquisition techniques/parameters affect reproducibility. To begin to fill this knowledge gap, we assessed the reproducibility of a comprehensive, commonly-used set of radiomic features using a unique, same-day repeat computed tomography data set from lung cancer patients. Each scan was reconstructed at 6 imaging settings, varying slice thicknesses (1.25 mm, 2.5 mm and 5 mm) and reconstruction algorithms (sharp, smooth). Reproducibility was assessed using the repeat scans reconstructed at identical imaging setting (6 settings in total). In separate analyses, we explored differences in radiomic features due to different imaging parameters by assessing the agreement of these radiomic features extracted from the repeat scans reconstructed at the same slice thickness but different algorithms (3 settings in total). Our data suggest that radiomic features are reproducible over a wide range of imaging settings. However, smooth and sharp reconstruction algorithms should not be used interchangeably. These findings will raise awareness of the importance of properly setting imaging acquisition parameters in radiomics/radiogenomics research.

SUBMITTER: Zhao B

PROVIDER: S-EPMC4806325 | biostudies-literature | 2016 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reproducibility of radiomics for deciphering tumor phenotype with imaging.

Zhao Binsheng B Tan Yongqiang Y Tsai Wei-Yann WY Qi Jing J Xie Chuanmiao C Lu Lin L Schwartz Lawrence H LH

Scientific reports 20160324

Radiomics (radiogenomics) characterizes tumor phenotypes based on quantitative image features derived from routine radiologic imaging to improve cancer diagnosis, prognosis, prediction and response to therapy. Although radiomic features must be reproducible to qualify as biomarkers for clinical care, little is known about how routine imaging acquisition techniques/parameters affect reproducibility. To begin to fill this knowledge gap, we assessed the reproducibility of a comprehensive, commonly- ...[more]

PMID: 27009765

Similar Datasets

Project description:PurposeThe aim of this paper is to describe a public, open-access, computed tomography (CT) phantom image set acquired at three centers and collected especially for radiomics reproducibility research. The dataset is useful to test radiomic features reproducibility with respect to various parameters, such as acquisition settings, scanners, and reconstruction algorithms.Acquisition and validation methodsThree phantoms were scanned in three independent institutions. Images of the following phantoms were acquired: Catphan 700 and COPDGene Phantom II (Phantom Laboratory, Greenwich, NY, USA), and the Triple modality 3D Abdominal Phantom (CIRS, Norfolk, VA, USA). Data were collected at three Dutch medical centers: MAASTRO Clinic (Maastricht, NL), Radboud University Medical Center (Nijmegen, NL), and University Medical Center Groningen (Groningen, NL) with scanners from two different manufacturers Siemens Healthcare and Philips Healthcare. The following acquisition parameter were varied in the phantom scans: slice thickness, reconstruction kernels, and tube current.Data format and usage notesWe made the dataset publically available on the Dutch instance of "Extensible Neuroimaging Archive Toolkit-XNAT" (https://xnat.bmia.nl). The dataset is freely available and reusable with attribution (Creative Commons 3.0 license).Potential applicationsOur goal was to provide a findable, open-access, annotated, and reusable CT phantom dataset for radiomics reproducibility studies. Reproducibility testing and harmonization are fundamental requirements for wide generalizability of radiomics-based clinical prediction models. It is highly desirable to include only reproducible features into models, to be more assured of external validity across hitherto unseen contexts. In this view, phantom data from different centers represent a valuable source of information to exclude CT radiomic features that may already be unstable with respect to simplified structures and tightly controlled scan settings. The intended extension of our shared dataset is to include other modalities and phantoms with more realistic lesion simulations.

Project description:BackgroundTumor grade is associated with the treatment and prognosis of endometrial cancer (EC). The accurate preoperative prediction of the tumor grade is essential for EC risk stratification. Herein, we aimed to assess the performance of a multiparametric magnetic resonance imaging (MRI)-based radiomics nomogram for predicting high-grade EC.MethodsOne hundred and forty-three patients with EC who had undergone preoperative pelvic MRI were retrospectively enrolled and divided into a training set (n =100) and a validation set (n =43). Radiomic features were extracted based on T2-weighted, diffusion-weighted, and dynamic contrast-enhanced T1-weighted images. The minimum absolute contraction selection operator (LASSO) was implemented to obtain optimal radiomics features and build the rad-score. Multivariate logistic regression analysis was used to determine the clinical MRI features and build a clinical model. We developed a radiomics nomogram by combining important clinical MRI features and rad-score. A receiver operating characteristic (ROC) curve was used to evaluate the performance of the three models. The clinical net benefit of the nomogram was assessed using decision curve analysis (DCA), net reclassification index (NRI), and integrated discrimination index (IDI).ResultsIn total, 35/143 patients had high-grade EC and 108 had low-grade EC. The areas under the ROC curves of the clinical model, rad-score, and radiomics nomogram were 0.837 (95% confidence interval [CI]: 0.754-0.920), 0.875 (95% CI: 0.797-0.952), and 0.923 (95% CI: 0.869-0.977) for the training set; 0.857 (95% CI: 0.741-0.973), 0.785 (95% CI: 0.592-0.979), and 0.914 (95% CI: 0.827-0.996) for the validation set, respectively. The radiomics nomogram showed a good net benefit according to the DCA. NRIs were 0.637 (0.214-1.061) and 0.657 (0.079-1.394), and IDIs were 0.115 (0.077-0.306) and 0.053 (0.027-0.357) in the training set and validation set, respectively.ConclusionThe radiomics nomogram based on multiparametric MRI can predict the tumor grade of EC before surgery and yield a higher performance than that of dilation and curettage.

Project description:ObjectivesTo investigate the intra- and inter-rater reliability of the total radiomics quality score (RQS) and the reproducibility of individual RQS items' score in a large multireader study.MethodsNine raters with different backgrounds were randomly assigned to three groups based on their proficiency with RQS utilization: Groups 1 and 2 represented the inter-rater reliability groups with or without prior training in RQS, respectively; group 3 represented the intra-rater reliability group. Thirty-three original research papers on radiomics were evaluated by raters of groups 1 and 2. Of the 33 papers, 17 were evaluated twice with an interval of 1 month by raters of group 3. Intraclass coefficient (ICC) for continuous variables, and Fleiss' and Cohen's kappa (k) statistics for categorical variables were used.ResultsThe inter-rater reliability was poor to moderate for total RQS (ICC 0.30-055, p < 0.001) and very low to good for item's reproducibility (k - 0.12 to 0.75) within groups 1 and 2 for both inexperienced and experienced raters. The intra-rater reliability for total RQS was moderate for the less experienced rater (ICC 0.522, p = 0.009), whereas experienced raters showed excellent intra-rater reliability (ICC 0.91-0.99, p < 0.001) between the first and second read. Intra-rater reliability on RQS items' score reproducibility was higher and most of the items had moderate to good intra-rater reliability (k - 0.40 to 1).ConclusionsReproducibility of the total RQS and the score of individual RQS items is low. There is a need for a robust and reproducible assessment method to assess the quality of radiomics research.Clinical relevance statementThere is a need for reproducible scoring systems to improve quality of radiomics research and consecutively close the translational gap between research and clinical implementation.Key points• Radiomics quality score has been widely used for the evaluation of radiomics studies. • Although the intra-rater reliability was moderate to excellent, intra- and inter-rater reliability of total score and point-by-point scores were low with radiomics quality score. • A robust, easy-to-use scoring system is needed for the evaluation of radiomics research.

Dataset Information

Reproducibility of radiomics for deciphering tumor phenotype with imaging.

Publications

Reproducibility of radiomics for deciphering tumor phenotype with imaging.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets