Dataset Information

The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping.

ABSTRACT: Background Radiomic features may quantify characteristics present in medical imaging. However, the lack of standardized definitions and validated reference values have hampered clinical use. Purpose To standardize a set of 174 radiomic features. Materials and Methods Radiomic features were assessed in three phases. In phase I, 487 features were derived from the basic set of 174 features. Twenty-five research teams with unique radiomics software implementations computed feature values directly from a digital phantom, without any additional image processing. In phase II, 15 teams computed values for 1347 derived features using a CT image of a patient with lung cancer and predefined image processing configurations. In both phases, consensus among the teams on the validity of tentative reference values was measured through the frequency of the modal value and classified as follows: less than three matches, weak; three to five matches, moderate; six to nine matches, strong; 10 or more matches, very strong. In the final phase (phase III), a public data set of multimodality images (CT, fluorine 18 fluorodeoxyglucose PET, and T1-weighted MRI) from 51 patients with soft-tissue sarcoma was used to prospectively assess reproducibility of standardized features. Results Consensus on reference values was initially weak for 232 of 302 features (76.8%) at phase I and 703 of 1075 features (65.4%) at phase II. At the final iteration, weak consensus remained for only two of 487 features (0.4%) at phase I and 19 of 1347 features (1.4%) at phase II. Strong or better consensus was achieved for 463 of 487 features (95.1%) at phase I and 1220 of 1347 features (90.6%) at phase II. Overall, 169 of 174 features were standardized in the first two phases. In the final validation phase (phase III), most of the 169 standardized features could be excellently reproduced (166 with CT; 164 with PET; and 164 with MRI). Conclusion A set of 169 radiomics features was standardized, which enabled verification and calibration of different radiomics software. © RSNA, 2020 Online supplemental material is available for this article. See also the editorial by Kuhl and Truhn in this issue.

SUBMITTER: Zwanenburg A

PROVIDER: S-EPMC7193906 | biostudies-literature | 2020 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping.

Zwanenburg Alex A Vallières Martin M Abdalah Mahmoud A MA Aerts Hugo J W L HJWL Andrearczyk Vincent V Apte Aditya A Ashrafinia Saeed S Bakas Spyridon S Beukinga Roelof J RJ Boellaard Ronald R Bogowicz Marta M Boldrini Luca L Buvat Irène I Cook Gary J R GJR Davatzikos Christos C Depeursinge Adrien A Desseroit Marie-Charlotte MC Dinapoli Nicola N Dinh Cuong Viet CV Echegaray Sebastian S El Naqa Issam I Fedorov Andriy Y AY Gatta Roberto R Gillies Robert J RJ Goh Vicky V Götz Michael M Guckenberger Matthias M Ha Sung Min SM Hatt Mathieu M Isensee Fabian F Lambin Philippe P Leger Stefan S Leijenaar Ralph T H RTH Lenkowicz Jacopo J Lippert Fiona F Losnegård Are A Maier-Hein Klaus H KH Morin Olivier O Müller Henning H Napel Sandy S Nioche Christophe C Orlhac Fanny F Pati Sarthak S Pfaehler Elisabeth A G EAG Rahmim Arman A Rao Arvind U K AUK Scherer Jonas J Siddique Muhammad Musib MM Sijtsema Nanna M NM Socarras Fernandez Jairo J Spezi Emiliano E Steenbakkers Roel J H M RJHM Tanadini-Lang Stephanie S Thorwarth Daniela D Troost Esther G C EGC Upadhaya Taman T Valentini Vincenzo V van Dijk Lisanne V LV van Griethuysen Joost J van Velden Floris H P FHP Whybra Philip P Richter Christian C Löck Steffen S

Radiology 20200310 2

Background Radiomic features may quantify characteristics present in medical imaging. However, the lack of standardized definitions and validated reference values have hampered clinical use. Purpose To standardize a set of 174 radiomic features. Materials and Methods Radiomic features were assessed in three phases. In phase I, 487 features were derived from the basic set of 174 features. Twenty-five research teams with unique radiomics software implementations computed feature values directly fr ...[more]

PMID: 32154773

Similar Datasets

Project description:BackgroundIn order to select for quantitative plant resistance to pathogens, high throughput approaches that can precisely quantify disease severity are needed. Automation and use of calibrated image analysis should provide more accurate, objective and faster analyses than visual assessments. In contrast to conventional visible imaging, chlorophyll fluorescence imaging is not sensitive to environmental light variations and provides single-channel images prone to a segmentation analysis by simple thresholding approaches. Among the various parameters used in chlorophyll fluorescence imaging, the maximum quantum yield of photosystem II photochemistry (Fv/Fm) is well adapted to phenotyping disease severity. Fv/Fm is an indicator of plant stress that displays a robust contrast between infected and healthy tissues. In the present paper, we aimed at the segmentation of Fv/Fm images to quantify disease severity.ResultsBased on the Fv/Fm values of each pixel of the image, a thresholding approach was developed to delimit diseased areas. A first step consisted in setting up thresholds to reproduce visual observations by trained raters of symptoms caused by Xanthomonas fuscans subsp. fuscans (Xff) CFBP4834-R on Phaseolus vulgaris cv. Flavert. In order to develop a thresholding approach valuable on any cultivars or species, a second step was based on modeling pixel-wise Fv/Fm-distributions as mixtures of Gaussian distributions. Such a modeling may discriminate various stages of the symptom development but over-weights artifacts that can occur on mock-inoculated samples. Therefore, we developed a thresholding approach based on the probability of misclassification of a healthy pixel. Then, a clustering step is performed on the diseased areas to discriminate between various stages of alteration of plant tissues. Notably, the use of chlorophyll fluorescence imaging could detect pre-symptomatic area. The interest of this image analysis procedure for assessing the levels of quantitative resistance is illustrated with the quantitation of disease severity on five commercial varieties of bean inoculated with Xff CFBP4834-R.ConclusionsIn this paper, we describe an image analysis procedure for quantifying the leaf area impacted by the pathogen. In a perspective of high throughput phenotyping, the procedure was automated with the software R downloadable at http://www.r-project.org/. The R script is available at http://lisa.univ-angers.fr/PHENOTIC/telechargements.html.

Project description:The image biomarkers standardization initiative (IBSI) was formed to address the standardization of extraction of quantifiable imaging metrics. Despite its effort, there remains a lack of consensus or established guidelines regarding radiomic feature terminology, the underlying mathematics and their implementation across various software programs. This creates a scenario where features extracted using different toolboxes cannot be used to build or validate the same model leading to a non-generalization of radiomic results. In this study, IBSI-established phantom and benchmark values were used to compare the variation of the radiomic features while using 6 publicly available software programs and 1 in-house radiomics pipeline. All IBSI-standardized features (11 classes, 173 in total) were extracted. The relative differences between the extracted feature values from the different software programs and the IBSI benchmark values were calculated to measure the inter-software agreement. To better understand the variations, features are further grouped into 3 categories according to their properties: 1) morphology, 2) statistic/histogram and 3)texture features. While a good agreement was observed for a majority of radiomics features across the various tested programs, relatively poor agreement was observed for morphology features. Significant differences were also found in programs that use different gray-level discretization approaches. Since these software programs do not include all IBSI features, the level of quantitative assessment for each category was analyzed using Venn and UpSet diagrams and quantified using two ad hoc metrics. Morphology features earned lowest scores for both metrics, indicating that morphological features are not consistently evaluated among software programs. We conclude that radiomic features calculated using different software programs may not be interchangeable. Further studies are needed to standardize the workflow of radiomic feature extraction.

Project description:Canopy temperature (CT) has been related to water-use and yield formation in crops. However, constantly (e.g., sun illumination angle, ambient temperature) as well as rapidly (e.g., clouds) changing environmental conditions make it difficult to compare measurements taken even at short time intervals. This poses a great challenge for high-throughput field phenotyping (HTFP). The aim of this study was to i) set up a workflow for unmanned aerial vehicles (UAV) based HTFP of CT, ii) investigate different data processing procedures to combine information from multiple images into orthomosaics, iii) investigate the repeatability of the resulting CT by means of heritability, and iv) investigate the optimal timing for thermography measurements. Additionally, the approach was v) compared with other methods for HTFP of CT. The study was carried out in a winter wheat field trial with 354 genotypes planted in two replications in a temperate climate, where a UAV captured CT in a time series of 24 flights during 6 weeks of the grain-filling phase. Custom-made thermal ground control points enabled accurate georeferencing of the data. The generated thermal orthomosaics had a high spatial accuracy (mean ground sampling distance of 5.03 cm/pixel) and position accuracy [mean root-mean-square deviation (RMSE) = 4.79 cm] over all time points. An analysis on the impact of the measurement geometry revealed a gradient of apparent CT in parallel to the principle plane of the sun and a hotspot around nadir. Averaging information from all available images (and all measurement geometries) for an area of interest provided the best results by means of heritability. Correcting for spatial in-field heterogeneity as well as slight environmental changes during the measurements were performed with the R package SpATS. CT heritability ranged from 0.36 to 0.74. Highest heritability values were found in the early afternoon. Since senescence was found to influence the results, it is recommended to measure CT in wheat after flowering and before the onset of senescence. Overall, low-altitude and high-resolution remote sensing proved suitable to assess the CT of crop genotypes in a large number of small field plots as is required in crop breeding and variety testing experiments.

Project description:BackgroundMaize (Zea mays L.) is one of the most important food sources in the world and has been one of the main targets of plant genetics and phenotypic research for centuries. Observation and analysis of various morphological phenotypic traits during maize growth are essential for genetic and breeding study. The generally huge number of samples produce an enormous amount of high-resolution image data. While high throughput plant phenotyping platforms are increasingly used in maize breeding trials, there is a reasonable need for software tools that can automatically identify visual phenotypic features of maize plants and implement batch processing on image datasets.ResultsOn the boundary between computer vision and plant science, we utilize advanced deep learning methods based on convolutional neural networks to empower the workflow of maize phenotyping analysis. This paper presents Maize-IAS (Maize Image Analysis Software), an integrated application supporting one-click analysis of maize phenotype, embedding multiple functions: (I) Projection, (II) Color Analysis, (III) Internode length, (IV) Height, (V) Stem Diameter and (VI) Leaves Counting. Taking the RGB image of maize as input, the software provides a user-friendly graphical interaction interface and rapid calculation of multiple important phenotypic characteristics, including leaf sheath points detection and leaves segmentation. In function Leaves Counting, the mean and standard deviation of difference between prediction and ground truth are 1.60 and 1.625.ConclusionThe Maize-IAS is easy-to-use and demands neither professional knowledge of computer vision nor deep learning. All functions for batch processing are incorporated, enabling automated and labor-reduced tasks of recording, measurement and quantitative analysis of maize growth traits on a large dataset. We prove the efficiency and potential capability of our techniques and software to image-based plant research, which also demonstrates the feasibility and capability of AI technology implemented in agriculture and plant science.

Dataset Information

The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping.

Publications

The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets