Browse
Submit Data
Databases
API
Help

Dataset Information

29 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Lung nodule detection in chest X-rays using synthetic ground-truth data comparing CNN-based diagnosis to human performance.

ABSTRACT: We present a method to generate synthetic thorax radiographs with realistic nodules from CT scans, and a perfect ground truth knowledge. We evaluated the detection performance of nine radiologists and two convolutional neural networks in a reader study. Nodules were artificially inserted into the lung of a CT volume and synthetic radiographs were obtained by forward-projecting the volume. Hence, our framework allowed for a detailed evaluation of CAD systems' and radiologists' performance due to the availability of accurate ground-truth labels for nodules from synthetic data. Radiographs for network training (U-Net and RetinaNet) were generated from 855 CT scans of a public dataset. For the reader study, 201 radiographs were generated from 21 nodule-free CT scans with altering nodule positions, sizes and nodule counts of inserted nodules. Average true positive detections by nine radiologists were 248.8 nodules, 51.7 false positive predicted nodules and 121.2 false negative predicted nodules. The best performing CAD system achieved 268 true positives, 66 false positives and 102 false negatives. Corresponding weighted alternative free response operating characteristic figure-of-merits (wAFROC FOM) for the radiologists range from 0.54 to 0.87 compared to a value of 0.81 (CI 0.75-0.87) for the best performing CNN. The CNN did not perform significantly better against the combined average of the 9 readers (p = 0.49). Paramediastinal nodules accounted for most false positive and false negative detections by readers, which can be explained by the presence of more tissue in this area.

SUBMITTER: Schultheiss M

PROVIDER: S-EPMC8339004 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Chest X-ray dataset and ground truth for lung segmentation.

Project description:Chest X-ray images are a valuable tool for accurately and efficiently diagnosing Covid-19 with the assistance of computer technology. These images enable the detection of diseases in internal organs, particularly the lungs, by providing crucial information about the pathological state of the lungs and other internal organs and tissues. Segmentation plays an essential role in the earliest stages of disease detection through computer-assisted analysis of medical images. This method enables the extraction of significant elements from the image, facilitating the identification of relevant areas. In the subsequent stage, healthcare professionals might acquire more precise diagnosis outcomes. Deep learning plays a significant role in developing models to achieve exact and efficient diagnostic results in picture segmentation and image classification procedures. However, using deep learning models in the image segmentation process necessitates the availability of image datasets and ground truth that radiologists have validated to facilitate the training process. The dataset provided in this article comprises 292 chest X-ray images obtained from Airlangga University Hospital in Indonesia. These images are accompanied with ground truth data that has been meticulously verified by radiologists. The offered X-ray images encompass those of patients diagnosed with Covid-19, pneumonia and those representing normal conditions. The provided dataset exhibits potential utility in advancing artificial intelligence techniques for segmentation and classification procedures.

| S-EPMC10570962 | biostudies-literature

COVID19 Diagnosis Using Chest X-rays and Transfer Learning.

Project description:A pandemic of respiratory illnesses from a novel coronavirus known as Sars-CoV-2 has swept across the globe since December of 2019. This is calling upon the research community including medical imaging to provide effective tools for use in combating this virus. Research in biomedical imaging of viral patients is already very active with machine learning models being created for diagnosing Sars-CoV-2 infections in patients using CT scans and chest x-rays. We aim to build upon this research. Here we used a transfer-learning approach to develop models capable of diagnosing COVID19 from chest x-ray. For this work we compiled a dataset of 112120 negative images from the Chest X-Ray 14 and 2725 positive images from public repositories. We tested multiple models, including logistic regression and random forest and XGBoost with and without principal components analysis, using five-fold cross-validation to evaluate recall, precision, and f1-score. These models were compared to a pre-trained deep-learning model for evaluating chest x-rays called COVID-Net. Our best model was XGBoost with principal components with a recall, precision, and f1-score of 0.692, 0.960, 0.804 respectively. This model greatly outperformed COVID-Net which scored 0.987, 0.025, 0.048. This model, with its high precision and reasonable sensitivity, would be most useful as "rule-in" test for COVID19. Though it outperforms some chemical assays in sensitivity, this model should be studied in patients who would not ordinarily receive a chest x-ray before being used for screening.Ccs conceptsLife and Medical Sciences • Machine Learning • Artificial Intelligence.Reference formatJonathan Stubblefield, Jason Causey, Dakota Dale, Jake Qualls, Emily Bellis, Jennifer Fowler, Karl Walker and Xiuzhen Huang. 2022. COVID19 Diagnosis Using Chest X-Rays and Transfer Learning.

| S-EPMC9580378 | biostudies-literature

cdev: a ground-truth based measure to evaluate RNA-seq normalization performance.

Project description:Normalization of RNA-seq data has been an active area of research since the problem was first recognized a decade ago. Despite the active development of new normalizers, their performance measures have been given little attention. To evaluate normalizers, researchers have been relying on ad hoc measures, most of which are either qualitative, potentially biased, or easily confounded by parametric choices of downstream analysis. We propose a metric called condition-number based deviation, or cdev, to quantify normalization success. cdev measures how much an expression matrix differs from another. If a ground truth normalization is given, cdev can then be used to evaluate the performance of normalizers. To establish experimental ground truth, we compiled an extensive set of public RNA-seq assays with external spike-ins. This data collection, together with cdev, provides a valuable toolset for benchmarking new and existing normalization methods.

| S-EPMC8496462 | biostudies-literature

A large dataset of synthetic SEM images of powder materials and their ground truth 3D structures.

Project description:This data article presents a data set comprised of 2048 synthetic scanning electron microscope (SEM) images of powder materials and descriptions of the corresponding 3D structures that they represent. These images were created using open source rendering software, and the generating scripts are included with the data set. Eight particle size distributions are represented with 256 independent images from each. The particle size distributions are relatively similar to each other, so that the dataset offers a useful benchmark to assess the fidelity of image analysis techniques. The characteristics of the PSDs and the resulting images are described and analyzed in more detail in the research article "Characterizing powder materials using keypoint-based computer vision methods" (B.L. DeCost, E.A. Holm, 2016) [1]. These data are freely available in a Mendeley Data archive "A large dataset of synthetic SEM images of powder materials and their ground truth 3D structures" (B.L. DeCost, E.A. Holm, 2016) located at http://dx.doi.org/10.17632/tj4syyj9mr.1[2] for any academic, educational, or research purposes.

| S-EPMC5094155 | biostudies-literature

Comparing different versions of computer-aided detection products when reading chest X-rays for tuberculosis.

Project description:Computer-aided detection (CAD) was recently recommended by the WHO for TB screening and triage based on several evaluations, but unlike traditional diagnostic tests, software versions are updated frequently and require constant evaluation. Since then, newer versions of two of the evaluated products have already been released. We used a case control sample of 12,890 chest X-rays to compare performance and model the programmatic effect of upgrading to newer versions of CAD4TB and qXR. We compared the area under the receiver operating characteristic curve (AUC), overall, and with data stratified by age, TB history, gender, and patient source. All versions were compared against radiologist readings and WHO's Target Product Profile (TPP) for a TB triage test. Both newer versions significantly outperformed their predecessors in terms of AUC: CAD4TB version 6 (0.823 [0.816-0.830]), version 7 (0.903 [0.897-0.908]) and qXR version 2 (0.872 [0.866-0.878]), version 3 (0.906 [0.901-0.911]). Newer versions met WHO TPP values, older versions did not. All products equalled or surpassed the human radiologist performance with improvements in triage ability in newer versions. Humans and CAD performed worse in older age groups and among those with TB history. New versions of CAD outperform their predecessors. Prior to implementation CAD should be evaluated using local data because underlying neural networks can differ significantly. An independent rapid evaluation centre is necessitated to provide implementers with performance data on new versions of CAD products as they are developed.

| S-EPMC9931298 | biostudies-literature

iBench Ground Truth Validation Tool

Project description:iBench is an open-source tool that provides enhanced validation of Mass Spectrometry identification methods. For this project, iBench was applied to Percolator rescored results from Mascot searches from a tryptic digestion of the K562 proteome, HLA-I immunopeptidome experiment, and synthetic peptide libraries. Here we provide the Mascot search results which were benchmarked as well as the original searches used to generate the ground truth identifications. These search results were generated by reprocessing RAW data from the PXD031709, PXD034056 and PXD031812 repositories.

2022-10-11 | PXD034968 | Pride

IVL-SYNTHSFM-v2: A synthetic dataset with exact ground truth for the evaluation of 3D reconstruction pipelines.

Project description:This article presents a dataset with 4000 synthetic images portraying five 3D models from different viewpoints under varying lighting conditions. Depth of field and motion blur have also been used to generate realistic images. For each object, 8 scenes with different combinations of lighting, depth of field and motion blur are created and images are taken from 100 points of view. Data also includes information about camera intrinsic and extrinsic calibration parameters for each image as well as the ground truth geometry of the 3D models. The images were rendered using Blender. The aim of this dataset is to allow evaluation and comparison of different solutions for 3D reconstruction of objects starting from a set of images taken under different realistic acquisition setups.

| S-EPMC6971370 | biostudies-literature

COVID-19 diagnosis from chest x-rays: developing a simple, fast, and accurate neural network.

Project description:PurposeChest x-rays are a fast and inexpensive test that may potentially diagnose COVID-19, the disease caused by the novel coronavirus. However, chest imaging is not a first-line test for COVID-19 due to low diagnostic accuracy and confounding with other viral pneumonias. Recent research using deep learning may help overcome this issue as convolutional neural networks (CNNs) have demonstrated high accuracy of COVID-19 diagnosis at an early stage.MethodsWe used the COVID-19 Radiography database [36], which contains x-ray images of COVID-19, other viral pneumonia, and normal lungs. We developed a CNN in which we added a dense layer on top of a pre-trained baseline CNN (EfficientNetB0), and we trained, validated, and tested the model on 15,153 X-ray images. We used data augmentation to avoid overfitting and address class imbalance; we used fine-tuning to improve the model's performance. From the external test dataset, we calculated the model's accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and F1-score.ResultsOur model differentiated COVID-19 from normal lungs with 95% accuracy, 90% sensitivity, and 97% specificity; it differentiated COVID-19 from other viral pneumonia and normal lungs with 93% accuracy, 94% sensitivity, and 95% specificity.ConclusionsOur parsimonious CNN shows that it is possible to differentiate COVID-19 from other viral pneumonia and normal lungs on x-ray images with high accuracy. Our method may assist clinicians with making more accurate diagnostic decisions and support chest X-rays as a valuable screening tool for the early, rapid diagnosis of COVID-19.Supplementary informationThe online version contains supplementary material available at 10.1007/s13755-021-00166-4.

| S-EPMC8509906 | biostudies-literature

iBench Ground Truth Validation Tool 2.0

Project description:iBench is an open-source tool that provides enhanced validation of Mass Spectrometry identification methods. In this updated version, iBench 2.0 takes high confidence peptide identifications from previously measured MS data and embeds the sequences in an in silico-only proteome as spliced or non-spliced peptides. The MS data can then be reanalyzed with the modified proteome, thereby representing a (pseudo) ground truth dataset, to enable benchmarking of an identification method. In particular, precision-recall curves are generated, comparing the fraction of PSMs identified which are correct and the fraction of all PSMs assigned by a method.Reference to this dataset:Soh WT, Roetschke HP, Cormican JA, Teo BF, Chiam NC, Raabe M, Pflanz R, Henneberg F, Becker S, Chari A, Liu H, Urlaub H, Liepe J, Mishto M. Degradation of proteins by human 20S proteasomes sheds light on the interplay between peptide hydrolysis and peptide splicing. Nat. Comm., accepted.

2023-12-21 | PXD044451 | Pride

Object Segmentation and Ground Truth in 3D Embryonic Imaging.

Project description:Many questions in developmental biology depend on measuring the position and movement of individual cells within developing embryos. Yet, tools that provide this data are often challenged by high cell density and their accuracy is difficult to measure. Here, we present a three-step procedure to address this problem. Step one is a novel segmentation algorithm based on image derivatives that, in combination with selective post-processing, reliably and automatically segments cell nuclei from images of densely packed tissue. Step two is a quantitative validation using synthetic images to ascertain the efficiency of the algorithm with respect to signal-to-noise ratio and object density. Finally, we propose an original method to generate reliable and experimentally faithful ground truth datasets: Sparse-dense dual-labeled embryo chimeras are used to unambiguously measure segmentation errors within experimental data. Together, the three steps outlined here establish a robust, iterative procedure to fine-tune image analysis algorithms and microscopy settings associated with embryonic 3D image data sets.

| S-EPMC4917178 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data