Evaluating imaging and computer-aided detection and diagnosis devices at the FDA.
Ontology highlight
ABSTRACT:
SUBMITTER: Gallas BD
PROVIDER: S-EPMC5557046 | biostudies-other | 2012 Apr
REPOSITORIES: biostudies-other
Similar Datasets
Project description:MotivationRadiologists have used algorithms for Computer-Aided Diagnosis (CAD) for decades. These algorithms use machine learning with engineered features, and there have been mixed findings on whether they improve radiologists' interpretations. Deep learning offers superior performance but requires more training data and has not been evaluated in joint algorithm-radiologist decision systems.ResultsWe developed the Computer-Aided Note and Diagnosis Interface (CANDI) for collaboratively annotating radiographs and evaluating how algorithms alter human interpretation. The annotation app collects classification, segmentation, and image captioning training data, and the evaluation app randomizes the availability of CAD tools to facilitate clinical trials on radiologist enhancement.Availability and implementationDemonstrations and source code are hosted at (https://candi.nextgenhealthcare.org), and (https://github.com/mbadge/candi), respectively, under GPL-3 license.Supplementary informationSupplementary material is available at Bioinformatics online.
| S-EPMC6499410 | biostudies-literature
Project description:We developed a computer-aided diagnosis (CAD) system based on linked color imaging (LCI) images to predict the histological results of polyps by analyzing the colors of the lesions. A total of 139 images of adenomatous polyps and 69 images of non-adenomatous polyps obtained from our hospital were collected and used to train the CAD system. A test set of LCI images, including both adenomatous and non-adenomatous polyps, was prospectively collected from patients who underwent colonoscopies between Oct and Dec 2017; this test set was used to assess the diagnostic abilities of the CAD system compared to those of human endoscopists (two experts and two novices). The accuracy, sensitivity, specificity, positive predictive value (PPV) and negative predictive value (NPV) of this novel CAD system for the training set were 87.0%, 87.1%, 87.0%, 93.1%, and 76.9%, respectively. The test set included 115 adenomatous polyps and 66 non-adenomatous polyps that were prospectively collected. The CAD system identified adenomatous or non-adenomatous polyps in the test set with an accuracy of 78.4%, a sensitivity of 83.3%, a specificity of 70.1%, a PPV of 82.6%, and an NPV of 71.2%. The accuracy of the CAD system was comparable to that of the expert endoscopists (78.4% vs 79.6%; p?=?0.517). In addition, the diagnostic accuracy of the novices was significantly lower to the performance of the experts (70.7% vs 79.6%; p?=?0.018). A novel CAD system based on LCI could be a rapid and powerful decision-making tool for endoscopists.
| S-EPMC6393495 | biostudies-literature
Project description:PurposeTo assess the effect of computer-aided detection (CAD) of brain metastasis (BM) on radiologists' diagnostic performance in interpreting three-dimensional brain magnetic resonance (MR) imaging using follow-up imaging and consensus as the reference standard.Materials and methodsThe institutional review board approved this retrospective study. The study cohort consisted of 110 consecutive patients with BM and 30 patients without BM. The training data set included MR images of 80 patients with 450 BM nodules. The test set included MR images of 30 patients with 134 BM nodules and 30 patients without BM. We developed a CAD system for BM detection using template-matching and K-means clustering algorithms for candidate detection and an artificial neural network for false-positive reduction. Four reviewers (two neuroradiologists and two radiology residents) interpreted the test set images before and after the use of CAD in a sequential manner. The sensitivity, false positive (FP) per case, and reading time were analyzed. A jackknife free-response receiver operating characteristic (JAFROC) method was used to determine the improvement in the diagnostic accuracy.ResultsThe sensitivity of CAD was 87.3% with an FP per case of 302.4. CAD significantly improved the diagnostic performance of the four reviewers with a figure-of-merit (FOM) of 0.874 (without CAD) vs. 0.898 (with CAD) according to JAFROC analysis (p < 0.01). Statistically significant improvement was noted only for less-experienced reviewers (FOM without vs. with CAD, 0.834 vs. 0.877, p < 0.01). The additional time required to review the CAD results was approximately 72 sec (40% of the total review time).ConclusionCAD as a second reader helps radiologists improve their diagnostic performance in the detection of BM on MR imaging, particularly for less-experienced reviewers.
| S-EPMC5464563 | biostudies-literature
Project description:According to the American Cancer Society's forecasts for 2019, there will be about 268,600 new cases in the United States with invasive breast cancer in women, about 62,930 new noninvasive cases, and about 41,760 death cases from breast cancer. As a result, there is a high demand for breast imaging specialists as indicated in a recent report for the Institute of Medicine and National Research Council. One way to meet this demand is through developing Computer-Aided Diagnosis (CAD) systems for breast cancer detection and diagnosis using mammograms. This study aims to review recent advancements and developments in CAD systems for breast cancer detection and diagnosis using mammograms and to give an overview of the methods used in its steps starting from preprocessing and enhancement step and ending in classification step. The current level of performance for the CAD systems is encouraging but not enough to make CAD systems standalone detection and diagnose clinical systems. Unless the performance of CAD systems enhanced dramatically from its current level by enhancing the existing methods, exploiting new promising methods in pattern recognition like data augmentation in deep learning and exploiting the advances in computational power of computers, CAD systems will continue to be a second opinion clinical procedure.
| S-EPMC7091549 | biostudies-literature
Project description:Published research results are difficult to replicate due to the lack of a standard evaluation data set in the area of decision support systems in mammography; most computer-aided diagnosis (CADx) and detection (CADe) algorithms for breast cancer in mammography are evaluated on private data sets or on unspecified subsets of public databases. This causes an inability to directly compare the performance of methods or to replicate prior results. We seek to resolve this substantial challenge by releasing an updated and standardized version of the Digital Database for Screening Mammography (DDSM) for evaluation of future CADx and CADe systems (sometimes referred to generally as CAD) research in mammography. Our data set, the CBIS-DDSM (Curated Breast Imaging Subset of DDSM), includes decompressed images, data selection and curation by trained mammographers, updated mass segmentation and bounding boxes, and pathologic diagnosis for training data, formatted similarly to modern computer vision data sets. The data set contains 753 calcification cases and 891 mass cases, providing a data-set size capable of analyzing decision support systems in mammography.
| S-EPMC5735920 | biostudies-literature
Project description:Biological systems have evolved efficient sensing and decision-making mechanisms to maximize fitness in changing molecular environments. Synthetic biologists have exploited these capabilities to engineer control on information and energy processing in living cells. While engineered organisms pose important technological and ethical challenges, de novo assembly of non-living biomolecular devices could offer promising avenues toward various real-world applications. However, assembling biochemical parts into functional information processing systems has remained challenging due to extensive multidimensional parameter spaces that must be sampled comprehensively in order to identify robust, specification compliant molecular implementations. We introduce a systematic methodology based on automated computational design and microfluidics enabling the programming of synthetic cell-like microreactors embedding biochemical logic circuits, or protosensors, to perform accurate biosensing and biocomputing operations in vitro according to temporal logic specifications. We show that proof-of-concept protosensors integrating diagnostic algorithms detect specific patterns of biomarkers in human clinical samples. Protosensors may enable novel approaches to medicine and represent a step toward autonomous micromachines capable of precise interfacing of human physiology or other complex biological environments, ecosystems, or industrial bioprocesses.
| S-EPMC5917673 | biostudies-literature
Project description:Deep learning has become a popular tool for computer-aided diagnosis using medical images, sometimes matching or exceeding the performance of clinicians. However, these models can also reflect and amplify human bias, potentially resulting inaccurate missed diagnoses. Despite this concern, the problem of improving model fairness in medical image classification by deep learning has yet to be fully studied. To address this issue, we propose an algorithm that leverages the marginal pairwise equal opportunity to reduce bias in medical image classification. Our evaluations across four tasks using four independent large-scale cohorts demonstrate that our proposed algorithm not only improves fairness in individual and intersectional subgroups but also maintains overall performance. Specifically, the relative change in pairwise fairness difference between our proposed model and the baseline model was reduced by over 35%, while the relative change in AUC value was typically within 1%. By reducing the bias generated by deep learning models, our proposed approach can potentially alleviate concerns about the fairness and reliability of image-based computer-aided diagnosis.
| S-EPMC10558498 | biostudies-literature
Project description:Training deep Convolutional Neural Networks (CNNs) presents challenges in terms of memory requirements and computational resources, often resulting in issues such as model overfitting and lack of generalization. These challenges can only be mitigated by using an excessive number of training images. However, medical image datasets commonly suffer from data scarcity due to the complexities involved in their acquisition, preparation, and curation. To address this issue, we propose a compact and hybrid machine learning architecture based on the Morphological and Convolutional Neural Network (MCNN), followed by a Random Forest classifier. Unlike deep CNN architectures, the MCNN was specifically designed to achieve effective performance with medical image datasets limited to a few hundred samples. It incorporates various morphological operations into a single layer and uses independent neural networks to extract information from each signal channel. The final classification is obtained by utilizing a Random Forest classifier on the outputs of the last neural network layer. We compare the classification performance of our proposed method with three popular deep CNN architectures (ResNet-18, ShuffleNet-V2, and MobileNet-V2) using two training approaches: full training and transfer learning. The evaluation was conducted on two distinct medical image datasets: the ISIC dataset for melanoma classification and the ORIGA dataset for glaucoma classification. Results demonstrate that the MCNN method exhibits reliable performance in melanoma classification, achieving an AUC of 0.94 (95% CI: 0.91 to 0.97), outperforming the popular CNN architectures. For the glaucoma dataset, the MCNN achieved an AUC of 0.65 (95% CI: 0.53 to 0.74), which was similar to the performance of the popular CNN architectures. This study contributes to the understanding of mathematical morphology in shallow neural networks for medical image classification and highlights the potential of hybrid architectures in effectively learning from medical image datasets that are limited by a small number of case samples.
| S-EPMC10546173 | biostudies-literature
Project description:BackgroundComputer-aided diagnosis (CAD) systems can help reduce radiologists' workload. This study assessed the value of a CAD system for the detection of lung nodules on chest computed tomography (CT) images.MethodsThe study retrospectively analyzed the CT images of patients who underwent routine health checkups between August 2019 and November 2019 at 3 hospitals in China. All images were first assessed by 2 radiologists manually in a blinded manner, which was followed by assessment with the CAD system. The location and classification of the lung nodules were determined. The final diagnosis was made by a panel of experts, including 2 associate chief radiologists and 1 chief radiologist at the radiology department. The sensitivity for nodule detection and false-positive nodules per case were calculated.ResultsA total of 1,002 CT images were included in the study, and the process was completed for 999 images. The sensitivity of the CAD system and manual detection was 90.19% and 49.88% (P<0.001), respectively. Similar sensitivity was observed between manual detection and the CAD system in lung nodules >15 mm (P=0.08). The false-positive nodules per case for the CAD system were 0.30±0.84 and those for manual detection were 0.24±0.68 (P=0.12). The sensitivity of the CAD system was higher than that of the radiologists, but the increase in the false-positive rate was only slight.ConclusionsIn addition to reducing the workload for medical professionals, a CAD system developed using a deep-learning model was highly effective and accurate in detecting lung nodules and did not demonstrate a meaningfully higher the false-positive rate.
| S-EPMC10585542 | biostudies-literature
Project description: Not available
| S-EPMC7125397 | biostudies-literature