Dataset Information

Effect of a Deep Learning Framework-Based Computer-Aided Diagnosis System on the Diagnostic Performance of Radiologists in Differentiating between Malignant and Benign Masses on Breast Ultrasonography.

ABSTRACT: OBJECTIVE:To investigate whether a computer-aided diagnosis (CAD) system based on a deep learning framework (deep learning-based CAD) improves the diagnostic performance of radiologists in differentiating between malignant and benign masses on breast ultrasound (US). MATERIALS AND METHODS:B-mode US images were prospectively obtained for 253 breast masses (173 benign, 80 malignant) in 226 consecutive patients. Breast mass US findings were retrospectively analyzed by deep learning-based CAD and four radiologists. In predicting malignancy, the CAD results were dichotomized (possibly benign vs. possibly malignant). The radiologists independently assessed Breast Imaging Reporting and Data System final assessments for two datasets (US images alone or with CAD). For each dataset, the radiologists' final assessments were classified as positive (category 4a or higher) and negative (category 3 or lower). The diagnostic performances of the radiologists for the two datasets (US alone vs. US with CAD) were compared. RESULTS:When the CAD results were added to the US images, the radiologists showed significant improvement in specificity (range of all radiologists for US alone vs. US with CAD: 72.8-92.5% vs. 82.1-93.1%; p < 0.001), accuracy (77.9-88.9% vs. 86.2-90.9%; p = 0.038), and positive predictive value (PPV) (60.2-83.3% vs. 70.4-85.2%; p = 0.001). However, there were no significant changes in sensitivity (81.3-88.8% vs. 86.3-95.0%; p = 0.120) and negative predictive value (91.4-93.5% vs. 92.9-97.3%; p = 0.259). CONCLUSION:Deep learning-based CAD could improve radiologists' diagnostic performance by increasing their specificity, accuracy, and PPV in differentiating between malignant and benign masses on breast US.

SUBMITTER: Choi JS

PROVIDER: S-EPMC6470083 | biostudies-other | 2019 May

REPOSITORIES: biostudies-other

ACCESS DATA

Publications

Effect of a Deep Learning Framework-Based Computer-Aided Diagnosis System on the Diagnostic Performance of Radiologists in Differentiating between Malignant and Benign Masses on Breast Ultrasonography.

Choi Ji Soo JS Han Boo Kyung BK Ko Eun Sook ES Bae Jung Min JM Ko Eun Young EY Song So Hee SH Kwon Mi Ri MR Shin Jung Hee JH Hahn Soo Yeon SY

Korean journal of radiology 20190501 5

<h4>Objective</h4>To investigate whether a computer-aided diagnosis (CAD) system based on a deep learning framework (deep learning-based CAD) improves the diagnostic performance of radiologists in differentiating between malignant and benign masses on breast ultrasound (US).<h4>Materials and methods</h4>B-mode US images were prospectively obtained for 253 breast masses (173 benign, 80 malignant) in 226 consecutive patients. Breast mass US findings were retrospectively analyzed by deep learning-b ...[more]

PMID: 30993926

Similar Datasets

Project description:To evaluate the interobserver variability in descriptions of breast masses by dedicated breast imagers and radiology residents and determine how any differences in lesion description affect the performance of a computer-aided diagnosis (CAD) computer classification system.Institutional review board approval was obtained for this HIPAA-compliant study, and the requirement to obtain informed consent was waived. Images of 50 breast lesions were individually interpreted by seven dedicated breast imagers and 10 radiology residents, yielding 850 lesion interpretations. Lesions were described with use of 11 descriptors from the Breast Imaging Reporting and Data System, and interobserver variability was calculated with the Cohen κ statistic. Those 11 features were selected, along with patient age, and merged together by a linear discriminant analysis (LDA) classification model trained by using 1005 previously existing cases. Variability in the recommendations of the computer model for different observers was also calculated with the Cohen κ statistic.A significant difference was observed for six lesion features, and radiology residents had greater interobserver variability in their selection of five of the six features than did dedicated breast imagers. The LDA model accurately classified lesions for both sets of observers (area under the receiver operating characteristic curve = 0.94 for residents and 0.96 for dedicated imagers). Sensitivity was maintained at 100% for residents and improved from 98% to 100% for dedicated breast imagers. For residents, the computer model could potentially improve the specificity from 20% to 40% (P < .01) and the κ value from 0.09 to 0.53 (P < .001). For dedicated breast imagers, the computer model could increase the specificity from 34% to 43% (P = .16) and the κ value from 0.21 to 0.61 (P < .001).Among findings showing a significant difference, there was greater interobserver variability in lesion descriptions among residents; however, an LDA model using data from either dedicated breast imagers or residents yielded a consistently high performance in the differentiation of benign from malignant breast lesions, demonstrating potential for improving specificity and decreasing interobserver variability in biopsy recommendations.

Project description:ImportanceUltrasonography-based risk models can help nonexpert clinicians evaluate adnexal lesions and reduce surgical interventions for benign tumors. Yet, these models have limited uptake in the US, and studies comparing their diagnostic accuracy are lacking.ObjectiveTo evaluate, in a US cohort, the diagnostic performance of 3 ultrasonography-based risk models for differentiating between benign and malignant adnexal lesions: International Ovarian Tumor Analysis (IOTA) Simple Rules with inconclusive cases reclassified as malignant or reevaluated by an expert, IOTA Assessment of Different Neoplasias in the Adnexa (ADNEX), and Ovarian-Adnexal Reporting and Data System (O-RADS).Design, setting, and participantsThis retrospective diagnostic study was conducted at a single US academic medical center and included consecutive patients aged 18 to 89 years with adnexal masses that were managed surgically or conservatively between January 2017 and October 2022.ExposureEvaluation of adnexal lesions using the Simple Rules, ADNEX, and O-RADS.Main outcomes and measuresThe main outcome was diagnostic performance, including area under the receiver operating characteristic (ROC) curve (AUC), sensitivity, specificity, positive and negative predictive values, and positive and negative likelihood ratios. Surgery or follow-up were reference standards. Secondary analyses evaluated the models' performances stratified by menopause status and race.ResultsThe cohort included 511 female patients with a 15.9% malignant tumor prevalence (81 patients). Mean (SD) ages of patients with benign and malignant adnexal lesions were 44.1 (14.4) and 52.5 (15.2) years, respectively, and 200 (39.1%) were postmenopausal. In the ROC analysis, the AUCs for discriminative performance of the ADNEX and O-RADS models were 0.96 (95% CI, 0.93-0.98) and 0.92 (95% CI, 0.90-0.95), respectively. After converting the ADNEX continuous individualized risk into the discrete ordinal categories of O-RADS, the ADNEX performance was reduced to an AUC of 0.93 (95% CI, 0.90-0.96), which was similar to that for O-RADS. The Simple Rules combined with expert reevaluation had 93.8% sensitivity (95% CI, 86.2%-98.0%) and 91.9% specificity (95% CI, 88.9%-94.3%), and the Simple Rules combined with malignant classification had 93.8% sensitivity (95% CI, 86.2%-98.0%) and 88.1% specificity (95% CI, 84.7%-91.0%). At a 10% risk threshold, ADNEX had 91.4% sensitivity (95% CI, 83.0%-96.5%) and 86.3% specificity (95% CI, 82.7%-89.4%) and O-RADS had 98.8% sensitivity (95% CI, 93.3%-100%) and 74.4% specificity (95% CI, 70.0%-78.5%). The specificities of all models were significantly lower in the postmenopausal group. Subgroup analysis revealed high performances independent of race.Conclusions and relevanceIn this diagnostic study of a US cohort, the Simple Rules, ADNEX, and O-RADS models performed well in differentiating between benign and malignant adnexal lesions; this outcome has been previously reported primarily in European populations. Risk stratification models can lead to more accurate and consistent evaluations of adnexal masses, especially when used by nonexpert clinicians, and may reduce unnecessary surgeries.

Dataset Information

Effect of a Deep Learning Framework-Based Computer-Aided Diagnosis System on the Diagnostic Performance of Radiologists in Differentiating between Malignant and Benign Masses on Breast Ultrasonography.

Publications

Effect of a Deep Learning Framework-Based Computer-Aided Diagnosis System on the Diagnostic Performance of Radiologists in Differentiating between Malignant and Benign Masses on Breast Ultrasonography.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets