Dataset Information

A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses.

ABSTRACT: We developed a machine learning model based on radiomics to predict the BI-RADS category of ultrasound-detected suspicious breast lesions and support medical decision-making towards short-interval follow-up versus tissue sampling. From a retrospective 2015-2019 series of ultrasound-guided core needle biopsies performed by four board-certified breast radiologists using six ultrasound systems from three vendors, we collected 821 images of 834 suspicious breast masses from 819 patients, 404 malignant and 430 benign according to histopathology. A balanced image set of biopsy-proven benign (n = 299) and malignant (n = 299) lesions was used for training and cross-validation of ensembles of machine learning algorithms supervised during learning by histopathological diagnosis as a reference standard. Based on a majority vote (over 80% of the votes to have a valid prediction of benign lesion), an ensemble of support vector machines showed an ability to reduce the biopsy rate of benign lesions by 15% to 18%, always keeping a sensitivity over 94%, when externally tested on 236 images from two image sets: (1) 123 lesions (51 malignant and 72 benign) obtained from two ultrasound systems used for training and from a different one, resulting in a positive predictive value (PPV) of 45.9% (95% confidence interval 36.3-55.7%) versus a radiologists' PPV of 41.5% (p < 0.005), combined with a 98.0% sensitivity (89.6-99.9%); (2) 113 lesions (54 malignant and 59 benign) obtained from two ultrasound systems from vendors different from those used for training, resulting into a 50.5% PPV (40.4-60.6%) versus a radiologists' PPV of 47.8% (p < 0.005), combined with a 94.4% sensitivity (84.6-98.8%). Errors in BI-RADS 3 category (i.e., assigned by the model as BI-RADS 4) were 0.8% and 2.7% in the Testing set I and II, respectively. The board-certified breast radiologist accepted the BI-RADS classes assigned by the model in 114 masses (92.7%) and modified the BI-RADS classes of 9 breast masses (7.3%). In six of nine cases, the model performed better than the radiologist did, since it assigned a BI-RADS 3 classification to histopathology-confirmed benign masses that were classified as BI-RADS 4 by the radiologist.

SUBMITTER: Interlenghi M

PROVIDER: S-EPMC8774734 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ObjectivesThis study aims to build radiomics model of Breast Imaging Reporting and Data System (BI-RADS) category 4 and 5 mammographic masses extracted from digital mammography (DM) for mammographic masses characterization by using a sensitivity threshold similar to that of biopsy.Materials and methodsThis retrospective study included 288 female patients (age, 52.41 ± 10.31) who had BI-RADS category 4 or 5 mammographic masses with an indication for biopsy. The patients were divided into two temporal set (training set, 82 malignancies and 110 benign lesions; independent test set, 48 malignancies and 48 benign lesions). A total of 188 radiomics features were extracted from mammographic masses on the combination of craniocaudal (CC) position images and mediolateral oblique (MLO) position images. For the training set, Pearson's correlation and the least absolute shrinkage and selection operator (LASSO) were used to select non-redundant radiomics features and useful radiomics features, respectively, and support vector machine (SVM) was applied to construct a radiomics model. The receiver operating characteristic curve (ROC) analysis was used to evaluate the classification performance of the radiomics model and to determine a threshold value with a sensitivity higher than 98% to predict the mammographic masses malignancy. For independent test set, identical threshold value was used to validate the classification performance of the radiomics model. The stability of the radiomics model was evaluated by using a fivefold cross-validation method, and two breast radiologists assessed the diagnostic agreement of the radiomics model.ResultsIn the training set, the radiomics model obtained an area under the receiver operating characteristic curve (AUC) of 0.934 [95% confidence intervals (95% CI), 0.898-0.971], a sensitivity of 98.8% (81/82), a threshold of 0.22, and a specificity of 60% (66/110). In the test set, the radiomics model obtained an AUC of 0.901 (95% CI, 0.835-0.961), a sensitivity of 95.8% (46/48), and a specificity of 66.7% (32/48). The radiomics model had relatively stable sensitivities in fivefold cross-validation (training set, 97.39% ± 3.9%; test set, 98.7% ± 4%).ConclusionThe radiomics method based on DM may help reduce the temporarily unnecessary invasive biopsies for benign mammographic masses over-classified in BI-RADS category 4 and 5 while providing similar diagnostic performance for malignant mammographic masses as biopsies.

Project description:Purpose To evaluate Breast Imaging Reporting and Data System (BI-RADS) category 3 assessment at diagnostic examination after recall from screening in a large urban population after implementation of digital breast tomosynthesis (DBT) by focusing both on overall use and use stratified by recalled finding type and outcome at 2 years. Materials and Methods This was an intuitional review board-approved and HIPAA-compliant retrospective review of 10 728 digital mammography (DM) examinations from September 1, 2010, to August 30, 2011, and 15 571 screening DBT examinations from October 1, 2011, to February 28, 2013. The recall populations for DM and DBT were 1112 of 10 728 (10.4% of women screened) and 1366 of 15 571 (8.8% of women screened), respectively. Recall examinations were classified according to finding type: calcifications, asymmetry or focal asymmetry, mass, and architectural distortion. Differences between groups were compared by using the ?2 test. Results Although there was no significant change in the utilization rate of BI-RADS category 3 in those patients screened with DM compared with DBT (168 of 10 728, 1.6% for DM vs 206 of 15 571, 1.3% for DBT; P = .102), there was a mean overall reduction of 2.4 women per 1000 (95% confidence interval [CI]: -0.5, 5.4) recommended for short-term follow-up. Lesion types given a BI-RADS category 3 assessment after diagnostic work-up did not change. The distribution of recalled finding types significantly changed with DBT, with increased recall examinations for architectural distortion and mass (P < .001) and decreased recall examinations for asymmetries (P ? .001). There was no change in recall examinations for calcifications (P = .977). Conclusion Screening with DBT did not significantly change the utilization rate of BI-RADS category 3 classification; however, the overall number of patients recommended for short-interval follow-up decreased by a mean of 2.4 women per 1000 (95% CI: -0.5, 5.4). © RSNA, 2017 Online supplemental material is available for this article.

Project description:Purpose To determine the utilization and positive predictive value (PPV) of the American College of Radiology (ACR) Breast Imaging Data and Reporting System (BI-RADS) category 4 subdivisions in diagnostic mammography in the National Mammography Database (NMD). Materials and Methods This study involved retrospective review of diagnostic mammography data submitted to the NMD from January 1, 2008 to December 30, 2014. Utilization rates of BI-RADS category 4 subdivisions were compared by year, facility (type, location, census region), and examination (indication, finding type) characteristics. PPV3 (positive predictive value for biopsies performed) was calculated overall and according to category 4 subdivision. The χ2 test was used to test for significant associations. Results Of 1 309 950 diagnostic mammograms, 125 447 (9.6%) were category 4, of which 33.3% (41 841 of 125 447) were subdivided. Subdivision utilization rates were higher (P < .001) in practices that were community, suburban, or in the West; for examination indication of prior history of breast cancer; and for the imaging finding of architectural distortion. Of 41 841 category 4 subdivided examinations, 4A constituted 55.6% (23 258 of 41 841) of the examinations; 4B, 31.8% (13 302 of 41 841) of the examinations; and 4C, 12.6% (5281 of 41 841) of the examinations. Pathologic outcomes were available in 91 563 examinations, and overall category 4 PPV3 was 21.1% (19 285 of 91 563). There was a statistically significant difference in PPV3 according to category 4 subdivision (P < .001): The PPV of 4A was 7.6% (1274 of 16 784), that of 4B was 22% (2317 of 10 408), and that of 4C was 69.3% (2839 of 4099). Conclusion Although BI-RADS suggests their use, subdivisions were utilized in the minority (33.3% [41 841 of 125 447]) of category 4 diagnostic mammograms, with variability based on facility and examination characteristics. When subdivisions were used, PPV3s were in BI-RADS-specified malignancy ranges. This analysis supports the use of subdivisions in broad practice and, given benefits for patient care, should motivate increased utilization. © RSNA, 2018 Online supplemental material is available for this article.

Project description:PURPOSE: To determine (a) how often the Breast Imaging Reporting and Data System (BI-RADS) category 3 was used in the American College of Radiology Imaging Network (ACRIN) Digital Mammographic Imaging Screening Trial (DMIST), either at the time of screening mammography or after work-up, (b) how often subjects actually returned for the recommended follow-up examination, and (c) the rate and stages of any malignancies subsequently found in subjects for whom short-term interval follow-up was recommended. MATERIALS AND METHODS: This study was approved by the Institutional Review Board at all institutions where subjects were enrolled. All subjects participating in DMIST gave informed consent and the study was HIPAA-compliant. A total of 47,599 DMIST-eligible and evaluable subjects, all of whom consented to undergo both digital and screen-film mammography, were included in this analysis. Cases referred for short-term interval follow-up based on digital, screen-film, or both imaging examinations were determined. Compliance with the recommendations and the final outcome (malignancy diagnosis at biopsy or no malignancy confirmed through follow-up) of each evaluable case were determined. RESULTS: A total of 1114 of the 47,599 (2.34%) subjects had tumors assigned a BI-RADS 3 category and were recommended to undergo short-interval follow-up. In this study, 791 of 1114 (71%) of the subjects were compliant with the recommendation and returned for short-interval follow-up. Of the women who did not return for short-interval follow-up, 70% (226 of 323) did return for their next annual mammography. Among all subjects whose tumors were assigned a BI-RADS 3 category either at screening mammography or after additional work-up, nine of 1114 (0.81%) were found to have cancer. Of the nine biopsy-proved cancers, six were invasive cancers and three were ductal carcinoma in situ stage Tis-T1c. The invasive cancers were all less than 2 cm in size. CONCLUSION: In DMIST, radiologists used the BI-RADS 3 classification infrequently (2.3% of patients). Tumors assigned a BI-RADS 3 category had a low rate of malignancy. The relatively high rate of noncompliance with short-interval follow-up recommendations (323 of 1114, or 29%) supports prior recommendations that radiologists thoroughly evaluate lesions before placing them in this category.

Project description:PurposeSclerosing adenosis (SA) is a benign lesion that could mimic breast carcinoma and be evaluated as malignancy by Breast Imaging-Reporting and Data System (BI-RADS) analysis. We aimed to construct and validate the performance of radiomic model based on dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) compared to BI-RADS analysis to identify SA.MethodsSixty-seven patients with invasive ductal carcinoma (IDC) and 58 patients with SA were included in this retrospective study from two institutions. The 125 patients were divided into a training cohort (n= 88) from institution I and a validation cohort from institution II (n=37). Dynamic contrast-enhanced sequences including one pre-contrast and five dynamic post-contrast series were obtained for all cases with different 3T scanners. Single-phase enhancement, multi-phase enhancement, and dynamic radiomic features were extracted from DCE-MRI. The least absolute shrinkage and selection operator (LASSO) logistic regression and cross-validation was performed to build the radscore of each single-phase enhancement and the final model combined multi-phase and dynamic radiomic features. The diagnostic performance of radiomics was evaluated by receiver operating characteristic (ROC) analysis and compared to the performance of BI-RADS analysis. The classification performance was tested using external validation.ResultsIn the training cohort, the AUCs of BI-RADS analysis were 0.71 (95%CI [0.60, 0.80]), 0.78 (95%CI [0.67, 0.86]), and 0.80 (95%CI [0.70, 0.88]), respectively. In single-phase analysis, the second enhanced phase radiomic signature achieved the highest AUC of 0.88 (95%CI [0.79, 0.94]) in distinguishing SA from IDC. Nine multi-phase radiomic features and two dynamic radiomic features showed the best predictive ability for final model building. The final model improved the AUC to 0.92 (95%CI [0.84, 0.97]), and showed statistically significant differences with BI-RADS analysis (p<0.05 for all). In the validation cohort, the AUC of the final model was 0.90 (95%CI [0.75, 0.97]), which was higher than all BI-RADS analyses and showed statistically significant differences with one of the BI-RADS analysis observers (p = 0.03).ConclusionsRadiomics based on DCE-MRI could show better diagnostic performance compared to BI-RADS analysis in differentiating SA from IDC, which may contribute to clinical diagnosis and treatment.

Project description:To evaluate the positive predictive values (PPVs) of Breast Imaging and Reporting Data Systems (BI-RADS) assessment categories for breast magnetic resonance (MR) imaging and to identify the BI-RADS MR imaging lesion features most predictive of cancer.This institutional review board-approved HIPAA-compliant prospective multicenter study was performed with written informed consent. Breast MR imaging studies of the contralateral breast in women with a recent diagnosis of breast cancer were prospectively evaluated. Contralateral breast MR imaging BI-RADS assessment categories, morphologic descriptors for foci, masses, non-masslike enhancement (NMLE), and kinetic features were assessed for predictive values for malignancy. PPV of each imaging characteristic of interest was estimated, and logistic regression analysis was used to examine the predictive ability of combinations of characteristics.Of 969 participants, 71.3% had a BI-RADS category 1 or 2 assessment; 10.9%, a BI-RADS category 3 assessment; 10.0%, a BI-RADS category 4 or 5 assessment; and 7.7%, a BI-RADS category 0 assessment on the basis of initial MR images. Thirty-one cancers were detected with MR imaging. Overall PPV for BI-RADS category 4 and 5 lesions was 0.278, with 17 cancers in patients with a BI-RADS category 4 lesion (PPV, 0.205) and 10 cancers in patients with a BI-RADS category 5 lesion (PPV, 0.714). Of the cancers, one was a focus, 17 were masses, and 13 were NMLEs. For masses, irregular shape, irregular margins, spiculated margins, and marked internal enhancement were most predictive of malignancy. For NMLEs, ductal, clumped, and reticular or dendritic enhancement were the features most frequently seen with malignancy. Kinetic enhancement features were less predictive of malignancy than were morphologic features.Standardized terminology of the BI-RADS lexicon enables quantification of the likelihood of malignancy for MR imaging-detected lesions through careful evaluation of lesion features. In particular, BI-RADS assessment categories and morphologic descriptors for masses and NMLE were useful in estimating the probability of cancer.

Dataset Information

A Machine Learning Ensemble Based on Radiomics to Predict BI-RADS Category and Reduce the Biopsy Rate of Ultrasound-Detected Suspicious Breast Masses.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets