Assessing radiologist performance using combined digital mammography and breast tomosynthesis compared with digital mammography alone: results of a multicenter, multireader trial.
Ontology highlight
ABSTRACT: Purpose
To compare radiologists' diagnostic accuracy and recall rates for breast tomosynthesis combined with digital mammography versus digital mammography alone.Materials and methods
Institutional review board approval was obtained at each accruing institution. Participating women gave written informed consent. Mediolateral oblique and craniocaudal digital mammographic and tomosynthesis images of both breasts were obtained from 1192 subjects. Two enriched reader studies were performed to compare digital mammography with tomosynthesis against digital mammography alone. Study 1 comprised 312 cases (48 cancer cases) with images read by 12 radiologists; study 2, 312 cases (51 cancer cases) with 15 radiologists. Study 1 readers recorded only that an abnormality requiring recall was present; study 2 readers had additional training and recorded both lesion type and location. Diagnostic accuracy was compared with receiver operating characteristic analysis. Recall rates of noncancer cases, sensitivity, specificity, and positive and negative predictive values determined by analyzing Breast Imaging Reporting and Data System scores were compared for the two methods.Results
Diagnostic accuracy for combined tomosynthesis and digital mammography was superior to that of digital mammography alone. Average difference in area under the curve in study 1 was 7.2% (95% confidence interval [CI]: 3.7%, 10.8%; P < .001) and in study 2 was 6.8% (95% CI: 4.1%, 9.5%; P < .001). All 27 radiologists increased diagnostic accuracy with addition of tomosynthesis. Recall rates for noncancer cases for all readers significantly decreased with addition of tomosynthesis (range, 6%-67%; P < .001 for 25 readers, P < .03 for all readers). Increased sensitivity was largest for invasive cancers: 15% and 22% in studies 1 and 2 versus 3% for in situ cancers in both studies.Conclusion
Addition of tomosynthesis to digital mammography offers the dual benefit of significantly increased diagnostic accuracy and significantly reduced recall rates for noncancer cases.Supplemental material
http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12120674/-/DC1.
SUBMITTER: Rafferty EA
PROVIDER: S-EPMC5410947 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:ImportanceMany US radiologists have screening mammography recall rates above the expert-recommended threshold of 12%. The influence of digital breast tomosynthesis (DBT) on the distribution of radiologist recall rates is uncertain.ObjectiveTo evaluate radiologists' recall and cancer detection rates before and after beginning interpretation of DBT examinations.Design, setting, and participantsThis cohort study included 198 radiologists from 104 radiology facilities in the Breast Cancer Surveillance Consortium who interpreted 251?384 DBT and 2?000?681 digital mammography (DM) screening examinations from 2009 to 2017, including 126 radiologists (63.6%) who interpreted DBT examinations during the study period and 72 (36.4%) who exclusively interpreted DM examinations (to adjust for secular trends). Data were analyzed from April 2018 to July 2019.ExposuresDigital breast tomosynthesis and DM screening examinations.Main outcomes and measuresRecall rate and cancer detection rate.ResultsA total of 198 radiologists interpreted 2?252?065 DM and DBT examinations (2?000?681 [88.8%] DM examinations; 251?384 [11.2%] DBT examinations; 710?934 patients [31.6%] aged 50-59 years; 1?448?981 [64.3%] non-Hispanic white). Among the 126 radiologists (63.6%) who interpreted DBT examinations, 83 (65.9%) had unadjusted DM recall rates of no more than 12% before using DBT, with a median (interquartile range) recall rate of 10.0% (7.5%-13.0%). On DBT examinations, 96 (76.2%) had an unadjusted recall rate of no more than 12%, with a median (interquartile range) recall rate of 8.8% (6.3%-11.3%). A secular trend in recall rate was observed, with the multivariable-adjusted risk of recall on screening examinations declining by 1.2% (95% CI, 0.9%-1.5%) per year. After adjusting for examination characteristics and secular trends, recall rates were 15% lower on DBT examinations compared with DM examinations interpreted before DBT use (relative risk, 0.85; 95% CI, 0.83-0.87). Adjusted recall rates were significantly lower on DBT examinations compared with DM examinations interpreted before DBT use for 45 radiologists (35.7%) and significantly higher for 18 (14.3%); 63 (50.0%) had no statistically significant change. The unadjusted cancer detection rate on DBT was 5.3 per 1000 examinations (95% CI, 5.0-5.7 per 1000 examinations) compared with 4.7 per 1000 examinations (95% CI, 4.6-4.8 per 1000 examinations) on DM examinations interpreted before DM use (multivariable-adjusted risk ratio, 1.21; 95% CI, 1.11-1.33).Conclusions and relevanceIn this study, DBT was associated with an overall decrease in recall rate and an increase in cancer detection rate. However, our results indicated that there is wide variability among radiologists, including a subset of radiologists who experienced increased recall rates on DBT examinations. Radiology practices should audit radiologist DBT screening performance and consider additional DBT training for radiologists whose performance does not improve as expected.
| S-EPMC7292996 | biostudies-literature
Project description:BackgroundDigital breast tomosynthesis (DBT) combined with digital mammography (DM) is increasingly used in the United States instead of DM alone for breast cancer screening. Early screening outcomes incorporating synthetic mammography (SM) with DBT have suggested that SM is an acceptable non-radiation dose alternative to DM.PurposeTo compare multicenter outcomes from breast cancer screening with SM/DBT versus DM/DBT.Materials and MethodsThis was a retrospective study of consecutive screening mammograms obtained at two institutions. Eligible studies consisted of 34 106 DM/DBT examinations between October 3, 2011, and October 31, 2014, and 34 180 SM/DBT examinations between January 7, 2015, and February 2, 2018, at the University of Pennsylvania and 51 148 DM/DBT examinations between January 1, 2012, and May 31, 2016, and 31 929 SM/DBT examinations between June 1, 2016, and March 30, 2018, at the University of Vermont. Demographics of women who attended screening and results from screening were recorded. Recall rate, biopsy rate, false-negative rate, cancer detection rate, positive predictive value, sensitivity, and specificity were calculated according to modality and institution. Descriptive statistics, χ2 tests, and logistic regression were used in analysis.ResultsThe study included 151 363 screening examinations among 151 363 women (mean age, 58.1 years ± 10.9 [standard deviation]). The unadjusted recall rate was lower with SM/DBT than with DM/DBT (7.0% [4630 of 66 109 examinations] for SM/DBT vs 7.9% [6742 of 85 254 examinations] for DM/DBT; P < .01). However, after multivariable adjustment, SM/DBT was associated with a slightly higher recall rate compared with DM/DBT (adjusted odds ratio [OR], 1.06; adjusted 95% CI: 1.01, 1.11; P = .02). Similarly, after multivariable adjustment, SM/DBT was associated with slightly lower specificity compared with DM/DBT (adjusted OR, 0.95; adjusted 95% CI: 0.90, 0.99; P = .02). There was no statistically significant difference in biopsy rate (P = .54), false-negative rate (P = .38), cancer detection rate (P = .55), invasive or in situ cancer detection rate (P = .52 and P = .98, respectively), positive predictive value (P = .78), or sensitivity (P = .33) for SM/DBT versus DM/DBT overall or within either institution (P > .05 for all).ConclusionBreast cancer screening performance is maintained within benchmarks when synthetic mammography replaces digital mammography in digital breast tomosynthesis imaging.© RSNA, 2020Online supplemental material is available for this article.See also the editorial by Lång in this issue.
| S-EPMC7706877 | biostudies-literature
Project description:BackgroundDigital breast tomosynthesis (DBT) has become a prevalent mode of breast cancer screening in recent years. Although older women are commonly screened for breast cancer, little is known about screening outcomes using DBT among older women.ObjectiveTo assess proximal screening outcomes with DBT compared to traditional two-dimensional(2-D) mammography among women 67-74 and women 75 and older.DesignCohort study.ParticipantsMedicare fee-for-service beneficiaries aged 67 years and older with no history of prior cancer who received a screening mammogram in 2015.Main measuresUse of subsequent imaging (ultrasound and diagnostic mammography) as an indication of recall, breast cancer detection, and characteristics of breast cancer at the time of diagnosis. Analyses used weighted logistic regression to adjust for potential confounders.Key resultsOur study included 26,406 women aged 67-74 and 17,001 women 75 and older who were screened for breast cancer. Among women 75 and older, the rate of subsequent imaging among women screened with DBT did not differ significantly from 2-D mammography (91.8 versus 97.0 per 1,000 screening mammograms, p=0.37). In this age group, DBT was associated with 2.1 additional cancers detected per 1,000 screening mammograms compared to 2D (11.5 versus 9.4, p=0.003), though these additional cancers were almost exclusively in situ and stage I invasive cancers. For women 67-74 years old, DBT was associated with a higher rate of subsequent imaging than 2-D mammography (113.9 versus 100.3, p=0.004) and a higher rate of stage I invasive cancer detection (4.7 versus 3.7, p=0.002), but not other stages.ConclusionsBreast cancer screening with DBT was not associated with lower rates of subsequent imaging among older women. Most additional cancers detected with DBT were early stage. Whether detecting these additional early-stage cancers among older women improves health outcomes remains uncertain.
| S-EPMC8483166 | biostudies-literature
Project description:BackgroundOur objective was to perform a systematic review and meta-analysis comparing the breast cancer detection rate (CDR), invasive CDR, recall rate, and positive predictive value 1 (PPV1) of digital mammography (DM) alone, combined digital breast tomosynthesis (DBT) and DM, combined DBT and synthetic 2-dimensional mammography (S2D), and DBT alone.MethodsMEDLINE and Embase were searched until April 2020 to identify comparative design studies reporting on patients undergoing routine breast cancer screening. Random effects model proportional meta-analyses estimated CDR, invasive CDR, recall rate, and PPV1. Meta-regression modeling was used to compare imaging modalities. All statistical tests were 2-sided.ResultsForty-two studies reporting on 2 606 296 patients (13 003 breast cancer cases) were included. CDR was highest in combined DBT and DM (6.36 per 1000 screened, 95% confidence interval [CI] = 5.62 to 7.14, P < .001), and combined DBT and S2D (7.40 per 1000 screened, 95% CI = 6.49 to 8.37, P < .001) compared with DM alone (4.68 per 1000 screened, 95% CI = 4.28 to 5.11). Invasive CDR was highest in combined DBT and DM (4.53 per 1000 screened, 95% CI = 3.97 to 5.12, P = .003) and combined DBT and S2D (5.68 per 1000 screened, 95% CI = 4.43 to 7.09, P < .001) compared with DM alone (3.42 per 1000 screened, 95% CI = 3.02 to 3.83). Recall rate was lowest in combined DBT and S2D (42.3 per 1000 screened, 95% CI = 37.4 to 60.4, P<.001). PPV1 was highest in combined DBT and DM (10.0%, 95% CI = 8.0% to 12.0%, P = .004), and combined DBT and S2D (16.0%, 95% CI = 10.0% to 23.0%, P < .001), whereas no difference was detected for DBT alone (7.0%, 95% CI = 6.0% to 8.0%, P = .75) compared with DM alone (7.0%, 95.0% CI = 5.0% to 8.0%).ConclusionsOur findings provide evidence on key performance metrics for DM, DBT alone, combined DBT and DM, and combined DBT and S2D, which may inform optimal application of these modalities for breast cancer screening.
| S-EPMC8168096 | biostudies-literature
Project description:Background Breast Imaging Reporting and Data System (BI-RADS) breast density categories assigned by interpreting radiologists often influence decisions surrounding supplemental breast cancer screening and risk assessment. The landscape of mammographic screening continuously evolves, and different mammographic screening modalities may result in different perception of density, reflected in different assignment of BI-RADS density categories. Purpose To investigate the effect of screening mammography modality on BI-RADS breast density assessments. Materials and Methods Data were retrospectively analyzed from 24 736 individual women (42.3% [10 455 of 24 736] white women, 57.7% [14 281 of 24 736] black women; mean age, 56.3 years; age range, 40.0-74.9 years) who underwent from one to seven mammographic screening examinations from September 2010 through February 2017 (60 766 examinations). Three screening modalities were used: digital mammography alone (8935 examinations); digital mammography with digital breast tomosynthesis (DBT; 30 779 examinations); and synthetic mammography with DBT (21 052 examinations). Random-effects logistic regression analysis was performed to estimate the likelihood of assignment to high versus low BI-RADS density category according to each modality, adjusted for ethnicity, age, body mass index (BMI), and radiologist. The interactions of modality with ethnicity and BMI on density categorization were also tested with the model. Results Women screened with DBT versus digital mammography alone had lower likelihood regarding categorization of high density breasts (digital mammography and DBT vs digital mammography: odds ratio, 0.69 [95% confidence interval: 0.61, 0.80], P < .001; synthetic mammography and DBT vs digital mammography: odds ratio, 0.43 [95% confidence interval: 0.37, 0.50], P < .001). Lower likelihood of high density was also observed at synthetic mammography and DBT compared with digital mammography and DBT (odds ratio, 0.62; 95% confidence interval: 0.56, 0.69; P < .001). There were interactions of modality with ethnicity (P = .007) and BMI (P = .003) on breast density assessment, with greater differences in density categorization according to modality observed for black women than for white women and groups with higher BMI. Conclusion Breast density categorization may vary by screening mammographic modality, and this effect appears to vary by ethnicity and body mass index. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Philpotts in this issue.
| S-EPMC6493215 | biostudies-literature
Project description:PurposeTo investigate how an artificial intelligence (AI) system performs at digital mammography (DM) from a screening population with ground truth defined by digital breast tomosynthesis (DBT), and whether AI could detect breast cancers at DM that had originally only been detected at DBT.Materials and methodsIn this secondary analysis of data from a prospective study, DM examinations from 14 768 women (mean age, 57 years), examined with both DM and DBT with independent double reading in the Malmӧ Breast Tomosynthesis Screening Trial (MBTST) (ClinicalTrials.gov: NCT01091545; data collection, 2010-2015), were analyzed with an AI system. Of 136 screening-detected cancers, 95 cancers were detected at DM and 41 cancers were detected only at DBT. The system identifies suspicious areas in the image, scored 1-100, and provides a risk score of 1 to 10 for the whole examination. A cancer was defined as AI detected if the cancer lesion was correctly localized and scored at least 62 (threshold determined by the AI system developers), therefore resulting in the highest examination risk score of 10. Data were analyzed with descriptive statistics, and detection performance was analyzed with receiver operating characteristics.ResultsThe highest examination risk score was assigned to 10% (1493 of 14 786) of the examinations. With 90.8% specificity, the AI system detected 75% (71 of 95) of the DM-detected cancers and 44% (18 of 41) of cancers at DM that had originally been detected only at DBT. The majority were invasive cancers (17 of 18).ConclusionAlmost half of the additional DBT-only screening-detected cancers in the MBTST were detected at DM with AI. AI did not reach double reading performance; however, if combined with double reading, AI has the potential to achieve a substantial portion of the benefit of DBT screening.Keywords: Computer-aided Diagnosis, Mammography, Breast, Diagnosis, Classification, Application DomainClinical trial registration no. NCT01091545© RSNA, 2021.
| S-EPMC8637235 | biostudies-literature
Project description:Although computer-aided diagnosis (CAD) is widely used in mammography, conventional CAD programs that use prompts to indicate potential cancers on the mammograms have not led to an improvement in diagnostic accuracy. Because of the advances in machine learning, especially with use of deep (multilayered) convolutional neural networks, artificial intelligence has undergone a transformation that has improved the quality of the predictions of the models. Recently, such deep learning algorithms have been applied to mammography and digital breast tomosynthesis (DBT). In this review, the authors explain how deep learning works in the context of mammography and DBT and define the important technical challenges. Subsequently, they discuss the current status and future perspectives of artificial intelligence-based clinical applications for mammography, DBT, and radiomics. Available algorithms are advanced and approach the performance of radiologists-especially for cancer detection and risk prediction at mammography. However, clinical validation is largely lacking, and it is not clear how the power of deep learning should be used to optimize practice. Further development of deep learning models is necessary for DBT, and this requires collection of larger databases. It is expected that deep learning will eventually have an important role in DBT, including the generation of synthetic images.
| S-EPMC6822772 | biostudies-literature
Project description:Importance:Expensive and lengthy clinical trials can delay regulatory evaluation of innovative technologies, affecting patient access to high-quality medical products. Simulation is increasingly being used in product development but rarely in regulatory applications. Objectives:To conduct a computer-simulated imaging trial evaluating digital breast tomosynthesis (DBT) as a replacement for digital mammography (DM) and to compare the results with a comparative clinical trial. Design, Setting, and Participants:The simulated Virtual Imaging Clinical Trial for Regulatory Evaluation (VICTRE) trial was designed to replicate a clinical trial that used human patients and radiologists. Images obtained with in silico versions of DM and DBT systems via fast Monte Carlo x-ray transport were interpreted by a computational reader detecting the presence of lesions. A total of 2986 synthetic image-based virtual patients with breast sizes and radiographic densities representative of a screening population and compressed thicknesses from 3.5 to 6 cm were generated using an analytic approach in which anatomical structures are randomly created within a predefined breast volume and compressed in the craniocaudal orientation. A positive cohort contained a digitally inserted microcalcification cluster or spiculated mass. Main Outcomes and Measures:The trial end point was the difference in area under the receiver operating characteristic curve between modalities for lesion detection. The trial was sized for an SE of 0.01 in the change in area under the curve (AUC), half the uncertainty in the comparative clinical trial. Results:In this trial, computational readers analyzed 31?055 DM and 27?960 DBT cases from 2986 virtual patients with the following Breast Imaging Reporting and Data System densities: 286 (9.6%) extremely dense, 1200 (40.2%) heterogeneously dense, 1200 (40.2%) scattered fibroglandular densities, and 300 (10.0%) almost entirely fat. The mean (SE) change in AUC was 0.0587 (0.0062) (P?<?.001) in favor of DBT. The change in AUC was larger for masses (mean [SE], 0.0903 [0.008]) than for calcifications (mean [SE], 0.0268 [0.004]), which was consistent with the findings of the comparative trial (mean [SE], 0.065 [0.017] for masses and -0.047 [0.032] for calcifications). Conclusions and Relevance:The results of the simulated VICTRE trial are consistent with the performance seen in the comparative trial. While further research is needed to assess the generalizability of these findings, in silico imaging trials represent a viable source of regulatory evidence for imaging devices.
| S-EPMC6324392 | biostudies-literature
Project description:PurposeTo correlate the parenchymal texture features at digital breast tomosynthesis (DBT) and digital mammography with breast percent density (PD), an established breast cancer risk factor, in a screening population of women.Materials and methodsThis HIPAA-compliant study was approved by the institutional review board. Bilateral DBT images and digital mammograms from 71 women (mean age, 54 years; age range, 34-75 years) with negative or benign findings at screening mammography were retrospectively collected from a separate institutional review board-approved DBT screening trial (performed from July 2007 to March 2008) in which all women had given written informed consent. Parenchymal texture features of skewness, coarseness, contrast, energy, homogeneity, and fractal dimension were computed from the retroareolar region. Principal component analysis (PCA) was applied to obtain orthogonal texture components. Mammographic PD was estimated with software. Correlation analysis and multiple linear regression with generalized estimating equations were performed to determine the association between texture features and breast PD. Regression was adjusted for age to determine the independent association of texture to breast PD when age was also considered as a predictor variable.ResultsTexture feature correlations to breast PD were stronger with DBT than with digital mammography. Statistically significant correlations (P < .001) were observed for contrast (r = 0.48), energy (r = -0.47), and homogeneity (r = -0.56) at DBT and for contrast (r = 0.26), energy (r = -0.26), and homogeneity (r = -0.33) at digital mammography. Multiple linear regression analysis of PCA texture components as predictors of PD also demonstrated significantly stronger associations with DBT. The association was strongest when age was also considered as a predictor of PD (R² = 0.41 for DBT and 0.28 for digital mammography; P < .001).ConclusionParenchymal texture features are more strongly correlated to breast PD in DBT than in digital mammography. The authors' long-term hypothesis is that parenchymal texture analysis with DBT will result in quantitative imaging biomarkers that can improve the estimation of breast cancer risk.
| S-EPMC3176420 | biostudies-literature
Project description:ImportanceBreast cancer screening examinations using digital breast tomosynthesis (DBT) has been shown to be associated with decreased false-positive test results and increased breast cancer detection compared with digital mammography (DM). Little is known regarding the size and stage of breast cancer types detected and their association with age and breast density.ObjectiveTo determine whether screening examinations using DBT detect breast cancers that are associated with an improved prognosis and to compare the detection rates by patient age and breast density.Design, setting, and participantsThis retrospective analysis of prospective cohort data from 3 research centers in the Population-based Research Optimizing Screening Through Personalized Regimens (PROSPR) consortium included data of women aged 40 to 74 years who underwent screening examinations using DM and DBT from January 1, 2011, through September 30, 2014. Statistical analysis was performed from November 8, 2017, to August 14, 2018.ExposuresUse of DBT as a supplement to DM at breast cancer screening examination.Main outcomes and measuresRecall rate, cancer detection rate, positive predictive value, biopsy rate, and distribution of invasive cancer subtypes.ResultsAmong 96 269 women (mean [SD] patient age for all examinations, 55.9 [9.0] years), patient age was 56.4 (9.0) years for DM and 54.6 (8.9) years for DBT. Of 180 340 breast cancer screening examinations, 129 369 examinations (71.7%) used DM and 50 971 examinations (28.3%) used DBT. Screening examination with DBT (73 of 99 women [73.7%]) was associated with the detection of smaller, more often node-negative, HER2-negative, invasive cancers compared with DM (276 of 422 women [65.4%]). Screening examination with DBT was also associated with lower recall (odds ratio, 0.64; 95% CI, 0.57-0.72; P < .001) and higher cancer detection (odds ratio, 1.41; 95% CI, 1.05-1.89; P = .02) compared with DM for all age groups even when stratified by breast density. The largest increase in cancer detection rate and the greatest shift toward smaller, node-negative invasive cancers detected with DBT was for women aged 40 to 49 years. For women aged 40 to 49 years with nondense breasts, the cancer detection rate for examinations using DBT was 1.70 per 1000 women higher compared with the rate using DM; for women with dense breasts, the cancer detection rate was 2.27 per 1000 women higher for DBT. For these younger women, screening with DBT was associated with only 7 of 28 breast cancers (25.0%) categorized as poor prognosis compared with 19 of 47 breast cancers (40.4%) when screening with DM.Conclusions and relevanceThe findings suggest that screening with DBT is associated with increased specificity and an increased proportion of breast cancers detected with better prognosis compared with DM. In the subgroup of women aged 40 to 49 years, routine DBT screening may have a favorable risk-benefit ratio.
| S-EPMC6512257 | biostudies-literature