Dataset Information

Assessing radiologist performance using combined digital mammography and breast tomosynthesis compared with digital mammography alone: results of a multicenter, multireader trial.

ABSTRACT:

Purpose

To compare radiologists' diagnostic accuracy and recall rates for breast tomosynthesis combined with digital mammography versus digital mammography alone.

Materials and methods

Institutional review board approval was obtained at each accruing institution. Participating women gave written informed consent. Mediolateral oblique and craniocaudal digital mammographic and tomosynthesis images of both breasts were obtained from 1192 subjects. Two enriched reader studies were performed to compare digital mammography with tomosynthesis against digital mammography alone. Study 1 comprised 312 cases (48 cancer cases) with images read by 12 radiologists; study 2, 312 cases (51 cancer cases) with 15 radiologists. Study 1 readers recorded only that an abnormality requiring recall was present; study 2 readers had additional training and recorded both lesion type and location. Diagnostic accuracy was compared with receiver operating characteristic analysis. Recall rates of noncancer cases, sensitivity, specificity, and positive and negative predictive values determined by analyzing Breast Imaging Reporting and Data System scores were compared for the two methods.

Results

Diagnostic accuracy for combined tomosynthesis and digital mammography was superior to that of digital mammography alone. Average difference in area under the curve in study 1 was 7.2% (95% confidence interval [CI]: 3.7%, 10.8%; P < .001) and in study 2 was 6.8% (95% CI: 4.1%, 9.5%; P < .001). All 27 radiologists increased diagnostic accuracy with addition of tomosynthesis. Recall rates for noncancer cases for all readers significantly decreased with addition of tomosynthesis (range, 6%-67%; P < .001 for 25 readers, P < .03 for all readers). Increased sensitivity was largest for invasive cancers: 15% and 22% in studies 1 and 2 versus 3% for in situ cancers in both studies.

Conclusion

Addition of tomosynthesis to digital mammography offers the dual benefit of significantly increased diagnostic accuracy and significantly reduced recall rates for noncancer cases.

Supplemental material

http://radiology.rsna.org/lookup/suppl/doi:10.1148/radiol.12120674/-/DC1.

SUBMITTER: Rafferty EA

PROVIDER: S-EPMC5410947 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:ImportanceMany US radiologists have screening mammography recall rates above the expert-recommended threshold of 12%. The influence of digital breast tomosynthesis (DBT) on the distribution of radiologist recall rates is uncertain.ObjectiveTo evaluate radiologists' recall and cancer detection rates before and after beginning interpretation of DBT examinations.Design, setting, and participantsThis cohort study included 198 radiologists from 104 radiology facilities in the Breast Cancer Surveillance Consortium who interpreted 251?384 DBT and 2?000?681 digital mammography (DM) screening examinations from 2009 to 2017, including 126 radiologists (63.6%) who interpreted DBT examinations during the study period and 72 (36.4%) who exclusively interpreted DM examinations (to adjust for secular trends). Data were analyzed from April 2018 to July 2019.ExposuresDigital breast tomosynthesis and DM screening examinations.Main outcomes and measuresRecall rate and cancer detection rate.ResultsA total of 198 radiologists interpreted 2?252?065 DM and DBT examinations (2?000?681 [88.8%] DM examinations; 251?384 [11.2%] DBT examinations; 710?934 patients [31.6%] aged 50-59 years; 1?448?981 [64.3%] non-Hispanic white). Among the 126 radiologists (63.6%) who interpreted DBT examinations, 83 (65.9%) had unadjusted DM recall rates of no more than 12% before using DBT, with a median (interquartile range) recall rate of 10.0% (7.5%-13.0%). On DBT examinations, 96 (76.2%) had an unadjusted recall rate of no more than 12%, with a median (interquartile range) recall rate of 8.8% (6.3%-11.3%). A secular trend in recall rate was observed, with the multivariable-adjusted risk of recall on screening examinations declining by 1.2% (95% CI, 0.9%-1.5%) per year. After adjusting for examination characteristics and secular trends, recall rates were 15% lower on DBT examinations compared with DM examinations interpreted before DBT use (relative risk, 0.85; 95% CI, 0.83-0.87). Adjusted recall rates were significantly lower on DBT examinations compared with DM examinations interpreted before DBT use for 45 radiologists (35.7%) and significantly higher for 18 (14.3%); 63 (50.0%) had no statistically significant change. The unadjusted cancer detection rate on DBT was 5.3 per 1000 examinations (95% CI, 5.0-5.7 per 1000 examinations) compared with 4.7 per 1000 examinations (95% CI, 4.6-4.8 per 1000 examinations) on DM examinations interpreted before DM use (multivariable-adjusted risk ratio, 1.21; 95% CI, 1.11-1.33).Conclusions and relevanceIn this study, DBT was associated with an overall decrease in recall rate and an increase in cancer detection rate. However, our results indicated that there is wide variability among radiologists, including a subset of radiologists who experienced increased recall rates on DBT examinations. Radiology practices should audit radiologist DBT screening performance and consider additional DBT training for radiologists whose performance does not improve as expected.

Project description:BackgroundDigital breast tomosynthesis (DBT) combined with digital mammography (DM) is increasingly used in the United States instead of DM alone for breast cancer screening. Early screening outcomes incorporating synthetic mammography (SM) with DBT have suggested that SM is an acceptable non-radiation dose alternative to DM.PurposeTo compare multicenter outcomes from breast cancer screening with SM/DBT versus DM/DBT.Materials and MethodsThis was a retrospective study of consecutive screening mammograms obtained at two institutions. Eligible studies consisted of 34 106 DM/DBT examinations between October 3, 2011, and October 31, 2014, and 34 180 SM/DBT examinations between January 7, 2015, and February 2, 2018, at the University of Pennsylvania and 51 148 DM/DBT examinations between January 1, 2012, and May 31, 2016, and 31 929 SM/DBT examinations between June 1, 2016, and March 30, 2018, at the University of Vermont. Demographics of women who attended screening and results from screening were recorded. Recall rate, biopsy rate, false-negative rate, cancer detection rate, positive predictive value, sensitivity, and specificity were calculated according to modality and institution. Descriptive statistics, χ2 tests, and logistic regression were used in analysis.ResultsThe study included 151 363 screening examinations among 151 363 women (mean age, 58.1 years ± 10.9 [standard deviation]). The unadjusted recall rate was lower with SM/DBT than with DM/DBT (7.0% [4630 of 66 109 examinations] for SM/DBT vs 7.9% [6742 of 85 254 examinations] for DM/DBT; P < .01). However, after multivariable adjustment, SM/DBT was associated with a slightly higher recall rate compared with DM/DBT (adjusted odds ratio [OR], 1.06; adjusted 95% CI: 1.01, 1.11; P = .02). Similarly, after multivariable adjustment, SM/DBT was associated with slightly lower specificity compared with DM/DBT (adjusted OR, 0.95; adjusted 95% CI: 0.90, 0.99; P = .02). There was no statistically significant difference in biopsy rate (P = .54), false-negative rate (P = .38), cancer detection rate (P = .55), invasive or in situ cancer detection rate (P = .52 and P = .98, respectively), positive predictive value (P = .78), or sensitivity (P = .33) for SM/DBT versus DM/DBT overall or within either institution (P > .05 for all).ConclusionBreast cancer screening performance is maintained within benchmarks when synthetic mammography replaces digital mammography in digital breast tomosynthesis imaging.© RSNA, 2020Online supplemental material is available for this article.See also the editorial by Lång in this issue.

Project description:BackgroundOur objective was to perform a systematic review and meta-analysis comparing the breast cancer detection rate (CDR), invasive CDR, recall rate, and positive predictive value 1 (PPV1) of digital mammography (DM) alone, combined digital breast tomosynthesis (DBT) and DM, combined DBT and synthetic 2-dimensional mammography (S2D), and DBT alone.MethodsMEDLINE and Embase were searched until April 2020 to identify comparative design studies reporting on patients undergoing routine breast cancer screening. Random effects model proportional meta-analyses estimated CDR, invasive CDR, recall rate, and PPV1. Meta-regression modeling was used to compare imaging modalities. All statistical tests were 2-sided.ResultsForty-two studies reporting on 2 606 296 patients (13 003 breast cancer cases) were included. CDR was highest in combined DBT and DM (6.36 per 1000 screened, 95% confidence interval [CI] = 5.62 to 7.14, P < .001), and combined DBT and S2D (7.40 per 1000 screened, 95% CI = 6.49 to 8.37, P < .001) compared with DM alone (4.68 per 1000 screened, 95% CI = 4.28 to 5.11). Invasive CDR was highest in combined DBT and DM (4.53 per 1000 screened, 95% CI = 3.97 to 5.12, P = .003) and combined DBT and S2D (5.68 per 1000 screened, 95% CI = 4.43 to 7.09, P < .001) compared with DM alone (3.42 per 1000 screened, 95% CI = 3.02 to 3.83). Recall rate was lowest in combined DBT and S2D (42.3 per 1000 screened, 95% CI = 37.4 to 60.4, P<.001). PPV1 was highest in combined DBT and DM (10.0%, 95% CI = 8.0% to 12.0%, P = .004), and combined DBT and S2D (16.0%, 95% CI = 10.0% to 23.0%, P < .001), whereas no difference was detected for DBT alone (7.0%, 95% CI = 6.0% to 8.0%, P = .75) compared with DM alone (7.0%, 95.0% CI = 5.0% to 8.0%).ConclusionsOur findings provide evidence on key performance metrics for DM, DBT alone, combined DBT and DM, and combined DBT and S2D, which may inform optimal application of these modalities for breast cancer screening.

Project description:Background Breast Imaging Reporting and Data System (BI-RADS) breast density categories assigned by interpreting radiologists often influence decisions surrounding supplemental breast cancer screening and risk assessment. The landscape of mammographic screening continuously evolves, and different mammographic screening modalities may result in different perception of density, reflected in different assignment of BI-RADS density categories. Purpose To investigate the effect of screening mammography modality on BI-RADS breast density assessments. Materials and Methods Data were retrospectively analyzed from 24 736 individual women (42.3% [10 455 of 24 736] white women, 57.7% [14 281 of 24 736] black women; mean age, 56.3 years; age range, 40.0-74.9 years) who underwent from one to seven mammographic screening examinations from September 2010 through February 2017 (60 766 examinations). Three screening modalities were used: digital mammography alone (8935 examinations); digital mammography with digital breast tomosynthesis (DBT; 30 779 examinations); and synthetic mammography with DBT (21 052 examinations). Random-effects logistic regression analysis was performed to estimate the likelihood of assignment to high versus low BI-RADS density category according to each modality, adjusted for ethnicity, age, body mass index (BMI), and radiologist. The interactions of modality with ethnicity and BMI on density categorization were also tested with the model. Results Women screened with DBT versus digital mammography alone had lower likelihood regarding categorization of high density breasts (digital mammography and DBT vs digital mammography: odds ratio, 0.69 [95% confidence interval: 0.61, 0.80], P < .001; synthetic mammography and DBT vs digital mammography: odds ratio, 0.43 [95% confidence interval: 0.37, 0.50], P < .001). Lower likelihood of high density was also observed at synthetic mammography and DBT compared with digital mammography and DBT (odds ratio, 0.62; 95% confidence interval: 0.56, 0.69; P < .001). There were interactions of modality with ethnicity (P = .007) and BMI (P = .003) on breast density assessment, with greater differences in density categorization according to modality observed for black women than for white women and groups with higher BMI. Conclusion Breast density categorization may vary by screening mammographic modality, and this effect appears to vary by ethnicity and body mass index. © RSNA, 2019 Online supplemental material is available for this article. See also the editorial by Philpotts in this issue.

Project description:PurposeTo investigate how an artificial intelligence (AI) system performs at digital mammography (DM) from a screening population with ground truth defined by digital breast tomosynthesis (DBT), and whether AI could detect breast cancers at DM that had originally only been detected at DBT.Materials and methodsIn this secondary analysis of data from a prospective study, DM examinations from 14 768 women (mean age, 57 years), examined with both DM and DBT with independent double reading in the Malmӧ Breast Tomosynthesis Screening Trial (MBTST) (ClinicalTrials.gov: NCT01091545; data collection, 2010-2015), were analyzed with an AI system. Of 136 screening-detected cancers, 95 cancers were detected at DM and 41 cancers were detected only at DBT. The system identifies suspicious areas in the image, scored 1-100, and provides a risk score of 1 to 10 for the whole examination. A cancer was defined as AI detected if the cancer lesion was correctly localized and scored at least 62 (threshold determined by the AI system developers), therefore resulting in the highest examination risk score of 10. Data were analyzed with descriptive statistics, and detection performance was analyzed with receiver operating characteristics.ResultsThe highest examination risk score was assigned to 10% (1493 of 14 786) of the examinations. With 90.8% specificity, the AI system detected 75% (71 of 95) of the DM-detected cancers and 44% (18 of 41) of cancers at DM that had originally been detected only at DBT. The majority were invasive cancers (17 of 18).ConclusionAlmost half of the additional DBT-only screening-detected cancers in the MBTST were detected at DM with AI. AI did not reach double reading performance; however, if combined with double reading, AI has the potential to achieve a substantial portion of the benefit of DBT screening.Keywords: Computer-aided Diagnosis, Mammography, Breast, Diagnosis, Classification, Application DomainClinical trial registration no. NCT01091545© RSNA, 2021.

Project description:Importance:Expensive and lengthy clinical trials can delay regulatory evaluation of innovative technologies, affecting patient access to high-quality medical products. Simulation is increasingly being used in product development but rarely in regulatory applications. Objectives:To conduct a computer-simulated imaging trial evaluating digital breast tomosynthesis (DBT) as a replacement for digital mammography (DM) and to compare the results with a comparative clinical trial. Design, Setting, and Participants:The simulated Virtual Imaging Clinical Trial for Regulatory Evaluation (VICTRE) trial was designed to replicate a clinical trial that used human patients and radiologists. Images obtained with in silico versions of DM and DBT systems via fast Monte Carlo x-ray transport were interpreted by a computational reader detecting the presence of lesions. A total of 2986 synthetic image-based virtual patients with breast sizes and radiographic densities representative of a screening population and compressed thicknesses from 3.5 to 6 cm were generated using an analytic approach in which anatomical structures are randomly created within a predefined breast volume and compressed in the craniocaudal orientation. A positive cohort contained a digitally inserted microcalcification cluster or spiculated mass. Main Outcomes and Measures:The trial end point was the difference in area under the receiver operating characteristic curve between modalities for lesion detection. The trial was sized for an SE of 0.01 in the change in area under the curve (AUC), half the uncertainty in the comparative clinical trial. Results:In this trial, computational readers analyzed 31?055 DM and 27?960 DBT cases from 2986 virtual patients with the following Breast Imaging Reporting and Data System densities: 286 (9.6%) extremely dense, 1200 (40.2%) heterogeneously dense, 1200 (40.2%) scattered fibroglandular densities, and 300 (10.0%) almost entirely fat. The mean (SE) change in AUC was 0.0587 (0.0062) (P?<?.001) in favor of DBT. The change in AUC was larger for masses (mean [SE], 0.0903 [0.008]) than for calcifications (mean [SE], 0.0268 [0.004]), which was consistent with the findings of the comparative trial (mean [SE], 0.065 [0.017] for masses and -0.047 [0.032] for calcifications). Conclusions and Relevance:The results of the simulated VICTRE trial are consistent with the performance seen in the comparative trial. While further research is needed to assess the generalizability of these findings, in silico imaging trials represent a viable source of regulatory evidence for imaging devices.

Project description:PurposeTo correlate the parenchymal texture features at digital breast tomosynthesis (DBT) and digital mammography with breast percent density (PD), an established breast cancer risk factor, in a screening population of women.Materials and methodsThis HIPAA-compliant study was approved by the institutional review board. Bilateral DBT images and digital mammograms from 71 women (mean age, 54 years; age range, 34-75 years) with negative or benign findings at screening mammography were retrospectively collected from a separate institutional review board-approved DBT screening trial (performed from July 2007 to March 2008) in which all women had given written informed consent. Parenchymal texture features of skewness, coarseness, contrast, energy, homogeneity, and fractal dimension were computed from the retroareolar region. Principal component analysis (PCA) was applied to obtain orthogonal texture components. Mammographic PD was estimated with software. Correlation analysis and multiple linear regression with generalized estimating equations were performed to determine the association between texture features and breast PD. Regression was adjusted for age to determine the independent association of texture to breast PD when age was also considered as a predictor variable.ResultsTexture feature correlations to breast PD were stronger with DBT than with digital mammography. Statistically significant correlations (P < .001) were observed for contrast (r = 0.48), energy (r = -0.47), and homogeneity (r = -0.56) at DBT and for contrast (r = 0.26), energy (r = -0.26), and homogeneity (r = -0.33) at digital mammography. Multiple linear regression analysis of PCA texture components as predictors of PD also demonstrated significantly stronger associations with DBT. The association was strongest when age was also considered as a predictor of PD (R² = 0.41 for DBT and 0.28 for digital mammography; P < .001).ConclusionParenchymal texture features are more strongly correlated to breast PD in DBT than in digital mammography. The authors' long-term hypothesis is that parenchymal texture analysis with DBT will result in quantitative imaging biomarkers that can improve the estimation of breast cancer risk.