Dataset Information

Computer-aided diagnosis prior to conventional interpretation of prostate mpMRI: an international multi-reader study.

ABSTRACT:

Objectives

To evaluate if computer-aided diagnosis (CAD) prior to prostate multi-parametric MRI (mpMRI) can improve sensitivity and agreement between radiologists.

Methods

Nine radiologists (three each high, intermediate, low experience) from eight institutions participated. A total of 163 patients with 3-T mpMRI from 4/2012 to 6/2015 were included: 110 cancer patients with prostatectomy after mpMRI, 53 patients with no lesions on mpMRI and negative TRUS-guided biopsy. Readers were blinded to all outcomes and detected lesions per PI-RADSv2 on mpMRI. After 5 weeks, readers re-evaluated patients using CAD to detect lesions. Prostatectomy specimens registered to MRI were ground truth with index lesions defined on pathology. Sensitivity, specificity and agreement were calculated per patient, lesion level and zone-peripheral (PZ) and transition (TZ).

Results

Index lesion sensitivity was 78.2% for mpMRI alone and 86.3% for CAD-assisted mpMRI (p = 0.013). Sensitivity was comparable for TZ lesions (78.7% vs 78.1%; p = 0.929); CAD improved PZ lesion sensitivity (84% vs 94%; p = 0.003). Improved sensitivity came from lesions scored PI-RADS < 3 as index lesion sensitivity was comparable at PI-RADS ≥ 3 (77.6% vs 78.1%; p = 0.859). Per patient specificity was 57.1% for CAD and 70.4% for mpMRI (p = 0.003). CAD improved agreement between all readers (56.9% vs 71.8%; p < 0.001).

Conclusions

CAD-assisted mpMRI improved sensitivity and agreement, but decreased specificity, between radiologists of varying experience.

Key points

• Computer-aided diagnosis (CAD) assists clinicians in detecting prostate cancer on MRI. • CAD assistance improves agreement between radiologists in detecting prostate cancer lesions. • However, this CAD system induces more false positives, particularly for less-experienced clinicians and in the transition zone. • CAD assists radiologists in detecting cancer missed on MRI, suggesting a path for improved diagnostic confidence.

SUBMITTER: Greer MD

PROVIDER: S-EPMC8023433 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundComputer-aided diagnosis (CADx) software that provides a second opinion has been widely used to assist physicians with various tasks. In dermatology, however, CADx has been mostly limited to melanoma or melanocytic skin cancer diagnosis. The frequency of non-melanocytic skin cancers and the accessibility of regular digital macrographs have raised interest in developing CADx for broader applications.ObjectivesTo investigate the feasibility of using CADx to diagnose both melanocytic and non-melanocytic skin lesions based on conventional digital photographic images.MethodsThis study was approved by an institutional review board, and the requirement to obtain informed consent was waived. In total, 769 conventional photographs of melanocytic and non-melanocytic skin lesions were retrospectively reviewed and used to develop a CADx system. Conventional and new color-related image features were developed to classify the lesions as benign or malignant using support vector machines (SVMs). The performance of CADx was compared with that of dermatologists.ResultsThe clinicians' overall sensitivity, specificity, and accuracy were 83.33%, 85.88%, and 85.31%, respectively. New color correlation and principal component analysis (PCA) features improved the classification ability of the baseline CADx (p = 0.001). The estimated area under the receiver operating characteristic (ROC) curve (Az) of the proposed CADx system was 0.949, with a sensitivity and specificity of 85.63% and 87.65%, respectively, and a maximum accuracy of 90.64%.ConclusionsWe have developed an effective CADx system to classify both melanocytic and non-melanocytic skin lesions using conventional digital macrographs. The system's performance was similar to that of dermatologists at our institute. Through improved feature extraction and SVM analysis, we found that conventional digital macrographs were feasible for providing useful information for CADx applications. The new color-related features significantly improved CADx applications for skin cancer.

Project description:Importance:The recent advances in the field of machine learning have raised expectations that computer-aided diagnosis will become the standard for the diagnosis of melanoma. Objective:To critically review the current literature and compare the diagnostic accuracy of computer-aided diagnosis with that of human experts. Data Sources:The MEDLINE, arXiv, and PubMed Central databases were searched to identify eligible studies published between January 1, 2002, and December 31, 2018. Study Selection:Studies that reported on the accuracy of automated systems for melanoma were selected. Search terms included melanoma, diagnosis, detection, computer aided, and artificial intelligence. Data Extraction and Synthesis:Evaluation of the risk of bias was performed using the QUADAS-2 tool, and quality assessment was based on predefined criteria. Data were analyzed from February 1 to March 10, 2019. Main Outcomes and Measures:Summary estimates of sensitivity and specificity and summary receiver operating characteristic curves were the primary outcomes. Results:The literature search yielded 1694 potentially eligible studies, of which 132 were included and 70 offered sufficient information for a quantitative analysis. Most studies came from the field of computer science. Prospective clinical studies were rare. Combining the results for automated systems gave a melanoma sensitivity of 0.74 (95% CI, 0.66-0.80) and a specificity of 0.84 (95% CI, 0.79-0.88). Sensitivity was lower in studies that used independent test sets than in those that did not (0.51; 95% CI, 0.34-0.69 vs 0.82; 95% CI, 0.77-0.86; P?<?.001); however, the specificity was similar (0.83; 95% CI, 0.71-0.91 vs 0.85; 95% CI, 0.80-0.88; P?=?.67). In comparison with dermatologists' diagnosis, computer-aided diagnosis showed similar sensitivities and a 10 percentage points lower specificity, but the difference was not statistically significant. Studies were heterogeneous and substantial risk of bias was found in all but 4 of the 70 studies included in the quantitative analysis. Conclusions and Relevance:Although the accuracy of computer-aided diagnosis for melanoma detection is comparable to that of experts, the real-world applicability of these systems is unknown and potentially limited owing to overfitting and the risk of bias of the studies at hand.