Dataset Information

Improving rib fracture detection accuracy and reading efficiency with deep learning-based detection software: a clinical evaluation.

ABSTRACT:

Objectives

To investigate the impact of deep learning (DL) on radiologists' detection accuracy and reading efficiency of rib fractures on CT.

Methods

Blunt chest trauma patients (n = 198) undergoing thin-slice CT were enrolled. Images were read by two radiologists (R1, R2) in three sessions: S1, unassisted reading; S2, assisted by DL as the concurrent reader; S3, DL as the second reader. The fractures detected by the readers and total reading time were documented. The reference standard for rib fractures was established by an expert panel. The sensitivity and false-positives per scan were calculated and compared among S1, S2, and S3.

Results

The reference standard identified 865 fractures on 713 ribs (102 patients) The sensitivity of S1, S2, and S3 was 82.8, 88.9, and 88.7% for R1, and 83.9, 88.7, and 88.8% for R2, respectively. The sensitivity of S2 and S3 was significantly higher compared to S1 for both readers (all p < 0.05). The sensitivity between S2 and S3 did not differ significantly (both p > 0.9). The false-positive per scan had no difference between sessions for R1 (p = 0.24) but was lower for S2 and S3 than S1 for R2 (both p < 0.05). Reading time decreased by 36% (R1) and 34% (R2) in S2 compared to S1.

Conclusions

Using DL as a concurrent reader can improve the detection accuracy and reading efficiency for rib fracture.

Advances in knowledge

DL can be integrated into the radiology workflow to improve the accuracy and reading efficiency of CT rib fracture detection.

SUBMITTER: Zhang B

PROVIDER: S-EPMC7934317 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Rib fracture detection is time-consuming and demanding work for radiologists. This study aimed to introduce a novel rib fracture detection system based on deep learning which can help radiologists to diagnose rib fractures in chest computer tomography (CT) images conveniently and accurately. A total of 1707 patients were included in this study from a single center. We developed a novel rib fracture detection system on chest CT using a three-step algorithm. According to the examination time, 1507, 100 and 100 patients were allocated to the training set, the validation set and the testing set, respectively. Free Response ROC analysis was performed to evaluate the sensitivity and false positivity of the deep learning algorithm. Precision, recall, F1-score, negative predictive value (NPV) and detection and diagnosis were selected as evaluation metrics to compare the diagnostic efficiency of this system with radiologists. The radiologist-only study was used as a benchmark and the radiologist-model collaboration study was evaluated to assess the model's clinical applicability. A total of 50,170,399 blocks (fracture blocks, 91,574; normal blocks, 50,078,825) were labelled for training. The F1-score of the Rib Fracture Detection System was 0.890 and the precision, recall and NPV values were 0.869, 0.913 and 0.969, respectively. By interacting with this detection system, the F1-score of the junior and the experienced radiologists had improved from 0.796 to 0.925 and 0.889 to 0.970, respectively; the recall scores had increased from 0.693 to 0.920 and 0.853 to 0.972, respectively. On average, the diagnosis time of radiologist assisted with this detection system was reduced by 65.3 s. The constructed Rib Fracture Detection System has a comparable performance with the experienced radiologist and is readily available to automatically detect rib fracture in the clinical setting with high efficacy, which could reduce diagnosis time and radiologists' workload in the clinical practice.