Dataset Information

Detection and visualization of abnormality in chest radiographs using modality-specific convolutional neural network ensembles.

ABSTRACT: Convolutional neural networks (CNNs) trained on natural images are extremely successful in image classification and localization due to superior automated feature extraction capability. In extending their use to biomedical recognition tasks, it is important to note that visual features of medical images tend to be uniquely different than natural images. There are advantages offered through training these networks on large scale medical common modality image collections pertaining to the recognition task. Further, improved generalization in transferring knowledge across similar tasks is possible when the models are trained to learn modality-specific features and then suitably repurposed for the target task. In this study, we propose modality-specific ensemble learning toward improving abnormality detection in chest X-rays (CXRs). CNN models are trained on a large-scale CXR collection to learn modality-specific features and then repurposed for detecting and localizing abnormalities. Model predictions are combined using different ensemble strategies toward reducing prediction variance and sensitivity to the training data while improving overall performance and generalization. Class-selective relevance mapping (CRM) is used to visualize the learned behavior of the individual models and their ensembles. It localizes discriminative regions of interest (ROIs) showing abnormal regions and offers an improved explanation of model predictions. It was observed that the model ensembles demonstrate superior localization performance in terms of Intersection of Union (IoU) and mean Average Precision (mAP) metrics than any individual constituent model.

SUBMITTER: Rajaraman S

PROVIDER: S-EPMC7083159 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Detection and visualization of abnormality in chest radiographs using modality-specific convolutional neural network ensembles.

Rajaraman Sivaramakrishnan S Kim Incheol I Antani Sameer K SK

PeerJ 20200317

Convolutional neural networks (CNNs) trained on natural images are extremely successful in image classification and localization due to superior automated feature extraction capability. In extending their use to biomedical recognition tasks, it is important to note that visual features of medical images tend to be uniquely different than natural images. There are advantages offered through training these networks on large scale medical common modality image collections pertaining to the recognit ...[more]

PMID: 32211231

Similar Datasets

Project description:Recent studies reported that a convolutional neural network (CNN; a deep learning model) can detect elevated pulmonary artery wedge pressure (PAWP) from chest radiographs, the diagnostic images most commonly used for assessing pulmonary congestion in heart failure. However, no method has been published for quantitatively estimating PAWP from such radiographs. We hypothesized that a regression CNN, an alternative type of deep learning, could be a useful tool for quantitatively estimating PAWP in cardiovascular diseases. We retrospectively enrolled 936 patients with cardiovascular diseases who had undergone right heart catheterization (RHC) and chest radiography and estimated PAWP by constructing a regression CNN based on the VGG16 model. We randomly categorized 80% of the data as training data (training group, n = 748) and 20% as test data (test group, n = 188). Moreover, we tuned the learning rate-one of the model parameters-by 5-hold cross-validation of the training group. Correlations between PAWP measured by RHC [ground truth (GT) PAWP] and PAWP derived from the regression CNN (estimated PAWP) were tested. To visualize how the regression CNN assessed the images, we created a regression activation map (RAM), a visualization technique for regression CNN. Estimated PAWP correlated significantly with GT PAWP in both the training (r = 0.76, P < 0.001) and test group (r = 0.62, P < 0.001). Bland-Altman plots found a mean (SEM) difference between GT and estimated PAWP of - 0.23 (0.16) mm Hg in the training and - 0.05 (0.41) mm Hg in the test group. The RAM showed that our regression CNN model estimated high PAWP by focusing on the cardiomegaly and pulmonary congestion. In the test group, the area under the curve (AUC) for detecting elevated PAWP (≥ 18 mm Hg) produced by the regression CNN model was similar to the AUC of an experienced cardiologist (0.86 vs 0.83, respectively; P = 0.24). This proof-of-concept study shows that regression CNN can quantitatively estimate PAWP from standard chest radiographs in cardiovascular diseases.

Project description:Rapid and accurate assessment of endotracheal tube (ETT) location is essential in the intensive care unit (ICU) setting, where timely identification of a mispositioned support device may prevent significant patient morbidity and mortality. This study proposes a series of deep learning-based algorithms which together iteratively identify and localize the position of an ETT relative to the carina on chest radiographs. Using the open-source MIMIC Chest X-Ray (MIMIC-CXR) dataset, a total of 16,000 patients were identified (8000 patients with an ETT and 8000 patients without an ETT). Three different convolutional neural network (CNN) algorithms were created. First, a regression loss function CNN was trained to estimate the coordinate location of the carina, which was then used to crop the original radiograph to the distal trachea and proximal bronchi. Second, a classifier CNN was trained using the cropped inputs to determine the presence or absence of an ETT. Finally, for radiographs containing an ETT, a third regression CNN was trained to both refine the coordinate location of the carina and identify the location of the distal ETT tip. Model accuracy was assessed by comparing the absolute distance of prediction and ground-truth coordinates as well as CNN predictions relative to measurements documented in original radiologic reports. Upon five-fold cross validation, binary classification for the presence or absence of ETT demonstrated an accuracy, sensitivity, specificity, PPV, NPV, and AUC of 97.14%, 97.37%, 96.89%, 97.12%, 97.15%, and 99.58% respectively. CNN predicted coordinate location of the carina, and distal ETT tip was estimated within a median error of 0.46 cm and 0.60 cm from ground-truth annotations respectively. Overall final CNN assessment of distance between the carina and distal ETT tip was predicted within a median error of 0.60 cm from manual ground-truth annotations, and a median error of 0.66 cm from measurements documented in the original radiology reports. A serial cascaded CNN approach demonstrates high accuracy for both identification and localization of ETT tip and carina on chest radiographs. High performance of the proposed multi-step strategy is in part related to iterative refinement of coordinate localization as well as explicit image cropping which focuses algorithm attention to key anatomic regions of interest.

Project description:BackgroundPneumothorax can lead to a life-threatening emergency. The experienced radiologists can offer precise diagnosis according to the chest radiographs. The localization of the pneumothorax lesions will help to quickly diagnose, which will be benefit for the patients in the underdevelopment areas lack of the experienced radiologists. In recent years, with the development of large neural network architectures and medical imaging datasets, deep learning methods have become a methodology of choice for analyzing medical images. The objective of this study was to the construct convolutional neural networks to localize the pneumothorax lesions in chest radiographs.Methods and findingsWe developed a convolutional neural network, called CheXLocNet, for the segmentation of pneumothorax lesions. The SIIM-ACR Pneumothorax Segmentation dataset was used to train and validate CheXLocNets. The training dataset contained 2079 radiographs with the annotated lesion areas. We trained six CheXLocNets with various hyperparameters. Another 300 annotated radiographs were used to select parameters of these CheXLocNets as the validation set. We determined the optimal parameters by the AP50 (average precision at the intersection over union (IoU) equal to 0.50), a segmentation evaluation metric used by several well-known competitions. Then CheXLocNets were evaluated by a test set (1082 normal radiographs and 290 disease radiographs), based on the classification metrics: area under the receiver operating characteristic curve (AUC), sensitivity, specificity, and positive predictive value (PPV); segmentation metrics: IoU and Dice score. For the classification, CheXLocNet with best sensitivity produced an AUC of 0.87, sensitivity of 0.78 (95% CI 0.73-0.83), and specificity of 0.78 (95% CI 0.76-0.81). CheXLocNet with best specificity produced an AUC of 0.79, sensitivity of 0.46 (95% CI 0.40-0.52), and specificity of 0.92 (95% CI 0.90-0.94). For the segmentation, CheXLocNet with best sensitivity produced an IoU of 0.69 and Dice score of 0.72. CheXLocNet with best specificity produced an IoU of 0.77 and Dice score of 0.79. We combined them to form an ensemble CheXLocNet. The ensemble CheXLocNet produced an IoU of 0.81 and Dice score of 0.82. Our CheXLocNet succeeded in automatically detecting pneumothorax lesions, without any human guidance.ConclusionsIn this study, we proposed a deep learning network, called, CheXLocNet, for the automatic segmentation of chest radiographs to detect pneumothorax. Our CheXLocNets generated accurate classification results and high-quality segmentation masks for the pneumothorax at the same time. This technology has the potential to improve healthcare delivery and increase access to chest radiograph expertise for the detection of diseases. Furthermore, the segmentation results can offer comprehensive geometric information of lesions, which can benefit monitoring the sequential development of lesions with high accuracy. Thus, CheXLocNets can be further extended to be a reliable clinical decision support tool. Although we used transfer learning in training CheXLocNet, the parameters of CheXLocNet was still large for the radiograph dataset. Further work is necessary to prune CheXLocNet suitable for the radiograph dataset.

Dataset Information

Detection and visualization of abnormality in chest radiographs using modality-specific convolutional neural network ensembles.

Publications

Detection and visualization of abnormality in chest radiographs using modality-specific convolutional neural network ensembles.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets