Dataset Information

Comparison of deep learning systems and cornea specialists in detecting corneal diseases from low-quality images

ABSTRACT: Summary The performance of deep learning in disease detection from high-quality clinical images is identical to and even greater than that of human doctors. However, in low-quality images, deep learning performs poorly. Whether human doctors also have poor performance in low-quality images is unknown. Here, we compared the performance of deep learning systems with that of cornea specialists in detecting corneal diseases from low-quality slit lamp images. The results showed that the cornea specialists performed better than our previously established deep learning system (PEDLS) trained on only high-quality images. The performance of the system trained on both high- and low-quality images was superior to that of the PEDLS while inferior to that of a senior corneal specialist. This study highlights that cornea specialists perform better in low-quality images than the system trained on high-quality images. Adding low-quality images with sufficient diagnostic certainty to the training set can reduce this performance gap. Graphical abstract Highlights • Deep learning performs poorly in low-quality images for detecting corneal diseases• Corneal specialists perform better than the PEDLS in low-quality images• The performance of the NDLS is better than that of the PEDLS in low-quality images• Adding low-quality images to the training set can improve the system's performance Ocular surface; Ophthalmology; Artificial intelligence

SUBMITTER: Li Z

PROVIDER: S-EPMC8577078 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Study designRetrospective diagnostic study.ObjectiveTo automatically detect osteolytic bone metastasis lesions in the thoracolumbar region using conventional computed tomography (CT) scans, we developed a new deep learning (DL)-based computer-aided detection model.Summary of background dataRadiographic detection of bone metastasis is often difficult, even for orthopedic surgeons and diagnostic radiologists, with a consequent risk for pathologic fracture or spinal cord injury. If we can improve detection rates, we will be able to prevent the deterioration of patients' quality of life at the end stage of cancer.Materials and methodsThis study included CT scans acquired at Tokyo Medical and Dental University (TMDU) Hospital between 2016 and 2022. A total of 263 positive CT scans that included at least one osteolytic bone metastasis lesion in the thoracolumbar spine and 172 negative CT scans without bone metastasis were collected for the datasets to train and validate the DL algorithm. As a test data set, 20 positive and 20 negative CT scans were separately collected from the training and validation datasets. To evaluate the performance of the established artificial intelligence (AI) model, sensitivity, precision, F1-score, and specificity were calculated. The clinical utility of our AI model was also evaluated through observer studies involving six orthopaedic surgeons and six radiologists.ResultsOur AI model showed a sensitivity, precision, and F1-score of 0.78, 0.68, and 0.72 (per slice) and 0.75, 0.36, and 0.48 (per lesion), respectively. The observer studies revealed that our AI model had comparable sensitivity to orthopaedic or radiology experts and improved the sensitivity and F1-score of residents.ConclusionWe developed a novel DL-based AI model for detecting osteolytic bone metastases in the thoracolumbar spine. Although further improvement in accuracy is needed, the current AI model may be applied to current clinical practice.Level of evidenceLevel III.

Project description:Acute lower respiratory infection is the leading cause of child death in developing countries. Current strategies to reduce this problem include early detection and appropriate treatment. Better diagnostic and therapeutic strategies are still needed in poor countries. Artificial-intelligence chest X-ray scheme has the potential to become a screening tool for lower respiratory infection in child. Artificial-intelligence chest X-ray schemes for children are rare and limited to a single lung disease. We need a powerful system as a diagnostic tool for most common lung diseases in children. To address this, we present a computer-aided diagnostic scheme for the chest X-ray images of several common pulmonary diseases of children, including bronchiolitis/bronchitis, bronchopneumonia/interstitial pneumonitis, lobar pneumonia, and pneumothorax. The study consists of two main approaches: first, we trained a model based on YOLOv3 architecture for cropping the appropriate location of the lung field automatically. Second, we compared three different methods for multi-classification, included the one-versus-one scheme, the one-versus-all scheme and training a classifier model based on convolutional neural network. Our model demonstrated a good distinguishing ability for these common lung problems in children. Among the three methods, the one-versus-one scheme has the best performance. We could detect whether a chest X-ray image is abnormal with 92.47% accuracy and bronchiolitis/bronchitis, bronchopneumonia, lobar pneumonia, pneumothorax, or normal with 71.94%, 72.19%, 85.42%, 85.71%, and 80.00% accuracy, respectively. In conclusion, we provide a computer-aided diagnostic scheme by deep learning for common pulmonary diseases in children. This scheme is mostly useful as a screening for normal versus most of lower respiratory problems in children. It can also help review the chest X-ray images interpreted by clinicians and may remind possible negligence. This system can be a good diagnostic assistance under limited medical resources.

Dataset Information

Comparison of deep learning systems and cornea specialists in detecting corneal diseases from low-quality images

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets