Dataset Information

Deep-Learning-Based Pre-Diagnosis Assessment Module for Retinal Photographs: A Multicenter Study.

ABSTRACT:

Purpose

Artificial intelligence (AI) deep learning (DL) has been shown to have significant potential for eye disease detection and screening on retinal photographs in different clinical settings, particular in primary care. However, an automated pre-diagnosis image assessment is essential to streamline the application of the developed AI-DL algorithms. In this study, we developed and validated a DL-based pre-diagnosis assessment module for retinal photographs, targeting image quality (gradable vs. ungradable), field of view (macula-centered vs. optic-disc-centered), and laterality of the eye (right vs. left).

Methods

A total of 21,348 retinal photographs from 1914 subjects from various clinical settings in Hong Kong, Singapore, and the United Kingdom were used for training, internal validation, and external testing for the DL module, developed by two DL-based algorithms (EfficientNet-B0 and MobileNet-V2).

Results

For image-quality assessment, the pre-diagnosis module achieved area under the receiver operating characteristic curve (AUROC) values of 0.975, 0.999, and 0.987 in the internal validation dataset and the two external testing datasets, respectively. For field-of-view assessment, the module had an AUROC value of 1.000 in all of the datasets. For laterality-of-the-eye assessment, the module had AUROC values of 1.000, 0.999, and 0.985 in the internal validation dataset and the two external testing datasets, respectively.

Conclusions

Our study showed that this three-in-one DL module for assessing image quality, field of view, and laterality of the eye of retinal photographs achieved excellent performance and generalizability across different centers and ethnicities.

Translational relevance

The proposed DL-based pre-diagnosis module realized accurate and automated assessments of image quality, field of view, and laterality of the eye of retinal photographs, which could be further integrated into AI-based models to improve operational flow for enhancing disease screening and diagnosis.

SUBMITTER: Yuen V

PROVIDER: S-EPMC8444486 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundDeep learning has been widely used for glaucoma diagnosis. However, there is no clinically validated algorithm for glaucoma incidence and progression prediction. This study aims to develop a clinically feasible deep-learning system for predicting and stratifying the risk of glaucoma onset and progression based on color fundus photographs (CFPs), with clinical validation of performance in external population cohorts.MethodsWe established data sets of CFPs and visual fields collected from longitudinal cohorts. The mean follow-up duration was 3 to 5 years across the data sets. Artificial intelligence (AI) models were developed to predict future glaucoma incidence and progression based on the CFPs of 17,497 eyes in 9346 patients. The area under the receiver operating characteristic (AUROC) curve, sensitivity, and specificity of the AI models were calculated with reference to the labels provided by experienced ophthalmologists. Incidence and progression of glaucoma were determined based on longitudinal CFP images or visual fields, respectively.ResultsThe AI model to predict glaucoma incidence achieved an AUROC of 0.90 (0.81-0.99) in the validation set and demonstrated good generalizability, with AUROCs of 0.89 (0.83-0.95) and 0.88 (0.79-0.97) in external test sets 1 and 2, respectively. The AI model to predict glaucoma progression achieved an AUROC of 0.91 (0.88-0.94) in the validation set, and also demonstrated outstanding predictive performance with AUROCs of 0.87 (0.81-0.92) and 0.88 (0.83-0.94) in external test sets 1 and 2, respectively.ConclusionOur study demonstrates the feasibility of deep-learning algorithms in the early detection and prediction of glaucoma progression.FUNDINGNational Natural Science Foundation of China (NSFC); the High-level Hospital Construction Project, Zhongshan Ophthalmic Center, Sun Yat-sen University; the Science and Technology Program of Guangzhou, China (2021), the Science and Technology Development Fund (FDCT) of Macau, and FDCT-NSFC.

Project description:ObjectiveTo develop a deep learning algorithm (DLA) to detect diabetic kideny disease (DKD) from retinal photographs of patients with diabetes, and evaluate performance in multiethnic populations.Materials and methodsWe trained 3 models: (1) image-only; (2) risk factor (RF)-only multivariable logistic regression (LR) model adjusted for age, sex, ethnicity, diabetes duration, HbA1c, systolic blood pressure; (3) hybrid multivariable LR model combining RF data and standardized z-scores from image-only model. Data from Singapore Integrated Diabetic Retinopathy Program (SiDRP) were used to develop (6066 participants with diabetes, primary-care-based) and internally validate (5-fold cross-validation) the models. External testing on 2 independent datasets: (1) Singapore Epidemiology of Eye Diseases (SEED) study (1885 participants with diabetes, population-based); (2) Singapore Macroangiopathy and Microvascular Reactivity in Type 2 Diabetes (SMART2D) (439 participants with diabetes, cross-sectional) in Singapore. Supplementary external testing on 2 Caucasian cohorts: (3) Australian Eye and Heart Study (AHES) (460 participants with diabetes, cross-sectional) and (4) Northern Ireland Cohort for the Longitudinal Study of Ageing (NICOLA) (265 participants with diabetes, cross-sectional).ResultsIn SiDRP validation, area under the curve (AUC) was 0.826(95% CI 0.818-0.833) for image-only, 0.847(0.840-0.854) for RF-only, and 0.866(0.859-0.872) for hybrid. Estimates with SEED were 0.764(0.743-0.785) for image-only, 0.802(0.783-0.822) for RF-only, and 0.828(0.810-0.846) for hybrid. In SMART2D, AUC was 0.726(0.686-0.765) for image-only, 0.701(0.660-0.741) in RF-only, 0.761(0.724-0.797) for hybrid.Discussion and conclusionThere is potential for DLA using retinal images as a screening adjunct for DKD among individuals with diabetes. This can value-add to existing DLA systems which diagnose diabetic retinopathy from retinal images, facilitating primary screening for DKD.

Project description:International guidelines recommend deciding the treatment of colorectal lesions based on the estimated histology by endoscopic optical diagnosis. However, the theoretical and practical knowledge on optical diagnosis is not widely expanded The mail goal of this randomised controlled trial is to compare the pooled sensitivity of optical diagnosis for predicting deep submucosal invasion in large non-pedunculated polyps > 20 mm assessed in routine colonoscopies of gastroenterologists attending a e-learning module (intervention group) vs gastroenterologists who do not (control group) The main questions the study aims to answer are: * Is the pooled sensitivity of optical diagnosis for predicting deep submucosal invasion in large non-pedunculated polyps assessed in routine colonoscopies increased in those gastroenterologists participating in the e-learning module? * Is the pooled diagnostic accuracy of optical diagnosis for predicting deep sm invasion in large non-pedunculated polyps ≥ 20 mm assessed in routine colonoscopies increased in those gastroenterologists participating in the e-learning module? * In lesions with submucosal invasion, is the en bloc and complete resection rate (R0) increased in those gastroenterologists participating in the e-learning module? * In lesions referred to surgery, is the pooled benign polyps rate decreased in those gastroenterologists participating in the e-learning module? * In lesions treated with advanced en bloc procedures (ESD, TAMIS, fullthickness resection), is the pooled rate of histology with high-grade dysplasia, intramucosal cancer or submucosal invasion increased in those gastroenterologists participating in the e-learning module? * In lesions treated with piecemeal endoscopic resection, is the pooled rate of histology with high-grade dysplasia, intramucosal cancer or submucosal invasion decreased in those gastroenterologists participating in the e-learning module? * Is the diagnostic accuracy for predicting deep submucosal invasion in a test with pictures increased after participating in the e-learning module? The participants (or subjects of study) are gastroenterologists. They will be randomised to do the e-learning course (intervention group) or not (control group). Researchers will compare clinical outcomes of gastroenterologists participating in the e-learning module vs gastroenterologists not participating in the e-learning module to see if: * the pooled sensitivity of optical diagnosis for predicting deep submucosal invasion in large non-pedunculated polyps > 20 mm assessed in routine colonoscopies is increased. * the pooled diagnostic accuracy of optical diagnosis for predicting deep sm invasion in large non-pedunculated polyps > 20 mm is increased. * the en bloc and complete resection rate (R0) is increased in lesions with submucosal invasion. * the pooled benign polyps rate decreased in lesions referred to surgery. * the pooled rate of histology with high-grade dysplasia, intramucosal cancer or submucosal invasion increased in lesions treated with advanced en bloc procedures (ESD, TAMIS, fullthickness resection). * the pooled rate of histology with high-grade dysplasia, intramucosal cancer or submucosal invasion decreased in lesions treated with piecemeal endoscopic resection. * the diagnostic accuracy for predicting deep submucosal invasion in a test with pictures after participating is increased.

Project description:IntroductionCompared with traditional fundus examination techniques, ultra-widefield fundus (UWF) images provide 200° panoramic images of the retina, which allows better detection of peripheral retinal lesions. The advent of UWF provides effective solutions only for detection but still lacks efficient diagnostic capabilities. This study proposed a retinal lesion detection model to automatically locate and identify six relatively typical and high-incidence peripheral retinal lesions from UWF images which will enable early screening and rapid diagnosis.MethodsA total of 24,602 augmented ultra-widefield fundus images with labels corresponding to 6 peripheral retinal lesions and normal manifestation labelled by 5 ophthalmologists were included in this study. An object detection model named You Only Look Once X (YOLOX) was modified and trained to locate and classify the six peripheral retinal lesions including rhegmatogenous retinal detachment (RRD), retinal breaks (RB), white without pressure (WWOP), cystic retinal tuft (CRT), lattice degeneration (LD), and paving-stone degeneration (PSD). We applied coordinate attention block and generalized intersection over union (GIOU) loss to YOLOX and evaluated it for accuracy, sensitivity, specificity, precision, F1 score, and average precision (AP). This model was able to show the exact location and saliency map of the retinal lesions detected by the model thus contributing to efficient screening and diagnosis.ResultsThe model reached an average accuracy of 96.64%, sensitivity of 87.97%, specificity of 98.04%, precision of 87.01%, F1 score of 87.39%, and mAP of 86.03% on test dataset 1 including 248 UWF images and reached an average accuracy of 95.04%, sensitivity of 83.90%, specificity of 96.70%, precision of 78.73%, F1 score of 81.96%, and mAP of 80.59% on external test dataset 2 including 586 UWF images, showing this system performs well in distinguishing the six peripheral retinal lesions.ConclusionFocusing on peripheral retinal lesions, this work proposed a deep learning model, which automatically recognized multiple peripheral retinal lesions from UWF images and localized exact positions of lesions. Therefore, it has certain potential for early screening and intelligent diagnosis of peripheral retinal lesions.