Dataset Information

Comparison of automated and expert human grading of diabetic retinopathy using smartphone-based retinal photography.

ABSTRACT:

Purpose

The aim of this study is to investigate the efficacy of a mobile platform that combines smartphone-based retinal imaging with automated grading for determining the presence of referral-warranted diabetic retinopathy (RWDR).

Methods

A smartphone-based camera (RetinaScope) was used by non-ophthalmic personnel to image the retina of patients with diabetes. Images were analyzed with the Eyenuk EyeArt® system, which generated referral recommendations based on presence of diabetic retinopathy (DR) and/or markers for clinically significant macular oedema. Images were independently evaluated by two masked readers and categorized as refer/no refer. The accuracies of the graders and automated interpretation were determined by comparing results to gold standard clinical diagnoses.

Results

A total of 119 eyes from 69 patients were included. RWDR was present in 88 eyes (73.9%) and in 54 patients (78.3%). At the patient-level, automated interpretation had a sensitivity of 87.0% and specificity of 78.6%; grader 1 had a sensitivity of 96.3% and specificity of 42.9%; grader 2 had a sensitivity of 92.5% and specificity of 50.0%. At the eye-level, automated interpretation had a sensitivity of 77.8% and specificity of 71.5%; grader 1 had a sensitivity of 94.0% and specificity of 52.2%; grader 2 had a sensitivity of 89.5% and specificity of 66.9%.

Discussion

Retinal photography with RetinaScope combined with automated interpretation by EyeArt achieved a lower sensitivity but higher specificity than trained expert graders. Feasibility testing was performed using non-ophthalmic personnel in a retina clinic with high disease burden. Additional studies are needed to assess efficacy of screening diabetic patients from general population.

SUBMITTER: Kim TN

PROVIDER: S-EPMC7852658 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Diabetic Retinopathy (DR) may result in various degrees of vision loss and even blindness if not diagnosed in a timely manner. Therefore, having an annual eye exam helps early detection to prevent vision loss in earlier stages, especially for diabetic patients. Recent technological advances made smartphone-based retinal imaging systems available on the market to perform small-sized, low-powered, and affordable DR screening in diverse environments. However, the accuracy of DR detection depends on the field of view and image quality. Since smartphone-based retinal imaging systems have much more compact designs than a traditional fundus camera, captured images are likely to be the low quality with a smaller field of view. Our motivation in this paper is to develop an automatic DR detection model for smartphone-based retinal images using the deep learning approach with the ResNet50 network. This study first utilized the well-known AlexNet, GoogLeNet, and ResNet50 architectures, using the transfer learning approach. Second, these frameworks were retrained with retina images from several datasets including EyePACS, Messidor, IDRiD, and Messidor-2 to investigate the effect of using images from the single, cross, and multiple datasets. Third, the proposed ResNet50 model is applied to smartphone-based synthetic images to explore the DR detection accuracy of smartphone-based retinal imaging systems. Based on the vision-threatening diabetic retinopathy detection results, the proposed approach achieved a high classification accuracy of 98.6%, with a 98.2% sensitivity and a 99.1% specificity while its AUC was 0.9978 on the independent test dataset. As the main contributions, DR detection accuracy was improved using the deep transfer learning approach for the ResNet50 network with publicly available datasets and the effect of the field of view in smartphone-based retinal imaging was studied. Although a smaller number of images were used in the training set compared with the existing studies, considerably acceptable high accuracies for validation and testing data were obtained.