Dataset Information

Impact of targeted diabetic retinopathy training for graders in Vietnam and the implications for future diabetic retinopathy screening programmes: a diagnostic test accuracy study.

ABSTRACT:

Objectives

To compare the accuracy of trained level 1 diabetic retinopathy (DR) graders (nurses, endocrinologists and one general practitioner), level 2 graders (midlevel ophthalmologists) and level 3 graders (senior ophthalmologists) in Vietnam against a reference standard from the UK and assess the impact of supplementary targeted grader training.

Design

Diagnostic test accuracy study.

Setting

Secondary care hospitals in Southern Vietnam.

Participants

DR training was delivered to Vietnamese graders in February 2018 by National Health Service (NHS) UK graders. Two-field retinal images (412 patient images) were graded by 14 trained graders in Vietnam between August and October 2018 and then regraded retrospectively by an NHS-certified reference standard UK optometrist (phase I). Further DR training based on phase I results was delivered to graders in November 2019. After training, a randomised subset of images from January to October 2020 (115 patient images) was graded by six of the original cohort (phase II). The reference grader regraded all images from phase I and II retrospectively in masked fashion.

Primary and secondary outcome measures

Sensitivity was calculated at the two different time points, and χ² was used to test significance.

Results

In phase I, the sensitivity for detecting any DR for all grader groups in Vietnam was low (41.8-42.2%) and improved in phase II after additional training was delivered (51.3-87.2%). The greatest improvement was seen among level 1 graders (p<0.001), and the lowest improvement was observed among level 3 graders (p=0.326). There was a statistically significant improvement in sensitivity for detecting referable DR and referable diabetic macular oedema between all grader levels. The post-training values ranged from 40.0 to 61.5% (including ungradable images) and 55.6%-90.0% (excluding ungradable images).

Conclusions

This study demonstrates that targeted training interventions can improve accuracy of DR grading. These findings have important implications for improving service delivery in DR screening programmes in low-resource settings.

SUBMITTER: Curran K

PROVIDER: S-EPMC9472142 | biostudies-literature | 2022 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Impact of targeted diabetic retinopathy training for graders in Vietnam and the implications for future diabetic retinopathy screening programmes: a diagnostic test accuracy study.

Curran Katie K Congdon Nathan N Hoang Tung Thanh TT Lohfeld Lynne L Nguyen Van Thu VT Nguyen Hue Thi HT Nguyen Quan Nhu QN Dardis Catherine C Virgili Gianni G Piyasena Prabhath P Tran Huong H Salongcay Recivall Pascual RP Tung Mai Quoc MQ Peto Tunde T

BMJ open 20220909 9

<h4>Objectives</h4>To compare the accuracy of trained level 1 diabetic retinopathy (DR) graders (nurses, endocrinologists and one general practitioner), level 2 graders (midlevel ophthalmologists) and level 3 graders (senior ophthalmologists) in Vietnam against a reference standard from the UK and assess the impact of supplementary targeted grader training.<h4>Design</h4>Diagnostic test accuracy study.<h4>Setting</h4>Secondary care hospitals in Southern Vietnam.<h4>Participants</h4>DR training w ...[more]

PMID: 36691192

Similar Datasets

Project description:BackgroundThe evidence on diagnostic test accuracy (DTA) of diabetic retinopathy (DR) screening utilising photographic studies by non-ophthalmologist personnel in low and middle-income country (LMIC) settings is scarce. We aimed to assess DTA of DR screening using a nonmydriatic hand-held digital camera by trained general physicians in a non-ophthalmic setting.MethodsThis study is a validation of a screening intervention. We selected 700 people with diabetes (PwDM) > 18 years of age, not previously screened or treated for DR, presenting at a tertiary medical clinic in Sri Lanka. Two-field retinal imaging was used to capture fundus images before and after pupil dilatation, using a hand-held non-mydriatic (Visuscout 100®-Germany) digital retinal camera. The images were captured and graded by two trained, masked independent physician graders. The DTA of different levels of DR was assessed comparing physician's grading with a retinologist's clinical examination by mydriatic bio-microscopy, according to a locally adopted guideline.ResultsSeven hundred eligible PwDM were screened by physician graders. The mean age of participants was 60.8 years (SD ±10.08) and mean duration of DM was 9.9 years (SD ±8.09). Ungradable image proportion in non-mydriatic imaging was 43.4% (either eye-31.3%, both eyes 12.1%). This decreased to 12.8% (either eye-11.6%, both eyes-1.2%) following pupil dilatation. In comparison to detection of any level of DR, a referable level DR (moderate non-proliferative DR and levels above) showed a higher level of DTA. The sensitivity of the defined referable DR was 88.7% (95% CI 81.7-93.8%) for grader 1 (positive predictive value [PPV] 59.1%) and 92.5% (95% CI 86.4-96.5%) for grader 2 (PPV 68%), using mydriatic imaging, after including ungradable images as screen positives. The specificity was 94.9% (95% CI 93.6-96.0%) for grader 1 (negative predictive value [NPV] 99%) and 96.4% (95% CI 95.3-97.3%) for grader 2 (NPV 99.4%).ConclusionsThe Physicians grading of images from a digital hand-held non-mydriatic camera at a medical clinic, with dilatation of pupil of those who have ungradable images, provides a valid modality to identify referable level of DR. This could be a feasible alternative modality to the existing opportunistic screening to improve the access and coverage.Trial registrationCurrent Controlled Trials ISRCTN47559703 . Date of Registration 18th March 2019, Retrospectively registered.

Project description:PurposeTo test an online training course for non-ophthalmic diabetic retinopathy (DR) graders for recognition of glaucomatous optic nerves in Vietnam.MethodsThis was an uncontrolled, experimental, before-and-after study in which 43 non-ophthalmic DR graders underwent baseline testing on a standard image set, completed a self-paced, online training course and were retested using the same photographs presented randomly. Twenty-nine local ophthalmologists completed the same test without the training course. DR graders then underwent additional one-to-one training by a glaucoma specialist and were retested. Test performance (% correct, compared with consensus grades from four fellowship-trained glaucoma experts), sensitivity, specificity, positive and negative predictive value, and area under the receiver operating (AUC) curve, were computed.ResultsMean age of DR graders (32.6±5.5 years) did not differ from ophthalmologists (32.3±7.3 years, p=0.13). Online training required a mean of 297.9 (SD 144.6) minutes. Graders' mean baseline score (33.3%±14.3%) improved significantly after training (55.8%±12.6%, p<0.001), and post-training score did not differ from ophthalmologists (58.7±15.4%, p=0.384). Although grader sensitivity reduced before [85.5% (95% CI 83.5% to 87.3%)] versus after [80.4% (78.3% to 82.4%)] training, specificity improved significantly [47.8 (44.9 to 50.7) vs 79.8 (77.3 to 82.0), p<0.001]. Grader AUC also improved after training [66.6 (64.9 to 68.3)] to [80.1 (78.5 to 81.6), p<0.001]. Additional one-to-one grader training by a glaucoma specialist did not further improve grader scores.ConclusionNon-ophthalmic DR graders can be trained to recognise glaucoma using a short online course in this setting, with no additional benefit from more expensive one-to-one training. After 5-hour online training in recognising glaucomatous optic nerve head, scores of non-ophthalmic DR graders doubled, and did not differ from local ophthalmologists. Intensive one-to-one training did not further improve performance.

Project description:BackgroundDiabetic retinopathy (DR), a common complication of diabetes mellitus, is the leading cause of impaired vision in adults worldwide. Smartphone ophthalmoscopy involves using a smartphone camera for digital retinal imaging. Utilizing smartphones to detect DR is potentially more affordable, accessible, and easier to use than conventional methods.ObjectiveThis study aimed to determine the diagnostic accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients.MethodsWe performed an electronic search on the Medical Literature Analysis and Retrieval System Online (MEDLINE), EMBASE, and Cochrane Library for literature published from January 2000 to November 2018. We included studies involving diabetic patients, which compared the diagnostic accuracy of smartphone ophthalmoscopy for detecting DR to an accurate or commonly employed reference standard, such as indirect ophthalmoscopy, slit-lamp biomicroscopy, and tabletop fundus photography. Two reviewers independently screened studies against the inclusion criteria, extracted data, and assessed the quality of included studies using the Quality Assessment of Diagnostic Accuracy Studies-2 tool, with disagreements resolved via consensus. Sensitivity and specificity were pooled using the random effects model. A summary receiver operating characteristic (SROC) curve was constructed. This review is reported in line with the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies guidelines.ResultsIn all, nine studies involving 1430 participants were included. Most studies were of high quality, except one study with limited applicability because of its reference standard. The pooled sensitivity and specificity for detecting any DR was 87% (95% CI 74%-94%) and 94% (95% CI 81%-98%); mild nonproliferative DR (NPDR) was 39% (95% CI 10%-79%) and 95% (95% CI 91%-98%); moderate NPDR was 71% (95% CI 57%-81%) and 95% (95% CI 88%-98%); severe NPDR was 80% (95% CI 49%-94%) and 97% (95% CI 88%-99%); proliferative DR (PDR) was 92% (95% CI 79%-97%) and 99% (95% CI 96%-99%); diabetic macular edema was 79% (95% CI 63%-89%) and 93% (95% CI 82%-97%); and referral-warranted DR was 91% (95% CI 86%-94%) and 89% (95% CI 56%-98%). The area under SROC curve ranged from 0.879 to 0.979. The diagnostic odds ratio ranged from 11.3 to 1225.ConclusionsWe found heterogeneous evidence showing that smartphone ophthalmoscopy performs well in detecting DR. The diagnostic accuracy for PDR was highest. Future studies should standardize reference criteria and classification criteria and evaluate other available forms of smartphone ophthalmoscopy in primary care settings.

Project description:INTRODUCTION:Diabetic retinopathy (DR) is a common microvascular complication of diabetes mellitus and the leading cause of impaired vision in adults worldwide. Early detection and treatment for DR could improve patient outcomes. Traditional methods of detecting DR include the gold standard Early Treatment Diabetic Retinopathy Study seven standard fields fundus photography, ophthalmoscopy and slit-lamp biomicroscopy. These modalities can be expensive, difficult to access and require involvement of specialised healthcare professionals. With the development of mobile phone technology, there is a growing interest in their use for DR identification as this approach is potentially more affordable, accessible and easier to use. Smartphones can be employed in a variety of ways for ophthalmoscopy including the use of smartphone camera, various attachments and artificial intelligence for obtaining and grading of retinal images. The aim of this scoping review is to determine the diagnostic test accuracy of various smartphone ophthalmoscopy approaches for detecting DR in diabetic patients. METHODS AND ANALYSIS:We will perform an electronic search of MEDLINE, Embase and Cochrane Library for literature published from 2000 onwards. Two reviewers will independently analyse studies for eligibility and assess study quality using the QUADAS-2 tool. Data for a 2?2 contingency table will be extracted. If possible, we will pool sensitivity and specificity data using the random-effects model and construct a summary receiver operating characteristic curve. In case of high heterogeneity, we will present the findings narratively. Subgroup analysis and sensitivity analysis will be performed where appropriate. ETHICS AND DISSEMINATION:This scoping review aims to provide an overview of smartphone ophthalmoscopy in DR identification. It will present findings on the accuracy of smartphone ophthalmoscopy in detecting DR, identify gaps in the literature and provide recommendations for future research. This review does not require ethical approval as we will not collect primary data.

Project description:BackgroundTo evaluate the accuracy and reliability of fundus retinal photos graded by local graders in Bangladesh with those graded by an expert at the Centre for Eye Research Australia (CERA) in the context of mass scale diabetic retinopathy (DR) screening in Bangladesh.MethodsA population-based cross-sectional study of 3,104 adults identified 213 (7.2%) eligible patients with diabetes of age ? 40 years in 2012-2013. Retinal photographs were collected using a non-mydriatic digital fundus retinal camera and a two-field imaging protocol. The photos were graded by two remote graders (G1 and G2) who were trained by a retinal specialist (RS) in Bangladesh, by the RS himself, and by a Centre for Eye Research Australia (CERA) grader. The local graders up skilled their grading ability by comparing 30% of the photos graded by the CERA grader with their own grades. Learning from that exercise was applied to the remaining 70% of photos, which were re-graded. Reliability and accuracy of grading amongst the graders were reported using cross tabulation, inter- and intra-grader reliability, and with sensitivity and specificity.ResultsOf 122 eyes from 61 patients, the mild (R1) DR was estimated to be 14 to 25%, pre-proliferative (R2) DR 4-8%, and proliferative (R3) DR 0.8 to 1.6%, whereas 25%, 8%, 18%, and 15% were found to be ungradable by CERA, RS, G1, and G2, respectively. Of 8 (6.6%) eyes identified as R2 by the CERA grader, 5 (63%), 3 (38%) and 3 (38%) were correctly classified as R2, whereas the rest were classified either as R1 or R3 but none were classified as no DR (R0) or ungradable by the RS, G1 and G2, respectively. After getting experience reviewing the 30% test set graded by the CERA grader, the local graders graded moderate and severe DR with 100% accuracy. After excluding ungradable photos, the sensitivity (specificity) relative to the CERA grader was 82% (88%) before and 80% (93%) after training for G1 and 56% (87%) before and 77% (90%) after training for G2. In case of maculopathy, the CERA grader reported 11.2% eyes with maculopathy, which included 100% of the 4.9% by RS, 6.6% by G1, and 7.4% by G2.ConclusionsLocal graders in Bangladesh are able to grade retinal photos with high accuracy if the DR is at least of a moderate level. With appropriate training and experience, local graders have the ability to contribute significantly to the grading of millions of retinal photos, which required grading in resource- poor countries.

Dataset Information

Impact of targeted diabetic retinopathy training for graders in Vietnam and the implications for future diabetic retinopathy screening programmes: a diagnostic test accuracy study.

Objectives

Design

Setting

Participants

Primary and secondary outcome measures

Results

Conclusions

Publications

Impact of targeted diabetic retinopathy training for graders in Vietnam and the implications for future diabetic retinopathy screening programmes: a diagnostic test accuracy study.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets