Dataset Information

Automated Quantification of Photoreceptor alteration in macular disease using Optical Coherence Tomography and Deep Learning.

ABSTRACT: Diabetic macular edema (DME) and retina vein occlusion (RVO) are macular diseases in which central photoreceptors are affected due to pathological accumulation of fluid. Optical coherence tomography allows to visually assess and evaluate photoreceptor integrity, whose alteration has been observed as an important biomarker of both diseases. However, the manual quantification of this layered structure is challenging, tedious and time-consuming. In this paper we introduce a deep learning approach for automatically segmenting and characterising photoreceptor alteration. The photoreceptor layer is segmented using an ensemble of four different convolutional neural networks. En-face representations of the layer thickness are produced to characterize the photoreceptors. The pixel-wise standard deviation of the score maps produced by the individual models is also taken to indicate areas of photoreceptor abnormality or ambiguous results. Experimental results showed that our ensemble is able to produce results in pair with a human expert, outperforming each of its constitutive models. No statistically significant differences were observed between mean thickness estimates obtained from automated and manually generated annotations. Therefore, our model is able to reliable quantify photoreceptors, which can be used to improve prognosis and managment of macular diseases.

SUBMITTER: Orlando JI

PROVIDER: S-EPMC7101374 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Automated Quantification of Photoreceptor alteration in macular disease using Optical Coherence Tomography and Deep Learning.

Orlando José Ignacio JI Gerendas Bianca S BS Riedl Sophie S Grechenig Christoph C Breger Anna A Ehler Martin M Waldstein Sebastian M SM Bogunović Hrvoje H Schmidt-Erfurth Ursula U

Scientific reports 20200327 1

Diabetic macular edema (DME) and retina vein occlusion (RVO) are macular diseases in which central photoreceptors are affected due to pathological accumulation of fluid. Optical coherence tomography allows to visually assess and evaluate photoreceptor integrity, whose alteration has been observed as an important biomarker of both diseases. However, the manual quantification of this layered structure is challenging, tedious and time-consuming. In this paper we introduce a deep learning approach f ...[more]

PMID: 32221349

Similar Datasets

Project description:PurposeTo examine whether deep-learning denoised optical coherence tomography angiography (OCTA) images could enhance automated macular ischemia quantification in branch retinal vein occlusion (BRVO).MethodsThis retrospective, single-center, cross-sectional study enrolled 74 patients with BRVO and 46 age-matched healthy subjects. The severity of macular ischemia was graded as mild, moderate, or severe. Denoised OCTA images were produced using a neural network model. Quantitative parameters derived from denoised images, including vessel density and nonperfusion area, were compared with those derived from the OCTA machine. The main outcome measures were correlations between quantitative parameters, and areas under receiver operating characteristic curves (AUCs) in classifying the severity of the macular ischemia.ResultsThe vessel density and nonperfusion area from denoised images were correlated strongly with the corresponding parameters from machine-derived images in control eyes and BRVO eyes with mild or moderate macular ischemia (all P < 0.001). However, no such correlation was found in eyes with severe macular ischemia. The vessel density and nonperfusion area from denoised images had significantly larger area under receiver operating characteristic curve than those derived from the original images in classifying moderate versus severe macular ischemia (0.927 vs 0.802 [P = 0.042] and 0.946 vs 0.797, [P = 0.022], respectively). There were no significant differences in the areas under receiver operating characteristic curve between the denoised images and the machine-derived parameters in classifying control versus BRVO, and mild versus moderate macular ischemia.ConclusionsA neural network model is useful for removing speckle noise on OCTA images and facilitating the automated grading of macular ischemia in eyes with BRVO.Translational relevanceDeep-learning denoised optical coherence tomography angiography images could enhance automated macular ischemia quantification.

Project description:ImportanceAs currently used, microperimetry is a burdensome clinical testing modality for testing retinal sensitivity requiring long testing times and trained technicians.ObjectiveTo create a deep-learning network that could directly estimate function from structure de novo to provide an en face high-resolution map of estimated retinal sensitivity.Design, setting, and participantsA cross-sectional imaging study using data collected between January 1, 2016, and November 30, 2017, from the Natural History Observation and Registry of macular telangiectasia type 2 (MacTel) evaluated 38 participants with confirmed MacTel from 2 centers.Main outcomes and measuresMean absolute error of estimated compared with observed retinal sensitivity. Observed retinal sensitivity was obtained with fundus-controlled perimetry (microperimetry). Estimates of retinal sensitivity were made with deep-learning models that learned on superpositions of high-resolution optical coherence tomography (OCT) scans and microperimetry results. Those predictions were used to create high-density en face sensitivity maps of the macula. Training, validation, and test sets were segregated at the patient level.ResultsA total of 2499 microperimetry sensitivities were mapped onto 1708 OCT B-scans from 63 eyes of 38 patients (mean [SD] age, 74.3 [9.7] years; 15 men [39.5%]). The numbers of examples for our algorithm were 67 899 (103 053 after data augmentation) for training, 1695 for validation, and 1212 for testing. Mean absolute error results were 4.51 dB (95% CI, 4.36-4.65 dB) when using linear regression and 3.66 dB (95% CI, 3.53-3.78 dB) when using the LeNet model. Using a 49.9 million-variable deep-learning model, a mean absolute error of 3.36 dB (95% CI, 3.25-3.48 dB) of retinal sensitivity for validation and test was achieved. Correlation showed a high degree of agreement (Pearson correlation r = 0.78). By paired Wilcoxon rank sum test, our model significantly outperformed these 2 baseline models (P < .001).Conclusions and relevanceHigh-resolution en face maps of estimated retinal sensitivities were created in eyes with MacTel. The maps were of unequalled resolution compared with microperimetry and were able to correctly delineate functionally healthy and impaired retina. This model may be useful to monitor structural and functional disease progression and has potential as an objective surrogate outcome measure in investigational trials.

Project description:Several studies published so far used highly selective image datasets from unclear sources to train computer vision models and that may lead to overestimated results, while those studies conducted in real-life remain scarce. To avoid image selection bias, we stacked convolutional and recurrent neural networks (CNN-RNN) to analyze complete optical coherence tomography (OCT) cubes in a row and predict diabetic macular edema (DME), in a real-world diabetic retinopathy screening program. A retrospective cohort study was carried out. Throughout 4-years, 5314 OCT cubes from 4408 subjects who attended to the diabetic retinopathy (DR) screening program were included. We arranged twenty-two (22) pre-trained CNNs in parallel with a bidirectional RNN layer stacked at the bottom, allowing the model to make a prediction for the whole OCT cube. The staff of retina experts built a ground truth of DME later used to train a set of these CNN-RNN models with different configurations. For each trained CNN-RNN model, we performed threshold tuning to find the optimal cut-off point for binary classification of DME. Finally, the best models were selected according to sensitivity, specificity, and area under the receiver operating characteristics curve (AUROC) with their 95% confidence intervals (95%CI). An ensemble of the best models was also explored. 5188 cubes were non-DME and 126 were DME. Three models achieved an AUROC of 0.94. Among these, sensitivity, and specificity (95%CI) ranged from 84.1-90.5 and 89.7-93.3, respectively, at threshold 1, from 89.7-92.1 and 80-83.1 at threshold 2, and from 80.2-81 and 93.8-97, at threshold 3. The ensemble model improved these results, and lower specificity was observed among subjects with sight-threatening DR. Analysis by age, gender, or grade of DME did not vary the performance of the models. CNN-RNN models showed high diagnostic accuracy for detecting DME in a real-world setting. This engine allowed us to detect extra-foveal DMEs commonly overlooked in other studies, and showed potential for application as the first filter of non-referable patients in an outpatient center within a population-based DR screening program, otherwise ended up in specialized care.

Dataset Information

Automated Quantification of Photoreceptor alteration in macular disease using Optical Coherence Tomography and Deep Learning.

Publications

Automated Quantification of Photoreceptor alteration in macular disease using Optical Coherence Tomography and Deep Learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets