Dataset Information

Limitations of Deep Learning Attention Mechanisms in Clinical Research: Empirical Case Study Based on the Korean Diabetic Disease Setting.

ABSTRACT:

Background

Despite excellent prediction performance, noninterpretability has undermined the value of applying deep-learning algorithms in clinical practice. To overcome this limitation, attention mechanism has been introduced to clinical research as an explanatory modeling method. However, potential limitations of using this attractive method have not been clarified to clinical researchers. Furthermore, there has been a lack of introductory information explaining attention mechanisms to clinical researchers.

Objective

The aim of this study was to introduce the basic concepts and design approaches of attention mechanisms. In addition, we aimed to empirically assess the potential limitations of current attention mechanisms in terms of prediction and interpretability performance.

Methods

First, the basic concepts and several key considerations regarding attention mechanisms were identified. Second, four approaches to attention mechanisms were suggested according to a two-dimensional framework based on the degrees of freedom and uncertainty awareness. Third, the prediction performance, probability reliability, concentration of variable importance, consistency of attention results, and generalizability of attention results to conventional statistics were assessed in the diabetic classification modeling setting. Fourth, the potential limitations of attention mechanisms were considered.

Results

Prediction performance was very high for all models. Probability reliability was high in models with uncertainty awareness. Variable importance was concentrated in several variables when uncertainty awareness was not considered. The consistency of attention results was high when uncertainty awareness was considered. The generalizability of attention results to conventional statistics was poor regardless of the modeling approach.

Conclusions

The attention mechanism is an attractive technique with potential to be very promising in the future. However, it may not yet be desirable to rely on this method to assess variable importance in clinical settings. Therefore, along with theoretical studies enhancing attention mechanisms, more empirical studies investigating potential limitations should be encouraged.

SUBMITTER: Kim J

PROVIDER: S-EPMC7773508 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Limitations of Deep Learning Attention Mechanisms in Clinical Research: Empirical Case Study Based on the Korean Diabetic Disease Setting.

Kim Junetae J Lee Sangwon S Hwang Eugene E Ryu Kwang Sun KS Jeong Hanseok H Lee Jae Wook JW Hwangbo Yul Y Choi Kui Son KS Cha Hyo Soung HS

Journal of medical Internet research 20201216 12

<h4>Background</h4>Despite excellent prediction performance, noninterpretability has undermined the value of applying deep-learning algorithms in clinical practice. To overcome this limitation, attention mechanism has been introduced to clinical research as an explanatory modeling method. However, potential limitations of using this attractive method have not been clarified to clinical researchers. Furthermore, there has been a lack of introductory information explaining attention mechanisms to ...[more]

PMID: 33325832

Similar Datasets

Project description:In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.

Project description:Prioritizing comparative effectiveness research may contribute to obtaining answers that clinicians perceive they need and may minimize research that could be considered wasteful. Our objective was to identify evidence gaps and set priorities for new systematic reviews and randomized controlled trials for managing diabetic retinopathy (DR), including diabetic macular edema (DME).Cross-sectional study.Diabetic Retinopathy Clinical Research Network (DRCR.net) investigators.We provided recommendations from the American Academy of Ophthalmology's 2012 Preferred Practice Patterns for Diabetic Retinopathy as 91 answerable clinical research questions about intervention effectiveness to 410 DRCR.net investigators to rate each question's importance from 0 (not important) to 10 (very important) using a 2-round Delphi survey and to suggest additional questions. We considered questions as high priority if at least 75% of respondents to both rounds assigned an importance rating of 5 or more in round 2. We also extracted outcome measures relevant to DR and asked respondents to identify those that must be measured in all studies. We mapped Cochrane reviews published up to March 2016 to high-priority clinical research questions.Ranking of importance of each clinical question.Thirty-two individuals completed rounds 1 and 2 and suggested 15 questions. Among the final list of 106 clinical research questions, 22 questions met our definition of high priority: 9 of 22 concerned the effectiveness of anti-VEGF therapy, and 13 of 22 focused on how often patients should be followed up (re-examination) and treatment effectiveness in patients with specific characteristics (e.g., DME). Outcomes that 75% or more of respondents marked as "must be measured in all studies" included visual acuity and visual loss, death of participants, and intraocular pressure. Only 1 prioritized question was associated with conclusive evidence from a Cochrane systematic review.A limited response rate among DRCR.net members identified 22 comparative effectiveness research questions as high priority for the management of DR, including DME, but few were associated with Cochrane reviews. These results support the need of systematic reviews and randomized controlled trials to address evidence gaps.

Project description:Collective, coordinated cellular motions underpin key processes in all multicellular organisms, yet it has been difficult to simultaneously express the 'rules' behind these motions in clear, interpretable forms that effectively capture high-dimensional cell-cell interaction dynamics in a manner that is intuitive to the researcher. Here we apply deep attention networks to analyze several canonical living tissues systems and present the underlying collective migration rules for each tissue type using only cell migration trajectory data. We use these networks to learn the behaviors of key tissue types with distinct collective behaviors-epithelial, endothelial, and metastatic breast cancer cells-and show how the results complement traditional biophysical approaches. In particular, we present attention maps indicating the relative influence of neighboring cells to the learned turning decisions of a 'focal cell'-the primary cell of interest in a collective setting. Colloquially, we refer to this learned relative influence as 'attention', as it serves as a proxy for the physical parameters modifying the focal cell's future motion as a function of each neighbor cell. These attention networks reveal distinct patterns of influence and attention unique to each model tissue. Endothelial cells exhibit tightly focused attention on their immediate forward-most neighbors, while cells in more expansile epithelial tissues are more broadly influenced by neighbors in a relatively large forward sector. Attention maps of ensembles of more mesenchymal, metastatic cells reveal completely symmetric attention patterns, indicating the lack of any particular coordination or direction of interest. Moreover, we show how attention networks are capable of detecting and learning how these rules change based on biophysical context, such as location within the tissue and cellular crowding. That these results require only cellular trajectories and no modeling assumptions highlights the potential of attention networks for providing further biological insights into complex cellular systems.

Dataset Information

Limitations of Deep Learning Attention Mechanisms in Clinical Research: Empirical Case Study Based on the Korean Diabetic Disease Setting.

Background

Objective

Methods

Results

Conclusions

Publications

Limitations of Deep Learning Attention Mechanisms in Clinical Research: Empirical Case Study Based on the Korean Diabetic Disease Setting.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets