Unknown

Dataset Information

0

A neuro-symbolic method for understanding free-text medical evidence.


ABSTRACT:

Objective

We introduce Medical evidence Dependency (MD)-informed attention, a novel neuro-symbolic model for understanding free-text clinical trial publications with generalizability and interpretability.

Materials and methods

We trained one head in the multi-head self-attention model to attend to the Medical evidence Ddependency (MD) and to pass linguistic and domain knowledge on to later layers (MD informed). This MD-informed attention model was integrated into BioBERT and tested on 2 public machine reading comprehension benchmarks for clinical trial publications: Evidence Inference 2.0 and PubMedQA. We also curated a small set of recently published articles reporting randomized controlled trials on COVID-19 (coronavirus disease 2019) following the Evidence Inference 2.0 guidelines to evaluate the model's robustness to unseen data.

Results

The integration of MD-informed attention head improves BioBERT substantially in both benchmark tasks-as large as an increase of +30% in the F1 score-and achieves the new state-of-the-art performance on the Evidence Inference 2.0. It achieves 84% and 82% in overall accuracy and F1 score, respectively, on the unseen COVID-19 data.

Conclusions

MD-informed attention empowers neural reading comprehension models with interpretability and generalizability via reusable domain knowledge. Its compositionality can benefit any transformer-based architecture for machine reading comprehension of free-text medical evidence.

SUBMITTER: Kang T 

PROVIDER: S-EPMC8135980 | biostudies-literature |

REPOSITORIES: biostudies-literature

Similar Datasets

| S-EPMC2995652 | biostudies-literature
| S-EPMC5860058 | biostudies-literature
| S-EPMC2526997 | biostudies-literature
| S-EPMC3022815 | biostudies-literature
| S-EPMC3129371 | biostudies-literature
| S-EPMC8521877 | biostudies-literature
| S-EPMC7647336 | biostudies-literature
| S-EPMC6116986 | biostudies-literature
| S-EPMC2954790 | biostudies-literature
| S-EPMC11003538 | biostudies-literature