Unknown

Dataset Information

0

BioWordVec, improving biomedical word embeddings with subword information and MeSH.


ABSTRACT: Distributed word representations have become an essential foundation for biomedical natural language processing (BioNLP), text mining and information retrieval. Word embeddings are traditionally computed at the word level from a large corpus of unlabeled text, ignoring the information present in the internal structure of words or any information available in domain specific structured resources such as ontologies. However, such information holds potentials for greatly improving the quality of the word representation, as suggested in some recent studies in the general domain. Here we present BioWordVec: an open set of biomedical word vectors/embeddings that combines subword information from unlabeled biomedical text with a widely-used biomedical controlled vocabulary called Medical Subject Headings (MeSH). We assess both the validity and utility of our generated word embeddings over multiple NLP tasks in the biomedical domain. Our benchmarking results demonstrate that our word embeddings can result in significantly improved performance over the previous state of the art in those challenging tasks.

SUBMITTER: Zhang Y 

PROVIDER: S-EPMC6510737 | biostudies-literature | 2019 May

REPOSITORIES: biostudies-literature

altmetric image

Publications

BioWordVec, improving biomedical word embeddings with subword information and MeSH.

Zhang Yijia Y   Chen Qingyu Q   Yang Zhihao Z   Lin Hongfei H   Lu Zhiyong Z  

Scientific data 20190510 1


Distributed word representations have become an essential foundation for biomedical natural language processing (BioNLP), text mining and information retrieval. Word embeddings are traditionally computed at the word level from a large corpus of unlabeled text, ignoring the information present in the internal structure of words or any information available in domain specific structured resources such as ontologies. However, such information holds potentials for greatly improving the quality of th  ...[more]

Similar Datasets

| S-EPMC6585427 | biostudies-literature
| S-EPMC7959609 | biostudies-literature
| S-EPMC9301597 | biostudies-literature
| S-EPMC7309261 | biostudies-literature
| S-EPMC5910851 | biostudies-literature
| S-EPMC7856086 | biostudies-literature
| S-EPMC10283113 | biostudies-literature
| S-EPMC2955645 | biostudies-literature
| S-EPMC9280463 | biostudies-literature
| S-EPMC7391163 | biostudies-literature