Unknown

Dataset Information

0

Locally Embedding Autoencoders: A Semi-Supervised Manifold Learning Approach of Document Representation.


ABSTRACT: Topic models and neural networks can discover meaningful low-dimensional latent representations of text corpora; as such, they have become a key technology of document representation. However, such models presume all documents are non-discriminatory, resulting in latent representation dependent upon all other documents and an inability to provide discriminative document representation. To address this problem, we propose a semi-supervised manifold-inspired autoencoder to extract meaningful latent representations of documents, taking the local perspective that the latent representation of nearby documents should be correlative. We first determine the discriminative neighbors set with Euclidean distance in observation spaces. Then, the autoencoder is trained by joint minimization of the Bernoulli cross-entropy error between input and output and the sum of the square error between neighbors of input and output. The results of two widely used corpora show that our method yields at least a 15% improvement in document clustering and a nearly 7% improvement in classification tasks compared to comparative methods. The evidence demonstrates that our method can readily capture more discriminative latent representation of new documents. Moreover, some meaningful combinations of words can be efficiently discovered by activating features that promote the comprehensibility of latent representation.

SUBMITTER: Wei C 

PROVIDER: S-EPMC4718658 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

altmetric image

Publications

Locally Embedding Autoencoders: A Semi-Supervised Manifold Learning Approach of Document Representation.

Wei Chao C   Luo Senlin S   Ma Xincheng X   Ren Hao H   Zhang Ji J   Pan Limin L  

PloS one 20160119 1


Topic models and neural networks can discover meaningful low-dimensional latent representations of text corpora; as such, they have become a key technology of document representation. However, such models presume all documents are non-discriminatory, resulting in latent representation dependent upon all other documents and an inability to provide discriminative document representation. To address this problem, we propose a semi-supervised manifold-inspired autoencoder to extract meaningful laten  ...[more]

Similar Datasets

2019-11-13 | GSE140262 | GEO
| S-EPMC7943198 | biostudies-literature
| S-EPMC8489729 | biostudies-literature
| S-EPMC4893667 | biostudies-other
| S-EPMC10569512 | biostudies-literature
| S-EPMC6245200 | biostudies-literature
| S-EPMC8625121 | biostudies-literature
| S-EPMC8456123 | biostudies-literature
| S-EPMC8589823 | biostudies-literature
| S-EPMC9933436 | biostudies-literature