Unknown

Dataset Information

0

Learning molecular dynamics with simple language model built upon long short-term memory neural network.


ABSTRACT: Recurrent neural networks have led to breakthroughs in natural language processing and speech recognition. Here we show that recurrent networks, specifically long short-term memory networks can also capture the temporal evolution of chemical/biophysical trajectories. Our character-level language model learns a probabilistic model of 1-dimensional stochastic trajectories generated from higher-dimensional dynamics. The model captures Boltzmann statistics and also reproduces kinetics across a spectrum of timescales. We demonstrate how training the long short-term memory network is equivalent to learning a path entropy, and that its embedding layer, instead of representing contextual meaning of characters, here exhibits a nontrivial connectivity between different metastable states in the underlying physical system. We demonstrate our model's reliability through different benchmark systems and a force spectroscopy trajectory for multi-state riboswitch. We anticipate that our work represents a stepping stone in the understanding and use of recurrent neural networks for understanding the dynamics of complex stochastic molecular systems.

SUBMITTER: Tsai ST 

PROVIDER: S-EPMC7547727 | biostudies-literature | 2020 Oct

REPOSITORIES: biostudies-literature

altmetric image

Publications

Learning molecular dynamics with simple language model built upon long short-term memory neural network.

Tsai Sun-Ting ST   Kuo En-Jui EJ   Tiwary Pratyush P  

Nature communications 20201009 1


Recurrent neural networks have led to breakthroughs in natural language processing and speech recognition. Here we show that recurrent networks, specifically long short-term memory networks can also capture the temporal evolution of chemical/biophysical trajectories. Our character-level language model learns a probabilistic model of 1-dimensional stochastic trajectories generated from higher-dimensional dynamics. The model captures Boltzmann statistics and also reproduces kinetics across a spect  ...[more]

Similar Datasets

| S-EPMC7079345 | biostudies-literature
| S-EPMC2945821 | biostudies-literature
| S-EPMC6738919 | biostudies-other
| S-EPMC7077979 | biostudies-literature
| S-EPMC6941898 | biostudies-literature
| S-EPMC2828875 | biostudies-literature
| S-EPMC2544606 | biostudies-literature
| S-EPMC6518582 | biostudies-literature
| S-EPMC2725236 | biostudies-literature
| S-EPMC4058299 | biostudies-literature