Browse
Submit Data
Databases
API
Help

Dataset Information

17 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Thermodynamics of continuous non-Markovian feedback control.

ABSTRACT: Feedback control mechanisms are ubiquitous in science and technology, and play an essential role in regulating physical, biological and engineering systems. The standard second law of thermodynamics does not hold in the presence of measurement and feedback. Most studies so far have extended the second law for discrete, Markovian feedback protocols; however, non-Markovian feedback is omnipresent in processes where the control signal is applied with a non-negligible delay. Here, we experimentally investigate the thermodynamics of continuous, time-delayed feedback control using the motion of an optically levitated, underdamped microparticle. We test the validity of a generalized second law which bounds the energy extracted from the system, and study the breakdown of feedback cooling for very large time delays.

SUBMITTER: Debiossac M

PROVIDER: S-EPMC7070085 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Thermodynamics of continuous non-Markovian feedback control.

Debiossac Maxime M Grass David D Alonso Jose Joaquin JJ Lutz Eric E Kiesel Nikolai N

Nature communications 20200313 1

Feedback control mechanisms are ubiquitous in science and technology, and play an essential role in regulating physical, biological and engineering systems. The standard second law of thermodynamics does not hold in the presence of measurement and feedback. Most studies so far have extended the second law for discrete, Markovian feedback protocols; however, non-Markovian feedback is omnipresent in processes where the control signal is applied with a non-negligible delay. Here, we experimentally ...[more]

PMID: 32170062

Similar Datasets

Nonequilibrium thermodynamics of the Markovian Mpemba effect and its inverse.

Project description:Under certain conditions, it takes a shorter time to cool a hot system than to cool the same system initiated at a lower temperature. This phenomenon-the "Mpemba effect"-was first observed in water and has recently been reported in other systems. Whereas several detail-dependent explanations were suggested for some of these observations, no common underlying mechanism is known. Using the theoretical framework of nonequilibrium thermodynamics, we present a widely applicable mechanism for a similar effect, the Markovian Mpemba effect, derive a sufficient condition for its appearance, and demonstrate it explicitly in three paradigmatic systems: the Ising model, diffusion dynamics, and a three-state system. In addition, we predict an inverse Markovian Mpemba effect in heating: Under proper conditions, a cold system can heat up faster than the same system initiated at a higher temperature. We numerically demonstrate that this inverse effect is expected in a 1D antiferromagnet nearest-neighbors interacting Ising chain in the presence of an external magnetic field. Our results shed light on the mechanism behind anomalous heating and cooling and suggest that it should be possible to observe these in a variety of systems.

| S-EPMC5441807 | biostudies-literature

Markovian and non-Markovian protein sequence evolution: aggregated Markov process models.

Project description:Over the years, there have been claims that evolution proceeds according to systematically different processes over different timescales and that protein evolution behaves in a non-Markovian manner. On the other hand, Markov models are fundamental to many applications in evolutionary studies. Apparent non-Markovian or time-dependent behavior has been attributed to influence of the genetic code at short timescales and dominance of physicochemical properties of the amino acids at long timescales. However, any long time period is simply the accumulation of many short time periods, and it remains unclear why evolution should appear to act systematically differently across the range of timescales studied. We show that the observed time-dependent behavior can be explained qualitatively by modeling protein sequence evolution as an aggregated Markov process (AMP): a time-homogeneous Markovian substitution model observed only at the level of the amino acids encoded by the protein-coding DNA sequence. The study of AMPs sheds new light on the relationship between amino acid-level and codon-level models of sequence evolution, and our results suggest that protein evolution should be modeled at the codon level rather than using amino acid substitution models.

| S-EPMC3157587 | biostudies-literature

Non-Markovian modeling of protein folding.

Project description:We extract the folding free energy landscape and the time-dependent friction function, the two ingredients of the generalized Langevin equation (GLE), from explicit-water molecular dynamics (MD) simulations of the α-helix forming polypeptide [Formula: see text] for a one-dimensional reaction coordinate based on the sum of the native H-bond distances. Folding and unfolding times from numerical integration of the GLE agree accurately with MD results, which demonstrate the robustness of our GLE-based non-Markovian model. In contrast, Markovian models do not accurately describe the peptide kinetics and in particular, cannot reproduce the folding and unfolding kinetics simultaneously, even if a spatially dependent friction profile is used. Analysis of the GLE demonstrates that memory effects in the friction significantly speed up peptide folding and unfolding kinetics, as predicted by the Grote-Hynes theory, and are the cause of anomalous diffusion in configuration space. Our methods are applicable to any reaction coordinate and in principle, also to experimental trajectories from single-molecule experiments. Our results demonstrate that a consistent description of protein-folding dynamics must account for memory friction effects.

| S-EPMC8346879 | biostudies-literature

Equivalence and its invalidation between non-Markovian and Markovian spreading dynamics on complex networks.

Project description:Epidemic spreading processes in the real world depend on human behaviors and, consequently, are typically non-Markovian in that the key events underlying the spreading dynamics cannot be described as a Poisson random process and the corresponding event time is not exponentially distributed. In contrast to Markovian type of spreading dynamics for which mathematical theories have been well developed, we lack a comprehensive framework to analyze and fully understand non-Markovian spreading processes. Here we develop a mean-field theory to address this challenge, and demonstrate that the theory enables accurate prediction of both the transient phase and the steady states of non-Markovian susceptible-infected-susceptible spreading dynamics on synthetic and empirical networks. We further find that the existence of equivalence between non-Markovian and Markovian spreading depends on a specific edge activation mechanism. In particular, when temporal correlations are absent on active edges, the equivalence can be expected; otherwise, an exact equivalence no longer holds.

| S-EPMC6707263 | biostudies-literature

Observation of non-Markovian micromechanical Brownian motion.

Project description:All physical systems are to some extent open and interacting with their environment. This insight, basic as it may seem, gives rise to the necessity of protecting quantum systems from decoherence in quantum technologies and is at the heart of the emergence of classical properties in quantum physics. The precise decoherence mechanisms, however, are often unknown for a given system. In this work, we make use of an opto-mechanical resonator to obtain key information about spectral densities of its condensed-matter heat bath. In sharp contrast to what is commonly assumed in high-temperature quantum Brownian motion describing the dynamics of the mechanical degree of freedom, based on a statistical analysis of the emitted light, it is shown that this spectral density is highly non-Ohmic, reflected by non-Markovian dynamics, which we quantify. We conclude by elaborating on further applications of opto-mechanical systems in open system identification.

| S-EPMC4525213 | biostudies-literature

Markovian and Non-Markovian Modeling of Membrane Dynamics with Milestoning.

Project description:We exploit atomically detailed simulations and the milestoning theory to extract coarse grained models of membrane kinetics and thermodynamics. Non-Markovian and Markovian theories for the phosphate group displacements are used to coarsely represent membrane motions. The construction of the two models makes it possible to examine their consistency and accuracy. The equilibrium and fluctuations of the phosphate groups along the normal to the membrane plane are estimated, and milestoning equations are constructed and solved. An optimal Markovian model is constructed that reproduces exactly the equilibrium and mean first passage time (MFPT) of the non-Markovian model. The equilibrium solution of both models is favorably compared to distributions obtained from straightforward molecular dynamics simulations. The picture for the kinetics is complex. Multiple local relaxation times of the mass density are illustrated emphasizing the non-Markovian characteristics of the process. In Markovian modeling, only a single relaxation time is assumed for a state. Mapping of particle dynamics to the dynamics of a field density offers a new way of coarse graining complex systems as membranes that may bridge between atomically detailed models and phenomenological descriptions of macroscopic membranes.

| S-EPMC5001947 | biostudies-other

Linear optics simulation of quantum non-Markovian dynamics.

Project description:The simulation of open quantum dynamics has recently allowed the direct investigation of the features of system-environment interaction and of their consequences on the evolution of a quantum system. Such interaction threatens the quantum properties of the system, spoiling them and causing the phenomenon of decoherence. Sometimes however a coherent exchange of information takes place between system and environment, memory effects arise and the dynamics of the system becomes non-Markovian. Here we report the experimental realisation of a non-Markovian process where system and environment are coupled through a simulated transverse Ising model. By engineering the evolution in a photonic quantum simulator, we demonstrate the role played by system-environment correlations in the emergence of memory effects.

| S-EPMC3520028 | biostudies-literature

Human and machine learning in non-Markovian decision making.

Project description:Humans can learn under a wide variety of feedback conditions. Reinforcement learning (RL), where a series of rewarded decisions must be made, is a particularly important type of learning. Computational and behavioral studies of RL have focused mainly on Markovian decision processes, where the next state depends on only the current state and action. Little is known about non-Markovian decision making, where the next state depends on more than the current state and action. Learning is non-Markovian, for example, when there is no unique mapping between actions and feedback. We have produced a model based on spiking neurons that can handle these non-Markovian conditions by performing policy gradient descent [1]. Here, we examine the model's performance and compare it with human learning and a Bayes optimal reference, which provides an upper-bound on performance. We find that in all cases, our population of spiking neurons model well-describes human performance.

| S-EPMC4405578 | biostudies-literature

Record ages of non-Markovian scale-invariant random walks.

Project description:How long is needed for an observable to exceed its previous highest value and establish a new record? This time, known as the age of a record plays a crucial role in quantifying record statistics. Until now, general methods for determining record age statistics have been limited to observations of either independent random variables or successive positions of a Markovian (memoryless) random walk. Here we develop a theoretical framework to determine record age statistics in the presence of memory effects for continuous non-smooth processes that are asymptotically scale-invariant. Our theoretical predictions are confirmed by numerical simulations and experimental realisations of diverse representative non-Markovian random walk models and real time series with memory effects, in fields as diverse as genomics, climatology, hydrology, geology and computer science. Our results reveal the crucial role of the number of records already achieved in time series and change our view on analysing record statistics.

| S-EPMC10562453 | biostudies-literature

Efficient simulation of non-Markovian dynamics on complex networks.

Project description:We study continuous-time multi-agent models, where agents interact according to a network topology. At any point in time, each agent occupies a specific local node state. Agents change their state at random through interactions with neighboring agents. The time until a transition happens can follow an arbitrary probability density. Stochastic (Monte-Carlo) simulations are often the preferred-sometimes the only feasible-approach to study the complex emerging dynamical patterns of such systems. However, each simulation run comes with high computational costs mostly due to updating the instantaneous rates of interconnected agents after each transition. This work proposes a stochastic rejection-based, event-driven simulation algorithm that scales extremely well with the size and connectivity of the underlying contact network and produces statistically correct samples. We demonstrate the effectiveness of our method on different information spreading models.

| S-EPMC7598478 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data