Dataset Information

A Theory of Cheap Control in Embodied Systems.

ABSTRACT: We present a framework for designing cheap control architectures of embodied agents. Our derivation is guided by the classical problem of universal approximation, whereby we explore the possibility of exploiting the agent's embodiment for a new and more efficient universal approximation of behaviors generated by sensorimotor control. This embodied universal approximation is compared with the classical non-embodied universal approximation. To exemplify our approach, we present a detailed quantitative case study for policy models defined in terms of conditional restricted Boltzmann machines. In contrast to non-embodied universal approximation, which requires an exponential number of parameters, in the embodied setting we are able to generate all possible behaviors with a drastically smaller model, thus obtaining cheap universal approximation. We test and corroborate the theory experimentally with a six-legged walking machine. The experiments indicate that the controller complexity predicted by our theory is close to the minimal sufficient value, which means that the theory has direct practical implications.

SUBMITTER: Montufar G

PROVIDER: S-EPMC4556690 | biostudies-literature | 2015 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Theory of Cheap Control in Embodied Systems.

Montúfar Guido G Ghazi-Zahedi Keyan K Ay Nihat N

PLoS computational biology 20150901 9

We present a framework for designing cheap control architectures of embodied agents. Our derivation is guided by the classical problem of universal approximation, whereby we explore the possibility of exploiting the agent's embodiment for a new and more efficient universal approximation of behaviors generated by sensorimotor control. This embodied universal approximation is compared with the classical non-embodied universal approximation. To exemplify our approach, we present a detailed quantita ...[more]

PMID: 26325254

Similar Datasets

Project description:Almost every biomedical systems analysis requires early decisions regarding the choice of the most suitable representations to be used. De facto the most prevalent choice is a system of ordinary differential equations (ODEs). This framework is very popular because it is flexible and fairly easy to use. It is also supported by an enormous array of stand-alone programs for analysis, including many distinct numerical solvers that are implemented in the main programming languages. Having selected ODEs, the modeler must then choose a mathematical format for the equations. This selection is not trivial as nearly unlimited options exist and there is seldom objective guidance. The typical choices include ad hoc representations, default models like mass-action or Lotka-Volterra equations, and generic approximations. Within the realm of approximations, linear models are typically successful for analyses of engineered systems, but they are not as appropriate for biomedical phenomena, which often display nonlinear features such as saturation, threshold effects or limit cycle oscillations, and possibly even chaos. Power-law approximations are simple but overcome these limitations. They are the key ingredient of Biochemical Systems Theory (BST), which uses ODEs exclusively containing power-law representations for all processes within a model. BST models cover a vast repertoire of nonlinear responses and, at the same time, have structural properties that are advantageous for a wide range of analyses. Nonetheless, as all ODE models, the BST approach has limitations. In particular, it is not always straightforward to account for genuine discreteness, time delays, and stochastic processes. As a new option, we therefore propose here an alternative to BST in the form of discrete Biochemical Systems Theory (dBST). dBST models have the same generality and practicality as their BST-ODE counterparts, but they are readily implemented even in situations where ODEs struggle. As a case study, we illustrate dBST applied to the dynamics of the aryl hydrocarbon receptor (AhR), a signal transduction system that simultaneously involves time delays and stochasticity.

Project description:Understanding the real-time dynamical mechanisms of neural systems remains a significant issue, preventing the development of efficient neural technology and user trust. This is because the mechanisms, involving various neural spatial-temporal ingredients [i.e., neural structure (NS), neural dynamics (ND), neural plasticity (NP), and neural memory (NM)], are too complex to interpret and analyze altogether. While advanced tools have been developed using explainable artificial intelligence (XAI), node-link diagram, topography map, and other visualization techniques, they still fail to monitor and visualize all of these neural ingredients online. Accordingly, we propose here for the first time "NeuroVis," real-time neural spatial-temporal information measurement and visualization, as a method/tool to measure temporal neural activities and their propagation throughout the network. By using this neural information along with the connection strength and plasticity, NeuroVis can visualize the NS, ND, NM, and NP via i) spatial 2D position and connection, ii) temporal color gradient, iii) connection thickness, and iv) temporal luminous intensity and change of connection thickness, respectively. This study presents three use cases of NeuroVis to evaluate its performance: i) function approximation using a modular neural network with recurrent and feedforward topologies together with supervised learning, ii) robot locomotion control and learning using the same modular network with reinforcement learning, and iii) robot locomotion control and adaptation using another larger-scale adaptive modular neural network. The use cases demonstrate how NeuroVis tracks and analyzes all neural ingredients of various (embodied) neural systems in real-time under the robot operating system (ROS) framework. To this end, it will offer the opportunity to better understand embodied dynamic neural information processes, boost efficient neural technology development, and enhance user trust.

Dataset Information

A Theory of Cheap Control in Embodied Systems.

Publications

A Theory of Cheap Control in Embodied Systems.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets