Dataset Information

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement.

ABSTRACT: Neurally inspired robotics already has a long history that includes reactive systems emulating reflexes, neural oscillators to generate movement patterns, and neural networks as trainable filters for high-dimensional sensory information. Neural inspiration has been less successful at the level of cognition. Decision-making, planning, building and using memories, for instance, are more often addressed in terms of computational algorithms than through neural process models. To move neural process models beyond reactive behavior toward cognition, the capacity to autonomously generate sequences of processing steps is critical. We review a potential solution to this problem that is based on strongly recurrent neural networks described as neural dynamic systems. Their stable states perform elementary motor or cognitive functions while coupled to sensory inputs. The state of the neural dynamics transitions to a new motor or cognitive function when a previously stable neural state becomes unstable. Only when a neural robotic system is capable of acting autonomously does it become a useful to a human user. We demonstrate how a neural dynamic architecture that supports autonomous sequence generation can engage in such interaction. A human user presents colored objects to the robot in a particular order, thus defining a serial order of color concepts. The user then exposes the system to a visual scene that contains the colored objects in a new spatial arrangement. The robot autonomously builds a scene representation by sequentially bringing objects into the attentional foreground. Scene memory updates if the scene changes. The robot performs visual search and then reaches for the objects in the instructed serial order. In doing so, the robot generalizes across time and space, is capable of waiting when an element is missing, and updates its action plans online when the scene changes. The entire flow of behavior emerges from a time-continuous neural dynamics without any controlling or supervisory algorithm.

SUBMITTER: Tekulve J

PROVIDER: S-EPMC6873106 | biostudies-literature | 2019

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement.

Tekülve Jan J Fois Adrien A Sandamirskaya Yulia Y Schöner Gregor G

Frontiers in neurorobotics 20191115

Neurally inspired robotics already has a long history that includes reactive systems emulating reflexes, neural oscillators to generate movement patterns, and neural networks as trainable filters for high-dimensional sensory information. Neural inspiration has been less successful at the level of cognition. Decision-making, planning, building and using memories, for instance, are more often addressed in terms of computational algorithms than through neural process models. To move neural process ...[more]

PMID: 31803041

Similar Datasets

Project description:Although the natural haptic perception of textures includes active finger movements, it is unclear how closely perception and movements are linked. Here we investigated this question using oriented textures. Textures that are composed of periodically repeating grooves have a clear orientation defined by the grooves. The direction of finger movement relative to texture orientation determines the availability of temporal cues to the spatial period of the texture. These cues are absent during movements directed in line with texture orientation, whereas movements orthogonal to texture orientation maximize the temporal frequency of stimulation. This may optimize temporal cues. In Experiment 1 we tested whether texture perception gets more precise the more orthogonal the movement direction is to the texture. We systematically varied the movement direction within a 2IFC spatial period discrimination task. As expected, perception was more precise (lower discrimination thresholds) when finger movements were directed closer towards the texture orthogonal as compared to in parallel to the texture. In Experiment 2 we investigated whether people adjust movement directions to the texture orthogonal in free exploration. We recorded movement directions during free exploration of standard and comparison gratings. The standard gratings were clearly oriented. The comparison gratings did not have a clear orientation defined by grooves. Participants adjusted movement directions to the texture orthogonal only for clearly oriented textures (standards). The adjustment to texture orthogonal was present in the final movement but not in the first movement. This suggests that movement adjustment is based on sensory signals for texture orientation that were gathered over the course of exploration. In Experiment 3 we assessed whether the perception of texture orientation and movement adjustments are based on shared sensory signals. We determined perceptual thresholds for orientation discrimination and computed 'movometric' thresholds from the stroke-by-stroke adjustment of movement direction. Perception and movements were influenced by a common factor, the spatial period, suggesting that the same sensory signals for texture orientation contribute to both. We conclude that people optimize texture perception by adjusting their movements in directions that maximize temporal cue frequency. Adjustments are performed on the basis of sensory signals that are also used for perception.

Project description:Persistent homology provides a new approach for the topological simplification of big data via measuring the life time of intrinsic topological features in a filtration process and has found its success in scientific and engineering applications. However, such a success is essentially limited to qualitative data classification and analysis. Indeed, persistent homology has rarely been employed for quantitative modeling and prediction. Additionally, the present persistent homology is a passive tool, rather than a proactive technique, for classification and analysis. In this work, we outline a general protocol to construct object-oriented persistent homology methods. By means of differential geometry theory of surfaces, we construct an objective functional, namely, a surface free energy defined on the data of interest. The minimization of the objective functional leads to a Laplace-Beltrami operator which generates a multiscale representation of the initial data and offers an objective oriented filtration process. The resulting differential geometry based object-oriented persistent homology is able to preserve desirable geometric features in the evolutionary filtration and enhances the corresponding topological persistence. The cubical complex based homology algorithm is employed in the present work to be compatible with the Cartesian representation of the Laplace-Beltrami flow. The proposed Laplace-Beltrami flow based persistent homology method is extensively validated. The consistence between Laplace-Beltrami flow based filtration and Euclidean distance based filtration is confirmed on the Vietoris-Rips complex for a large amount of numerical tests. The convergence and reliability of the present Laplace-Beltrami flow based cubical complex filtration approach are analyzed over various spatial and temporal mesh sizes. The Laplace-Beltrami flow based persistent homology approach is utilized to study the intrinsic topology of proteins and fullerene molecules. Based on a quantitative model which correlates the topological persistence of fullerene central cavity with the total curvature energy of the fullerene structure, the proposed method is used for the prediction of fullerene isomer stability. The efficiency and robustness of the present method are verified by more than 500 fullerene molecules. It is shown that the proposed persistent homology based quantitative model offers good predictions of total curvature energies for ten types of fullerene isomers. The present work offers the first example to design object-oriented persistent homology to enhance or preserve desirable features in the original data during the filtration process and then automatically detect or extract the corresponding topological traits from the data.

Dataset Information

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement.

Publications

Autonomous Sequence Generation for a Neural Dynamic Robot: Scene Perception, Serial Order, and Object-Oriented Movement.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets