Dataset Information

A dynamical model of hierarchical selection and coordination in speech planning.

ABSTRACT: studies of the control of complex sequential movements have dissociated two aspects of movement planning: control over the sequential selection of movement plans, and control over the precise timing of movement execution. This distinction is particularly relevant in the production of speech: utterances contain sequentially ordered words and syllables, but articulatory movements are often executed in a non-sequential, overlapping manner with precisely coordinated relative timing. This study presents a hybrid dynamical model in which competitive activation controls selection of movement plans and coupled oscillatory systems govern coordination. The model departs from previous approaches by ascribing an important role to competitive selection of articulatory plans within a syllable. Numerical simulations show that the model reproduces a variety of speech production phenomena, such as effects of preparation and utterance composition on reaction time, and asymmetries in patterns of articulatory timing associated with onsets and codas. The model furthermore provides a unified understanding of a diverse group of phonetic and phonological phenomena which have not previously been related.

SUBMITTER: Tilsen S

PROVIDER: S-EPMC3634742 | biostudies-literature | 2013

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A dynamical model of hierarchical selection and coordination in speech planning.

Tilsen Sam S

PloS one 20130424 4

studies of the control of complex sequential movements have dissociated two aspects of movement planning: control over the sequential selection of movement plans, and control over the precise timing of movement execution. This distinction is particularly relevant in the production of speech: utterances contain sequentially ordered words and syllables, but articulatory movements are often executed in a non-sequential, overlapping manner with precisely coordinated relative timing. This study prese ...[more]

PMID: 23638147

Similar Datasets

Project description:Assisting individuals in their daily activities through autonomous mobile robots is a significant concern, especially for users without specialized knowledge. Specifically, the capability of a robot to navigate to destinations based on human speech instructions is crucial. Although robots can take different paths toward the same objective, the shortest path is not always the most suitable. A preferred approach would be to accommodate waypoint specifications flexibly for planning an improved alternative path even with detours. Furthermore, robots require real-time inference capabilities. In this sense, spatial representations include semantic, topological, and metric-level representations, each capturing different aspects of the environment. This study aimed to realize a hierarchical spatial representation using a topometric semantic map and path planning with speech instructions by including waypoints. Thus, we present a hierarchical path planning method called spatial concept-based topometric semantic mapping for hierarchical path planning (SpCoTMHP), which integrates place connectivity. This approach provides a novel integrated probabilistic generative model and fast approximate inferences with interactions among the hierarchy levels. A formulation based on "control as probabilistic inference" theoretically supports the proposed path planning algorithm. We conducted experiments in a home environment using the Toyota human support robot on the SIGVerse simulator and in a lab-office environment with the real robot Albert. Here, the user issues speech commands that specify the waypoint and goal, such as "Go to the bedroom via the corridor." Navigation experiments were performed using speech instructions with a waypoint to demonstrate the performance improvement of the SpCoTMHP over the baseline hierarchical path planning method with heuristic path costs (HPP-I) in terms of the weighted success rate at which the robot reaches the closest target (0.590) and passes the correct waypoints. The computation time was significantly improved by 7.14 s with the SpCoTMHP than the baseline HPP-I in advanced tasks. Thus, hierarchical spatial representations provide mutually understandable instruction forms for both humans and robots, thus enabling language-based navigation.

Project description:Upon perceiving sensory errors during movements, the human sensorimotor system updates future movements to compensate for the errors, a phenomenon called sensorimotor adaptation. One component of this adaptation is thought to be driven by sensory prediction errors-discrepancies between predicted and actual sensory feedback. However, the mechanisms by which prediction errors drive adaptation remain unclear. Here, auditory prediction error-based mechanisms involved in speech auditory-motor adaptation were examined via the feedback aware control of tasks in speech (FACTS) model. Consistent with theoretical perspectives in both non-speech and speech motor control, the hierarchical architecture of FACTS relies on both the higher-level task (vocal tract constrictions) as well as lower-level articulatory state representations. Importantly, FACTS also computes sensory prediction errors as a part of its state feedback control mechanism, a well-established framework in the field of motor control. We explored potential adaptation mechanisms and found that adaptive behavior was present only when prediction errors updated the articulatory-to-task state transformation. In contrast, designs in which prediction errors updated forward sensory prediction models alone did not generate adaptation. Thus, FACTS demonstrated that 1) prediction errors can drive adaptation through task-level updates, and 2) adaptation is likely driven by updates to task-level control rather than (only) to forward predictive models. Additionally, simulating adaptation with FACTS generated a number of important hypotheses regarding previously reported phenomena such as identifying the source(s) of incomplete adaptation and driving factor(s) for changes in the second formant frequency during adaptation to the first formant perturbation. The proposed model design paves the way for a hierarchical state feedback control framework to be examined in the context of sensorimotor adaptation in both speech and non-speech effector systems.

Project description:The development of multicellular organisms involves cells to decide their fate upon the action of biochemical signals. This decision is often spatiotemporally coordinated such that a spatial pattern arises. The dynamics that drive pattern formation usually involve genetic nonlinear interactions and positive feedback loops. These complex dynamics may enable multiple stable patterns for the same conditions. Under these circumstances, pattern formation in a developing tissue involves a selection process: why is a certain pattern formed and not another stable one? Herein we computationally address this issue in the context of the Notch signaling pathway. We characterize a dynamical mechanism for developmental selection of a specific pattern through spatiotemporal changes of the control parameters of the dynamics, in contrast to commonly studied situations in which initial conditions and noise determine which pattern is selected among multiple stable ones. This mechanism can be understood as a path along the parameter space driven by a sequence of biochemical signals. We characterize the selection process for three different scenarios of this dynamical mechanism that can take place during development: the signal either 1) acts in all the cells at the same time, 2) acts only within a cluster of cells, or 3) propagates along the tissue. We found that key elements for pattern selection are the destabilization of the initial pattern, the subsequent exploration of other patterns determined by the spatiotemporal symmetry of the parameter changes, and the speeds of the path compared to the timescales of the pattern formation process itself. Each scenario enables the selection of different types of patterns and creates these elements in distinct ways, resulting in different features. Our approach extends the concept of selection involved in cellular decision-making, usually applied to cell-autonomous decisions, to systems that collectively make decisions through cell-to-cell interactions.

Dataset Information

A dynamical model of hierarchical selection and coordination in speech planning.

Publications

A dynamical model of hierarchical selection and coordination in speech planning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets