Dataset Information

The FACTS model of speech motor control: Fusing state estimation and task-based control.

ABSTRACT: We present a new computational model of speech motor control: the Feedback-Aware Control of Tasks in Speech or FACTS model. FACTS employs a hierarchical state feedback control architecture to control simulated vocal tract and produce intelligible speech. The model includes higher-level control of speech tasks and lower-level control of speech articulators. The task controller is modeled as a dynamical system governing the creation of desired constrictions in the vocal tract, after Task Dynamics. Both the task and articulatory controllers rely on an internal estimate of the current state of the vocal tract to generate motor commands. This estimate is derived, based on efference copy of applied controls, from a forward model that predicts both the next vocal tract state as well as expected auditory and somatosensory feedback. A comparison between predicted feedback and actual feedback is then used to update the internal state prediction. FACTS is able to qualitatively replicate many characteristics of the human speech system: the model is robust to noise in both the sensory and motor pathways, is relatively unaffected by a loss of auditory feedback but is more significantly impacted by the loss of somatosensory feedback, and responds appropriately to externally-imposed alterations of auditory and somatosensory feedback. The model also replicates previously hypothesized trade-offs between reliance on auditory and somatosensory feedback and shows for the first time how this relationship may be mediated by acuity in each sensory domain. These results have important implications for our understanding of the speech motor control system in humans.

SUBMITTER: Parrell B

PROVIDER: S-EPMC6743785 | biostudies-literature | 2019 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The FACTS model of speech motor control: Fusing state estimation and task-based control.

Parrell Benjamin B Ramanarayanan Vikram V Nagarajan Srikantan S Houde John J

PLoS computational biology 20190903 9

We present a new computational model of speech motor control: the Feedback-Aware Control of Tasks in Speech or FACTS model. FACTS employs a hierarchical state feedback control architecture to control simulated vocal tract and produce intelligible speech. The model includes higher-level control of speech tasks and lower-level control of speech articulators. The task controller is modeled as a dynamical system governing the creation of desired constrictions in the vocal tract, after Task Dynamics. ...[more]

PMID: 31479444

Similar Datasets

Project description:Upon perceiving sensory errors during movements, the human sensorimotor system updates future movements to compensate for the errors, a phenomenon called sensorimotor adaptation. One component of this adaptation is thought to be driven by sensory prediction errors-discrepancies between predicted and actual sensory feedback. However, the mechanisms by which prediction errors drive adaptation remain unclear. Here, auditory prediction error-based mechanisms involved in speech auditory-motor adaptation were examined via the feedback aware control of tasks in speech (FACTS) model. Consistent with theoretical perspectives in both non-speech and speech motor control, the hierarchical architecture of FACTS relies on both the higher-level task (vocal tract constrictions) as well as lower-level articulatory state representations. Importantly, FACTS also computes sensory prediction errors as a part of its state feedback control mechanism, a well-established framework in the field of motor control. We explored potential adaptation mechanisms and found that adaptive behavior was present only when prediction errors updated the articulatory-to-task state transformation. In contrast, designs in which prediction errors updated forward sensory prediction models alone did not generate adaptation. Thus, FACTS demonstrated that 1) prediction errors can drive adaptation through task-level updates, and 2) adaptation is likely driven by updates to task-level control rather than (only) to forward predictive models. Additionally, simulating adaptation with FACTS generated a number of important hypotheses regarding previously reported phenomena such as identifying the source(s) of incomplete adaptation and driving factor(s) for changes in the second formant frequency during adaptation to the first formant perturbation. The proposed model design paves the way for a hierarchical state feedback control framework to be examined in the context of sensorimotor adaptation in both speech and non-speech effector systems.

Project description:BackgroundIn the past years, robotic systems have become increasingly popular in upper limb rehabilitation. Nevertheless, clinical studies have so far not been able to confirm superior efficacy of robotic therapy over conventional methods. The personalization of robot-aided therapy according to the patients' individual motor deficits has been suggested as a pivotal step to improve the clinical outcome of such approaches.MethodsHere, we present a model-based approach to personalize robot-aided rehabilitation therapy within training sessions. The proposed method combines the information from different motor performance measures recorded from the robot to continuously estimate patients' motor improvement for a series of point-to-point reaching movements in different directions. Additionally, it comprises a personalization routine to automatically adapt the rehabilitation training. We engineered our approach using an upper-limb exoskeleton. The implementation was tested with 17 healthy subjects, who underwent a motor-adaptation paradigm, and two subacute stroke patients, exhibiting different degrees of motor impairment, who participated in a pilot test undergoing rehabilitative motor training.ResultsThe results of the exploratory study with healthy subjects showed that the participants divided into fast and slow adapters. The model was able to correctly estimate distinct motor improvement progressions between the two groups of participants while proposing individual training protocols. For the two pilot patients, an analysis of the selected motor performance measures showed that both patients were able to retain the improvements gained during training when reaching movements were reintroduced at a later stage. These results suggest that the automated training adaptation was appropriately timed and specifically tailored to the abilities of each individual.ConclusionsThe results of our exploratory study demonstrated the feasibility of the proposed model-based approach for the personalization of robot-aided rehabilitation therapy. The pilot test with two subacute stroke patients further supported our approach, while providing encouraging results for the applicability in clinical settings. Trial registration This study is registered in ClinicalTrials.gov (NCT02770300, registered 30 March 2016, https://clinicaltrials.gov/ct2/show/NCT02770300).

Project description:BackgroundAccess to neurological care for Parkinson disease (PD) is a rare privilege for millions of people worldwide, especially in resource-limited countries. In 2013, there were just 1200 neurologists in India for a population of 1.3 billion people; in Africa, the average population per neurologist exceeds 3.3 million people. In contrast, 60,000 people receive a diagnosis of PD every year in the United States alone, and similar patterns of rising PD cases-fueled mostly by environmental pollution and an aging population-can be seen worldwide. The current projection of more than 12 million patients with PD worldwide by 2040 is only part of the picture given that more than 20% of patients with PD remain undiagnosed. Timely diagnosis and frequent assessment are key to ensure timely and appropriate medical intervention, thus improving the quality of life of patients with PD.ObjectiveIn this paper, we propose a web-based framework that can help anyone anywhere around the world record a short speech task and analyze the recorded data to screen for PD.MethodsWe collected data from 726 unique participants (PD: 262/726, 36.1% were women; non-PD: 464/726, 63.9% were women; average age 61 years) from all over the United States and beyond. A small portion of the data (approximately 54/726, 7.4%) was collected in a laboratory setting to compare the performance of the models trained with noisy home environment data against high-quality laboratory-environment data. The participants were instructed to utter a popular pangram containing all the letters in the English alphabet, "the quick brown fox jumps over the lazy dog." We extracted both standard acoustic features (mel-frequency cepstral coefficients and jitter and shimmer variants) and deep learning-based embedding features from the speech data. Using these features, we trained several machine learning algorithms. We also applied model interpretation techniques such as Shapley additive explanations to ascertain the importance of each feature in determining the model's output.ResultsWe achieved an area under the curve of 0.753 for determining the presence of self-reported PD by modeling the standard acoustic features through the XGBoost-a gradient-boosted decision tree model. Further analysis revealed that the widely used mel-frequency cepstral coefficient features and a subset of previously validated dysphonia features designed for detecting PD from a verbal phonation task (pronouncing "ahh") influence the model's decision the most.ConclusionsOur model performed equally well on data collected in a controlled laboratory environment and in the wild across different gender and age groups. Using this tool, we can collect data from almost anyone anywhere with an audio-enabled device and help the participants screen for PD remotely, contributing to equity and access in neurological care.

Dataset Information

The FACTS model of speech motor control: Fusing state estimation and task-based control.

Publications

The FACTS model of speech motor control: Fusing state estimation and task-based control.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets