Optimal task-dependent changes of bimanual feedback control and adaptation.
Ontology highlight
ABSTRACT:
SUBMITTER: Diedrichsen J
PROVIDER: S-EPMC2230536 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Control of our movements is apparently facilitated by an adaptive internal model in the cerebellum. It was long thought that this internal model implemented an adaptive inverse model and generated motor commands, but recently many reject that idea in favor of a forward model hypothesis. In theory, the forward model predicts upcoming state during reaching movements so the motor cortex can generate appropriate motor commands. Recent computational models of this process rely on the optimal feedback control (OFC) framework of control theory. OFC is a powerful tool for describing motor control, it does not describe adaptation. Some assume that adaptation of the forward model alone could explain motor adaptation, but this is widely understood to be overly simplistic. However, an adaptive optimal controller is difficult to implement. A reasonable alternative is to allow forward model adaptation to 're-tune' the controller. Our simulations show that, as expected, forward model adaptation alone does not produce optimal trajectories during reaching movements perturbed by force fields. However, they also show that re-optimizing the controller from the forward model can be sub-optimal. This is because, in a system with state correlations or redundancies, accurate prediction requires different information than optimal control. We find that adding noise to the movements that matches noise found in human data is enough to overcome this problem. However, since the state space for control of real movements is far more complex than in our simple simulations, the effects of correlations on re-adaptation of the controller from the forward model cannot be overlooked.
| S-EPMC3304072 | biostudies-literature
Project description:Concurrent feedback provided during acquisition can enhance performance of novel tasks. The 'guidance hypothesis' predicts that feedback provision leads to dependence and poor performance in its absence. However, appropriately structured feedback information provided through sound ('sonification') may not be subject to this effect. We test this directly using a rhythmic bimanual shape-tracing task in which participants learned to move at a 4:3 timing ratio. Sonification of movement and demonstration was compared to two other learning conditions: (1) Sonification of task demonstration alone and (2) completely silent practice (control). Sonification of movement emerged as the most effective form of practice, reaching significantly lower error scores than control. Sonification of solely the demonstration, which was expected to benefit participants by perceptually unifying task requirements, did not lead to better performance than control. Good performance was maintained by participants in the Sonification condition in an immediate retention test without feedback, indicating that the use of this feedback can overcome the guidance effect. On a 24-h retention test, performance had declined and was equal between groups. We argue that this and similar findings in the feedback literature are best explained by an ecological approach to motor skill learning which places available perceptual information at the highest level of importance.
| S-EPMC5486555 | biostudies-literature
Project description:The cerebellar granule cell layer has inspired numerous theoretical models of neural representations that support learned behaviors, beginning with the work of Marr and Albus. In these models, granule cells form a sparse, combinatorial encoding of diverse sensorimotor inputs. Such sparse representations are optimal for learning to discriminate random stimuli. However, recent observations of dense, low-dimensional activity across granule cells have called into question the role of sparse coding in these neurons. Here, we generalize theories of cerebellar learning to determine the optimal granule cell representation for tasks beyond random stimulus discrimination, including continuous input-output transformations as required for smooth motor control. We show that for such tasks, the optimal granule cell representation is substantially denser than predicted by classical theories. Our results provide a general theory of learning in cerebellum-like systems and suggest that optimal cerebellar representations are task-dependent.
| S-EPMC10541175 | biostudies-literature
Project description:Recent experiments with brain-machine-interfaces (BMIs) indicate that the extent of neural modulations increased abruptly upon starting to operate the interface, and especially after the monkey stopped moving its hand. In contrast, neural modulations that are correlated with the kinematics of the movement remained relatively unchanged. Here we demonstrate that similar changes are produced by simulated neurons that encode the relevant signals generated by an optimal feedback controller during simulated BMI experiments. The optimal feedback controller relies on state estimation that integrates both visual and proprioceptive feedback with prior estimations from an internal model. The processing required for optimal state estimation and control were conducted in the state-space, and neural recording was simulated by modeling two populations of neurons that encode either only the estimated state or also the control signal. Spike counts were generated as realizations of doubly stochastic Poisson processes with linear tuning curves. The model successfully reconstructs the main features of the kinematics and neural activity during regular reaching movements. Most importantly, the activity of the simulated neurons successfully reproduces the observed changes in neural modulations upon switching to brain control. Further theoretical analysis and simulations indicate that increasing the process noise during normal reaching movement results in similar changes in neural modulations. Thus, we conclude that the observed changes in neural modulations during BMI experiments can be attributed to increasing process noise associated with the imperfect BMI filter, and, more directly, to the resulting increase in the variance of the encoded signals associated with state estimation and the required control signal.
| S-EPMC4436824 | biostudies-other
Project description:The visual system optimizes its functioning for a given environment through processes collectively called adaptation. It is currently unknown, however, whether adaptation is affected by the particular task the observer performs within that environment. Two experiments tested whether this is the case. Observers adapted to high contrast grating patterns, and the decay of adaptation was measured using a version of the tilt-aftereffect, while they performed two different secondary tasks. One task involved judging the luminance of a small circular spot at fixation, and was expected to be unaffected by adaptation. The other secondary task involved judging a low contrast grating, and adaptation was expected to make this task difficult by reducing the visibility of the grating. Identical displays containing both a fixation spot and a grating were used for both tasks. Tilt-aftereffects were smaller when subjects concurrently performed the grating task than when they performed the fixation task. These results suggest that the control of adaptation, in this case its decay, is sensitive to the nature of the task the observer is performing. Adaptation may attempt to optimize vision with respect to many different criteria simultaneously; task is likely one of the criteria included in this process.
| S-EPMC7046198 | biostudies-literature
Project description:Movement planning is thought to be primarily determined by motor costs such as inaccuracy and effort. Solving for the optimal plan that minimizes these costs typically leads to specifying a time-varying feedback controller which both generates the movement and can optimally correct for errors that arise within a movement. However, the quality of the sensory feedback during a movement can depend substantially on the generated movement. We show that by incorporating such state-dependent sensory feedback, the optimal solution incorporates active sensing and is no longer a pure feedback process but includes a significant feedforward component. To examine whether people take into account such state-dependency in sensory feedback we asked people to make movements in which we controlled the reliability of sensory feedback. We made the visibility of the hand state-dependent, such that the visibility was proportional to the component of hand velocity in a particular direction. Subjects gradually adapted to such a sensory perturbation by making curved hand movements. In particular, they appeared to control the late visibility of the movement matching predictions of the optimal controller with state-dependent sensory noise. Our results show that trajectory planning is not only sensitive to motor costs but takes sensory costs into account and argues for optimal control of movement in which feedforward commands can play a significant role.
| S-EPMC5156370 | biostudies-literature
Project description:The brain uses information from different sensory systems to guide motor behavior, and aging is associated with simultaneous decline in the quality of sensory information provided to the brain and deterioration in motor control. Correlations between age-dependent decline in sensory anatomical structures and behavior have been demonstrated in many sensorimotor systems, and it has recently been suggested that a Bayesian framework could explain these relationships. Here we show that age-dependent changes in a human sensorimotor reflex, the vestibuloocular reflex, are explained by a Bayesian optimal adaptation in the brain occurring in response to death of motion-sensing hair cells. Specifically, we found that the temporal dynamics of the reflex as a function of age emerge from ( r = 0.93, P < 0.001) a Kalman filter model that determines the optimal behavioral output when the sensory signal-to-noise characteristics are degraded by death of the transducers. These findings demonstrate that the aging brain is capable of generating the ideal and statistically optimal behavioral response when provided with deteriorating sensory information. While the Bayesian framework has been shown to be a general neural principle for multimodal sensory integration and dynamic sensory estimation, these findings provide evidence of longitudinal Bayesian processing over the human life span. These results illuminate how the aging brain strives to optimize motor behavior when faced with deterioration in the peripheral and central nervous systems and have implications in the field of vestibular and balance disorders, as they will likely provide guidance for physical therapy and for prosthetic aids that aim to reduce falls in the elderly. NEW & NOTEWORTHY We showed that age-dependent changes in the vestibuloocular reflex are explained by a Bayesian optimal adaptation in the brain that occurs in response to age-dependent sensory anatomical changes. This demonstrates that the brain can longitudinally respond to age-related sensory loss in an ideal and statistically optimal way. This has implications for understanding and treating vestibular disorders caused by aging and provides insight into the structure-function relationship during aging.
| S-EPMC5867390 | biostudies-literature
Project description:Visuomotor feedback responses vary in intensity throughout a reach, commonly explained by optimal control. Here, we show that the optimal control for a range of movements with the same goal can be simplified to a time-to-target dependent control scheme. We measure our human participants' visuomotor responses in five reaching conditions, each with different hand or cursor kinematics. Participants only produced different feedback responses when these kinematic changes resulted in different times-to-target. We complement our experimental data with a range of finite and non-finite horizon optimal feedback control (OFC) models, finding that the model with time-to-target as one of the input parameters best replicates the experimental data. Overall, this suggests that time-to-target is a critical control parameter in online feedback control. Moreover, we propose that for a specific task and known dynamics, humans can instantly produce a control signal without any additional online computation allowing rapid response onset and close to optimal control.
| S-EPMC7189480 | biostudies-literature
Project description:Background and purposeHuman motor planning and control depend highly on optimal feedback control systems, such as the neocortex-cerebellum circuit. Here, diffusion tensor imaging was used to verify the disruption of the neocortex-cerebellum circuit in spinocerebellar ataxia type 3 (SCA3), and the circuit's disruption correlation with SCA3 motor dysfunction was investigated.MethodsThis study included 45 patients with familial SCA3, aged 17-67 years, and 49 age- and sex-matched healthy controls, aged 21-64 years. Tract-based spatial statistics and probabilistic tractography was conducted using magnetic resonance images of the patients and controls. The correlation between the local probability of probabilistic tractography traced from the cerebellum and clinical symptoms measured using specified symptom scales was also calculated.ResultsThe cerebellum-originated probabilistic tractography analysis showed that structural connectivity, mainly in the subcortical cerebellar-thalamo-cortical tract, was significantly reduced and the cortico-ponto-cerebellar tract was significantly stronger in the SCA3 group than in the control group. The enhanced tract was extended to the right lateral parietal region and the right primary motor cortex. The enhanced neocortex-cerebellum connections were highly associated with disease progression, including duration and symptomatic deterioration. Tractography probabilities from the cerebellar to parietal and sensorimotor areas were significantly negatively correlated with motor abilities in patients with SCA3.ConclusionTo our knowledge, this study is the first to reveal that disrupting the neocortex-cerebellum loop can cause SCA3-induced motor dysfunctions. The specific interaction between the cerebellar-thalamo-cortical and cortico-ponto-cerebellar pathways in patients with SCA3 and its relationship with ataxia symptoms provides a new direction for future research.
| S-EPMC11295168 | biostudies-literature
Project description:Integral feedback control is a basic engineering strategy for ensuring that the output of a system robustly tracks its desired value independent of noise or variations in system parameters. In biological systems, it is common for the response to an extracellular stimulus to return to its prestimulus value even in the continued presence of the signal-a process termed adaptation or desensitization. Barkai, Alon, Surette, and Leibler have provided both theoretical and experimental evidence that the precision of adaptation in bacterial chemotaxis is robust to dramatic changes in the levels and kinetic rate constants of the constituent proteins in this signaling network [Alon, U., Surette, M. G., Barkai, N. & Leibler, S. (1998) Nature (London) 397, 168-171]. Here we propose that the robustness of perfect adaptation is the result of this system possessing the property of integral feedback control. Using techniques from control and dynamical systems theory, we demonstrate that integral control is structurally inherent in the Barkai-Leibler model and identify and characterize the key assumptions of the model. Most importantly, we argue that integral control in some form is necessary for a robust implementation of perfect adaptation. More generally, integral control may underlie the robustness of many homeostatic mechanisms.
| S-EPMC18287 | biostudies-literature