Learning optimal adaptation strategies in unpredictable motor tasks.
Ontology highlight
ABSTRACT:
SUBMITTER: Braun DA
PROVIDER: S-EPMC2692080 | biostudies-literature | 2009 May
REPOSITORIES: biostudies-literature
Publications
Learning optimal adaptation strategies in unpredictable motor tasks.
Braun Daniel A DA Aertsen Ad A Wolpert Daniel M DM Mehring Carsten C
The Journal of neuroscience : the official journal of the Society for Neuroscience 20090501 20
Picking up an empty milk carton that we believe to be full is a familiar example of adaptive control, because the adaptation process of estimating the carton's weight must proceed simultaneously with the control process of moving the carton to a desired location. Here we show that the motor system initially generates highly variable behavior in such unpredictable tasks but eventually converges to stereotyped patterns of adaptive responses predicted by a simple optimality principle. These results ...[more]
Similar Datasets
Project description:Although scheduling multiple tasks in motor learning to maximize long-term retention of performance is of great practical importance in sports training and motor rehabilitation after brain injury, it is unclear how to do so. We propose here a novel theoretical approach that uses optimal control theory and computational models of motor adaptation to determine schedules that maximize long-term retention predictively. Using Pontryagin's maximum principle, we derived a control law that determines the trial-by-trial task choice that maximizes overall delayed retention for all tasks, as predicted by the state-space model. Simulations of a single session of adaptation with two tasks show that when task interference is high, there exists a threshold in relative task difficulty below which the alternating schedule is optimal. Only for large differences in task difficulties do optimal schedules assign more trials to the harder task. However, over the parameter range tested, alternating schedules yield long-term retention performance that is only slightly inferior to performance given by the true optimal schedules. Our results thus predict that in a large number of learning situations wherein tasks interfere, intermixing tasks with an equal number of trials is an effective strategy in enhancing long-term retention.
| S-EPMC6555556 | biostudies-literature
Project description:Despite recent advances in robot-assisted training, the benefits of haptic guidance on motor (re)learning are still limited. While haptic guidance may increase task performance during training, it may also decrease participants' effort and interfere with the perception of the environment dynamics, hindering somatosensory information crucial for motor learning. Importantly, haptic guidance limits motor variability, a factor considered essential for learning. We propose that Model Predictive Controllers (MPC) might be good alternatives to haptic guidance since they minimize the assisting forces and promote motor variability during training. We conducted a study with 40 healthy participants to investigate the effectiveness of MPCs on learning a dynamic task. The task consisted of swinging a virtual pendulum to hit incoming targets with the pendulum ball. The environment was haptically rendered using a Delta robot. We designed two MPCs: the first MPC-end-effector MPC-applied the optimal assisting forces on the end-effector. A second MPC-ball MPC-applied its forces on the virtual pendulum ball to further reduce the assisting forces. The participants' performance during training and learning at short- and long-term retention tests were compared to a control group who trained without assistance, and a group that trained with conventional haptic guidance. We hypothesized that the end-effector MPC would promote motor variability and minimize the assisting forces during training, and thus, promote learning. Moreover, we hypothesized that the ball MPC would enhance the performance and motivation during training but limit the motor variability and sense of agency (i.e., the feeling of having control over their movements), and therefore, limit learning. We found that the MPCs reduce the assisting forces compared to haptic guidance. Training with the end-effector MPC increases the movement variability and does not hinder the pendulum swing variability during training, ultimately enhancing the learning of the task dynamics compared to the other groups. Finally, we observed that increases in the sense of agency seemed to be associated with learning when training with the end-effector MPC. In conclusion, training with MPCs enhances motor learning of tasks with complex dynamics and are promising strategies to improve robotic training outcomes in neurological patients.
| S-EPMC7884323 | biostudies-literature
Project description:The hypothesis of modular control, which stands on the existence of muscle synergies as building blocks of muscle coordination, has been investigated in a great variety of motor tasks and species. Yet, its role during learning processes is still largely unexplored. To what extent is such modular control flexible, in terms of spatial structure and temporal activation, to externally or internally induced adaptations, is a debated issue. To address this question, we designed a biofeedback experiment to induce changes in the timing of muscle activations during leg cycling movements. The protocol consisted in delaying the peak of activation of one target muscle and using its electromyography (EMG) envelope as visual biofeedback. For each of the 10 healthy participants, the protocol was repeated for three different target muscles: Tibialis Anterioris (TA), Gastrocnemius Medialis (GM), and Vastus Lateralis (VL). To explore the effects of the conditioning protocol, we analyzed changes in the activity of eight lower limb muscles by applying different models of modular motor control [i.e., fixed spatial components (FSC) and fixed temporal components (FTC)]. Our results confirm the hypothesis that visual EMG biofeedback is able to induce changes in muscle coordination. Subjects were able to shift the peak of activation of the target muscle, with a delay of (49 ± 27°) across subjects and conditions. This time shift generated a reorganization of all the other muscles in terms of timing and amplitude. By using different models of modular motor control, we demonstrated that neither spatially invariant nor temporally invariant muscle synergies alone were able to account for these changes in muscle coordination after learning, while temporally invariant muscle synergies with adjustments in timing could capture most of muscle activity adaptations observed after the conditioning protocol. These results suggest that short-term learning in rhythmic tasks is built upon synergistic temporal commands that are robust to changes in the task demands.
| S-EPMC7373728 | biostudies-literature
Project description:BACKGROUND:This study examined the motor unit (MU) control strategies for non-fatiguing isometric elbow flexion tasks at 40% and 70% maximal voluntary isometric contraction. METHODS:Nineteen healthy individuals performed two submaximal tasks with similar torque levels: contracting against an immovable object (force task), and maintaining the elbow joint angle against an external load (position task). Surface electromyographic (EMG) signals were collected from the agonist and antagonist muscles. The signals from the agonist were decomposed into individual action potential trains. The linear regression analysis was used to examine the MU recruitment threshold (RT) versus mean firing rates (MFR), and RT versus derecruitment threshold (DT) relationships. RESULTS:Both agonist and antagonist muscles' EMG amplitudes did not differ between two tasks. The linear slopes of the MU RT versus MFR and RT versus DT relationships during the position task were more negative (p = 0.010) and more positive (p = 0.023), respectively, when compared to the force task. CONCLUSIONS:To produce a similar force output, the position task may rely less on the recruitment of relatively high-threshold MUs. Additionally, as the force output decreases, MUs tend to derecruit at a higher force level during the position task.
| S-EPMC7215511 | biostudies-literature
Project description:Procedural learning and memory has been conceptualised as consisting of cognitive and autonomous phases. Although the Serial Reaction Time Task (SRTT) is a popular task used to study procedural memory (PM), it has not been used to explore the different phases of PM. The present study employed a modified SRTT and investigated whether it can distinguish phases of PM. Our results revealed that performance at the beginning of typing a repeating sequence was marked by a steep learning curve, followed by gradual improvements and ending in high performance levels without further improvement. Steep performance increases characterise the effortful learning of the cognitive phase, gradual increases at higher performances characterise emerging automatisation of the associative phase, and sustained highest performance characterises autonomous procedures when PM has formed. Our study presents an easy-to-use measure, capable of distinguishing phases of PM, and which can be useful to assess PM during brain development.
| S-EPMC8048153 | biostudies-literature
Project description:The present work is the first study that assess long run change after motor learning. The study's main objective was to evaluate the short to medium-term impact of motor imagery (MI) and action observation (AO) on motor learning of a sequence of thumb-opposition tasks of increasing complexity. We randomly assigned 45 participants to an AO, MI, or placebo observation (PO) group. A sequence of 12 thumb-opposition tasks was taught for 3 consecutive days (4 per day). The primary outcome was accuracy. The secondary outcomes were required time and perfect positioning. The outcomes were assessed immediately after the intervention and at 1 week, 1 month and 4 months postintervention. Regarding the primary outcome, AO group had significantly higher accuracy than the MI or PO group until at least 4 months (p < 0.01, d > 0.80). However, in the bimanual positions, AO was not superior to MI at 1 week postintervention. Regarding secondary outcomes, AO group required less time than the MI group to remember and perform the left-hand and both-hand gestures, with a large effect size (p < 0.01, d > 0.80). In terms of percentage of perfect positions, AO group achieved significantly better results than the MI group until at least 4 months after the intervention in the unimanual gestures (p < 0.01, d > 0.80) and up to 1 month postintervention in the bimanual gestures (p = 0.012, d = 1.29). AO training resulted in greater and longer term motor learning than MI and placebo intervention. If the goal is to learn some motor skills for whatever reason (e.g., following surgery or immobilization.), AO training should be considered clinically.
| S-EPMC7378061 | biostudies-literature
Project description:In motor tasks, errors between planned and actual movements generally result in adaptive changes which reduce the occurrence of similar errors in the future. It has commonly been assumed that the motor adaptation arising from an error occurring on a particular movement is specifically associated with the motion that was planned. Here we show that this is not the case. Instead, we demonstrate the binding of the adaptation arising from an error on a particular trial to the motion experienced on that same trial. The formation of this association means that future movements planned to resemble the motion experienced on a given trial benefit maximally from the adaptation arising from it. This reflects the idea that actual rather than planned motions are assigned 'credit' for motor errors because, in a computational sense, the maximal adaptive response would be associated with the condition credited with the error. We studied this process by examining the patterns of generalization associated with motor adaptation to novel dynamic environments during reaching arm movements in humans. We found that these patterns consistently matched those predicted by adaptation associated with the actual rather than the planned motion, with maximal generalization observed where actual motions were clustered. We followed up these findings by showing that a novel training procedure designed to leverage this newfound understanding of the binding of learning to action, can improve adaptation rates by greater than 50%. Our results provide a mechanistic framework for understanding the effects of partial assistance and error augmentation during neurologic rehabilitation, and they suggest ways to optimize their use.
| S-EPMC3121685 | biostudies-literature
Project description:This study aimed to investigate, through functional MRI (fMRI), the neuronal substrates associated with the consolidation process of two motor skills: motor sequence learning (MSL) and motor adaptation (MA). Four groups of young healthy individuals were assigned to either (i) a night/sleep condition, in which they were scanned while practicing a finger sequence learning task or an eight-target adaptation pointing task in the evening (test) and were scanned again 12 h later in the morning (retest) or (ii) a day/awake condition, in which they were scanned on the MSL or the MA tasks in the morning and were rescanned 12 h later in the evening. As expected and consistent with the behavioral results, the functional data revealed increased test-retest changes of activity in the striatum for the night/sleep group compared with the day/awake group in the MSL task. By contrast, the results of the MA task did not show any difference in test-retest activity between the night/sleep and day/awake groups. When the two MA task groups were combined, however, increased test-retest activity was found in lobule VI of the cerebellar cortex. Together, these findings highlight the presence of both functional and structural dissociations reflecting the off-line consolidation processes of MSL and MA. They suggest that MSL consolidation is sleep dependent and reflected by a differential increase of neural activity within the corticostriatal system, whereas MA consolidation necessitates either a period of daytime or sleep and is associated with increased neuronal activity within the corticocerebellar system.
| S-EPMC2955095 | biostudies-literature
Project description:Human beings adapt the spontaneous pace of their actions to interact with the environment. Yet, the nature of the mechanism enabling such adaptive behavior remains poorly understood. The aim of the present contribution was to examine the role of attention in motor timing using (a) time series analysis, and (b) a dual task paradigm. In a series of two studies, a finger-tapping task was used in sensorimotor synchronization with various tempi (from 300 to 1,100 ms) and motor complexity (one target vs. six targets). Time series analyzes indicated that two different timing strategies were used depending on the speed constraints. At slow tempi, tapping sequences were characterized by strong negative autocorrelations, suggesting the implication of cognitive predictive timing. When moving at fast and close-to-spontaneous tempi, tapping sequences were characterized by less negative autocorrelations, suggesting that timing properties emerged from body movement dynamics. The analysis of the dual-task reaction times confirmed that both the temporal and spatial constraints impacted the attentional resources allocated to the finger-tapping tasks. Overall, our work suggests that moving fast and slow involve distinct timing strategies that are characterized by contrasting attentional demands.
| S-EPMC7868383 | biostudies-literature
Project description:Forward and backward walking are remarkably similar motor behaviors to the extent that backward walking has been described as a time-reversed version of forward walking. However, because they display different muscle activity patterns, it has been questioned if forward and backward walking share common control strategies. To investigate this point, we used a split-belt treadmill experimental paradigm designed to elicit healthy individuals' motor adaptation by changing the speed of one of the treadmill belts, while keeping the speed of the other belt constant. We applied this experimental paradigm to both forward and backward walking. We analyzed several adaptation parameters including step symmetry, stability, and energy expenditure as well as the characteristics of the synergies of lower-limb muscles. We found that forward and backward walking share the same muscle synergy modules. We showed that these modules are marked by similar patterns of adaptation driven by stability and energy consumption minimization criteria, both relying on modulating the temporal activation of the muscle synergies. Our results provide evidence that forward and backward walking are governed by the same control and adaptation mechanisms.
| S-EPMC8405989 | biostudies-literature