Causal Role of Motor Preparation during Error-Driven Learning.
Ontology highlight
ABSTRACT:
SUBMITTER: Vyas S
PROVIDER: S-EPMC7185427 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Sensorimotor learning adapts motor output to maintain movement accuracy. For saccadic eye movements, learning also alters space perception, suggesting a dissociation between the performed saccade and its internal representation derived from corollary discharge (CD). This is critical since learning is commonly believed to be driven by CD-based visual prediction error. We estimate the internal saccade representation through pre- and trans-saccadic target localization, showing that it decouples from the actual saccade during learning. We present a model that explains motor and perceptual changes by collective plasticity of spatial target percept, motor command, and a forward dynamics model that transforms CD from motor into visuospatial coordinates. We show that learning does not follow visual prediction error but instead a postdictive update of space after saccade landing. We conclude that trans-saccadic space perception guides motor learning via CD-based postdiction of motor error under the assumption of a stable world.
| S-EPMC8057815 | biostudies-literature
Project description:The classic Aesop's fable, Crow and the Pitcher, has inspired a major line of research in comparative cognition. Over the past several years, five articles (over 32 experiments) have examined the ability of corvids (e.g., rooks, crows, and jays) to complete lab-based analogs of this fable, by requiring them to drop stones and other objects into tubes of water to retrieve a floating worm (Bird and Emery in Curr Biol 19:1-5, 2009b; Cheke et al. in Anim Cogn 14:441-455, 2011; Jelbert et al. in PLoS One 3:e92895, 2014; Logan et al. in PLoS One 7:e103049, 2014; Taylor et al. in Gray R D 12:e26887, 2011). These researchers have stressed the unique potential of this paradigm for understanding causal reasoning in corvids. Ghirlanda and Lind (Anim Behav 123:239-247, 2017) re-evaluated trial-level data from these studies and concluded that initial preferences for functional objects, combined with trial-and-error learning, may account for subjects' performance on key variants of the paradigm. In the present paper, we use meta-analytic techniques to provide more precise information about the rate and mode of learning that occurs within and across tasks. Within tasks, subjects learned from successful (but not unsuccessful) actions, indicating that higher-order reasoning about phenomena such as mass, volume, and displacement is unlikely to be involved. Furthermore, subjects did not transfer information learned in one task to subsequent tasks, suggesting that corvids do not engage with these tasks as variants of the same problem (i.e., how to generate water displacement to retrieve a floating worm). Our methodological analysis and empirical findings raise the question: Can Aesop's fable studies distinguish between trial-and-error learning and/or higher-order causal reasoning? We conclude they cannot.
| S-EPMC6181768 | biostudies-literature
Project description:To adapt to variable environments, humans regulate their behavior by modulating gains in sensory-to-motor processing. In this study, we measured a simple eye movement, the ocular following response (OFR), in monkeys to study the neuronal basis of adaptive motor learning in the visuomotor processing stream. The medial superior temporal (MST) area of the cerebral cortex is a critical site for contextual gain modulation of the OFR. However, the role of MST neurons in adaptive gain modulation of the OFR remains unknown. We adopted a velocity step-down sequence paradigm that was designed to promote adaptive gain modulation of the OFR to investigate the role of the dorsal MST (MSTd) in adaptive motor learning. In the initial learning stage, we observed a reduction in the OFR but no significant change in the "open-loop" responses for the majority of the MSTd neurons. However, in the late learning stage, some MSTd neurons exhibited significantly enhanced "closed-loop" responses in association with increases in retinal error velocity. These results indicate that the MSTd area primarily encodes visual motion, suggesting that MSTd neurons function upstream of the motor learning site to provide sensory signals to the downstream structures involved in adaptive motor learning.
| S-EPMC5244411 | biostudies-other
Project description:We investigated whether physical requirements and motor variability decreased over days in novices during a repetitive screwing task. Fifty-seven subjects performed one hour of repetitive screwing and fastening on three days, separated by 2⁻7 days. The average physical requirement and relative cycle-to-cycle variability (coefficient of variation, i.e., CV) were calculated from continuous recordings of electromyography of four arm muscles (biceps brachii, triceps brachii, flexor carpi radialis, extensor digitorum), forearm acceleration, and electrocardiography. Muscle activity levels, heart rate, and forearm acceleration decreased from day 1 to day 2 (range: ~4% to ~20%) and/or 3 (range: ~4% to ~28%). Not all muscles showed a similar pattern. Activity of the extensor digitorum and biceps brachii decreased already between days 1 and 2 (range: ~6% to ~13%), whereas activity of the flexor carpi radialis and triceps brachii decreased between days 1 and 3 (range: ~13% to ~20%). No changes in physical requirement were detected between days 2 and 3. Relative motor variability did not change across days, except that variability of forearm acceleration increased from day 1 to 3 (~5%). This study found consistent changes in physical requirements and indicated that several arm muscles show earlier decreases of muscular activity, like the extensor digitorum, compared to other body parts, like the flexor carpi radialis. Moreover, movement strategies may develop differently than muscle activation strategies, based on the different developments of physical requirements and motor variability. The development of physical requirements in industrial tasks is part of daily living and starts at task onset, highlighting the importance of task familiarization and the randomization of experimental conditions in scientific studies.
| S-EPMC6479693 | biostudies-literature
Project description:Computational models proposed that the medial temporal lobe (MTL) contributes importantly to error-driven learning, though little direct in-vivo evidence for this hypothesis exists. To test this, we recorded in the entorhinal cortex (EC) and hippocampus (HPC) as macaques performed an associative learning task using an error-driven learning strategy, defined as better performance after error relative to correct trials. Error-detection signals were more prominent in the EC relative to HPC. Early in learning hippocampal but not EC neurons signaled error-driven learning by increasing their population stimulus-selectivity following error trials. This same pattern was not seen in another task where error-driven learning was not used. After learning, different populations of cells in both the EC and HPC signaled long-term memory of newly learned associations with enhanced stimulus-selective responses. These results suggest prominent but differential contributions of EC and HPC to learning from errors and a particularly important role of the EC in error-detection.
| S-EPMC8144598 | biostudies-literature
Project description:BackgroundThe primary motor cortex (M1) has a vital role to play in the learning of novel motor skills. However, the physiological changes underpinning this learning, particularly in terms of dynamic changes during movement preparation, are incompletely understood. In particular, a substantial decrease in resting gamma-amino butyric acid (GABA) activity, i.e. a release of resting inhibition, is seen within M1 as a subject prepares to move. Although there is evidence that a decrease in resting inhibition occurs within M1 during motor learning it is not known whether the pre-movement "release" of GABAergic inhibition is modulated during skill acquisition.ObjectiveHere, we investigated changes in pre-movement GABAergic inhibitory "release" during training on a motor skill task.MethodsWe studied GABAA activity using paired-pulse TMS (Short-Interval Intracortical Inhibition (SICI)) during training on a ballistic thumb abduction task, both at rest and at two time-points during movement preparation.ResultsImprovement in task performance was related to a later, steeper, release of inhibition during the movement preparation phase. Specifically, subjects who showed greater improvement in the task in the early stages of training showed a reduced level of GABAergic release immediately prior to movement compared with those who improved less. Later in training, subjects who performed better showed a reduction in GABAergic release early in movement preparation.ConclusionsThese findings suggest that motor training is associated with maintained inhibition in motor cortex during movement preparation.
| S-EPMC7116431 | biostudies-literature
Project description:Dystonia is a movement disorder characterized by sustained or intermittent muscle contractions causing abnormal, often repetitive movements, postures, or both. Although dystonia is traditionally associated with basal ganglia dysfunction, recent evidence has been pointing to a role of the cerebellum, a brain area involved in motor control and learning. Cerebellar abnormalities have been correlated with dystonia but their potential causative role remains elusive. Here, we simulated the cerebellar input-output relationship with high-resolution computational modeling. We used a data-driven cerebellar Spiking Neural Network and simulated a cerebellum-driven associative learning task, Eye-Blink Classical Conditioning (EBCC), which is characteristically altered in relation to cerebellar lesions in several pathologies. In control simulations, input stimuli entrained characteristic network dynamics and induced synaptic plasticity along task repetitions, causing a progressive spike suppression in Purkinje cells with consequent facilitation of deep cerebellar nuclei cells. These neuronal processes caused a progressive acquisition of eyelid Conditioned Responses (CRs). Then, we modified structural or functional local neural features in the network reproducing alterations reported in dystonic mice. Either reduced olivocerebellar input or aberrant Purkinje cell burst-firing resulted in abnormal learning curves imitating the dysfunctional EBCC motor responses (in terms of CR amount and timing) of dystonic mice. These behavioral deficits might be due to altered temporal processing of sensorimotor information and uncoordinated control of muscle contractions. Conversely, an imbalance of excitatory and inhibitory synaptic densities on Purkinje cells did not reflect into significant EBCC deficit. The present work suggests that only certain types of alterations, including reduced olivocerebellar input and aberrant PC burst-firing, are compatible with the EBCC changes observed in dystonia, indicating that some cerebellar lesions can have a causative role in the pathogenesis of symptoms.
| S-EPMC9243665 | biostudies-literature
Project description:Confronted with a rich sensory environment, the brain must learn statistical regularities across sensory domains to construct causal models of the world. Here, we used functional magnetic resonance imaging and dynamic causal modeling (DCM) to furnish neurophysiological evidence that statistical associations are learnt, even when task-irrelevant. Subjects performed an audio-visual target-detection task while being exposed to distractor stimuli. Unknown to them, auditory distractors predicted the presence or absence of subsequent visual distractors. We modeled incidental learning of these associations using a Rescorla-Wagner (RW) model. Activity in primary visual cortex and putamen reflected learning-dependent surprise: these areas responded progressively more to unpredicted, and progressively less to predicted visual stimuli. Critically, this prediction-error response was observed even when the absence of a visual stimulus was surprising. We investigated the underlying mechanism by embedding the RW model into a DCM to show that auditory to visual connectivity changed significantly over time as a function of prediction error. Thus, consistent with predictive coding models of perception, associative learning is mediated by prediction-error dependent changes in connectivity. These results posit a dual role for prediction-error in encoding surprise and driving associative plasticity.
| S-EPMC2665159 | biostudies-literature
Project description:When movements become dysmetric, the resultant motor error induces a plastic change in the cerebellum to correct the movement, i.e., motor adaptation. Current evidence suggests that the error signal to the cerebellum is delivered by complex spikes originating in the inferior olive (IO). To prove a causal link between the IO error signal and motor adaptation, several studies blocked the IO, which, unfortunately, affected not only the adaptation but also the movement itself. We avoided this confound by inactivating the source of an error signal to the IO. Several studies implicate the superior colliculus (SC) as the source of the error signal to the IO for saccade adaptation. When we inactivated the SC, the metrics of the saccade to be adapted were unchanged, but saccade adaptation was impaired. Thus, an intact rostral SC is necessary for saccade adaptation. Our data provide experimental evidence for the cerebellar learning theory that requires an error signal to drive motor adaptation.
| S-EPMC6156644 | biostudies-literature
Project description:ADHD is associated with altered dopamine regulated reinforcement learning on prediction errors. Despite evidence of categorically altered error processing in ADHD, neuroimaging advances have largely investigated models of normal reinforcement learning in greater detail. Further, although reinforcement leaning critically relies on ventral striatum exerting error magnitude related thresholding influences on substantia nigra (SN) and dorsal striatum, these thresholding influences have never been identified with neuroimaging. To identify such thresholding influences, we propose that error magnitude related activities must first be separated from opposite activities in overlapping neural regions during error detection. Here we separate error detection from magnitude related adjustment (post-error slowing) during inhibition errors in the stop signal task in typically developing (TD) and ADHD adolescents using fMRI. In TD, we predicted that: 1) deactivation of dorsal striatum on error detection interrupts ongoing processing, and should be proportional to right frontoparietal response phase activity that has been observed in the SST; 2) deactivation of ventral striatum on post-error slowing exerts thresholding influences on, and should be proportional to activity in dorsal striatum. In ADHD, we predicted that ventral striatum would instead correlate with heightened amygdala responses to errors. We found deactivation of dorsal striatum on error detection correlated with response-phase activity in both groups. In TD, post-error slowing deactivation of ventral striatum correlated with activation of dorsal striatum. In ADHD, ventral striatum correlated with heightened amygdala activity. Further, heightened activities in locus coeruleus (norepinephrine), raphe nucleus (serotonin) and medial septal nuclei (acetylcholine), which all compete for control of DA, and are altered in ADHD, exhibited altered correlations with SN. All correlations in TD were replicated in healthy adults. Results in TD are consistent with dopamine regulated reinforcement learning on post-error slowing. In ADHD, results are consistent with heightened activities in the amygdala and non-dopaminergic neurotransmitter nuclei preventing reinforcement learning.
| S-EPMC6382150 | biostudies-literature