Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Reward timing matters in motor learning.

ABSTRACT: Reward timing, that is, the delay after which reward is delivered following an action is known to strongly influence reinforcement learning. Here, we asked if reward timing could also modulate how people learn and consolidate new motor skills. In 60 healthy participants, we found that delaying reward delivery by a few seconds influenced motor learning. Indeed, training with a short reward delay (1 s) induced continuous improvements in performance, whereas a long reward delay (6 s) led to initially high learning rates that were followed by an early plateau in the learning curve and a lower performance at the end of training. Participants who learned the skill with a long reward delay also exhibited reduced overnight memory consolidation. Overall, our data show that reward timing affects the dynamics and consolidation of motor learning, a finding that could be exploited in future rehabilitation programs.

SUBMITTER: Vassiliadis P

PROVIDER: S-EPMC9095742 | biostudies-literature | 2022 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Reward timing matters in motor learning.

Vassiliadis Pierre P Lete Aegryan A Duque Julie J Derosiere Gerard G

iScience 20220425 5

Reward timing, that is, the delay after which reward is delivered following an action is known to strongly influence reinforcement learning. Here, we asked if reward timing could also modulate how people learn and consolidate new motor skills. In 60 healthy participants, we found that delaying reward delivery by a few seconds influenced motor learning. Indeed, training with a short reward delay (1 s) induced continuous improvements in performance, whereas a long reward delay (6 s) led to initial ...[more]

PMID: 35573187

Similar Datasets

Timing Matters

Project description:Timing matters: Impacts of host selection and social environment on gut microbiota vary over host ontogeny in estrildid finches

| PRJEB53212 | ENA

Implicit reward-based motor learning.

Project description:Binary feedback, providing information solely about task success or failure, can be sufficient to drive motor learning. While binary feedback can induce explicit adjustments in movement strategy, it remains unclear if this type of feedback also induce implicit learning. We examined this question in a center-out reaching task by gradually moving an invisible reward zone away from a visual target to a final rotation of 7.5° or 25° in a between-group design. Participants received binary feedback, indicating if the movement intersected the reward zone. By the end of the training, both groups modified their reach angle by about 95% of the rotation. We quantified implicit learning by measuring performance in a subsequent no-feedback aftereffect phase, in which participants were told to forgo any adopted movement strategies and reach directly to the visual target. The results showed a small, but robust (2-3°) aftereffect in both groups, highlighting that binary feedback elicits implicit learning. Notably, for both groups, reaches to two flanking generalization targets were biased in the same direction as the aftereffect. This pattern is at odds with the hypothesis that implicit learning is a form of use-dependent learning. Rather, the results suggest that binary feedback can be sufficient to recalibrate a sensorimotor map.

| S-EPMC10327077 | biostudies-literature

Implicit reward-based motor learning.

Project description:Binary feedback, providing information solely about task success or failure, can be sufficient to drive motor learning. While binary feedback can induce explicit adjustments in movement strategy, it remains unclear if this type of feedback also induces implicit learning. We examined this question in a center-out reaching task by gradually moving an invisible reward zone away from a visual target to a final rotation of 7.5° or 25° in a between-group design. Participants received binary feedback, indicating if the movement intersected the reward zone. By the end of the training, both groups modified their reach angle by about 95% of the rotation. We quantified implicit learning by measuring performance in a subsequent no-feedback aftereffect phase, in which participants were told to forgo any adopted movement strategies and reach directly to the visual target. The results showed a small, but robust (2-3°) aftereffect in both groups, highlighting that binary feedback elicits implicit learning. Notably, for both groups, reaches to two flanking generalization targets were biased in the same direction as the aftereffect. This pattern is at odds with the hypothesis that implicit learning is a form of use-dependent learning. Rather, the results suggest that binary feedback can be sufficient to recalibrate a sensorimotor map.

| S-EPMC10471724 | biostudies-literature

Mind matters: placebo enhances reward learning in Parkinson's disease.

Project description:Expectations have a powerful influence on how we experience the world. Neurobiological and computational models of learning suggest that dopamine is crucial for shaping expectations of reward and that expectations alone may influence dopamine levels. However, because expectations and reinforcers are typically manipulated together, the role of expectations per se has remained unclear. We separated these two factors using a placebo dopaminergic manipulation in individuals with Parkinson's disease. We combined a reward learning task with functional magnetic resonance imaging to test how expectations of dopamine release modulate learning-related activity in the brain. We found that the mere expectation of dopamine release enhanced reward learning and modulated learning-related signals in the striatum and the ventromedial prefrontal cortex. These effects were selective to learning from reward: neither medication nor placebo had an effect on learning to avoid monetary loss. These findings suggest a neurobiological mechanism by which expectations shape learning and affect.

| S-EPMC4503317 | biostudies-literature

Learning reward timing in cortex through reward dependent expression of synaptic plasticity.

Project description:The ability to represent time is an essential component of cognition but its neural basis is unknown. Although extensively studied both behaviorally and electrophysiologically, a general theoretical framework describing the elementary neural mechanisms used by the brain to learn temporal representations is lacking. It is commonly believed that the underlying cellular mechanisms reside in high order cortical regions but recent studies show sustained neural activity in primary sensory cortices that can represent the timing of expected reward. Here, we show that local cortical networks can learn temporal representations through a simple framework predicated on reward dependent expression of synaptic plasticity. We assert that temporal representations are stored in the lateral synaptic connections between neurons and demonstrate that reward-modulated plasticity is sufficient to learn these representations. We implement our model numerically to explain reward-time learning in the primary visual cortex (V1), demonstrate experimental support, and suggest additional experimentally verifiable predictions.

| S-EPMC2672535 | biostudies-literature

Quantifying exploration in reward-based motor learning.

Project description:Exploration in reward-based motor learning is observable in experimental data as increased variability. In order to quantify exploration, we compare three methods for estimating other sources of variability: sensorimotor noise. We use a task in which participants could receive stochastic binary reward feedback following a target-directed weight shift. Participants first performed six baseline blocks without feedback, and next twenty blocks alternating with and without feedback. Variability was assessed based on trial-to-trial changes in movement endpoint. We estimated sensorimotor noise by the median squared trial-to-trial change in movement endpoint for trials in which no exploration is expected. We identified three types of such trials: trials in baseline blocks, trials in the blocks without feedback, and rewarded trials in the blocks with feedback. We estimated exploration by the median squared trial-to-trial change following non-rewarded trials minus sensorimotor noise. As expected, variability was larger following non-rewarded trials than following rewarded trials. This indicates that our reward-based weight-shifting task successfully induced exploration. Most importantly, our three estimates of sensorimotor noise differed: the estimate based on rewarded trials was significantly lower than the estimates based on the two types of trials without feedback. Consequently, the estimates of exploration also differed. We conclude that the quantification of exploration depends critically on the type of trials used to estimate sensorimotor noise. We recommend the use of variability following rewarded trials.

| S-EPMC7117770 | biostudies-literature

Motor skill learning and reward consumption differentially affect VTA activation.

Project description:Dopamine release from the ventral tegmental area (VTA) terminals in the primary motor cortex (M1) enables motor skill acquisition. Here, we test the hypothesis that dopaminergic VTA neurons projecting to M1 are activated when rewards are obtained during motor skill acquisition, but not during task execution at plateau performance, or by rewards obtained without performing skilled movements. Rats were trained to perform a skilled reaching task for 3 days (acquisition) or 7 days (plateau). In combination with retrograde labelling of VTA-to-M1 projection neurons, double immunofluorescence for c-fos and tyrosine hydroxylase (TH) was used to assess activation of dopaminergic and non-dopaminergic VTA neurons. Dopaminergic VTA-to-M1 projection neurons were indeed activated during successful motor skill acquisition, but not when rats failed to learn or had reached plateau performance, nor by food rewards alone. By contrast, dopaminergic VTA neurons that did not project to M1 were activated by both skilled reaching and food rewards. Non-dopaminergic neurons were found to be activated by motor task performance at plateau, but not during skill acquisition. These results indicate that distinct populations of VTA neurons are activated by motor skill acquisition and task performance. Moreover, this activation is not merely related to consumption of food rewards.

| S-EPMC5766527 | biostudies-literature

Timing along the cardiac cycle modulates neural signals of reward-based learning.

Project description:Natural fluctuations in cardiac activity modulate brain activity associated with sensory stimuli, as well as perceptual decisions about low magnitude, near-threshold stimuli. However, little is known about the relationship between fluctuations in heart activity and other internal representations. Here we investigate whether the cardiac cycle relates to learning-related internal representations - absolute and signed prediction errors. We combined machine learning techniques with electroencephalography with both simple, direct indices of task performance and computational model-derived indices of learning. Our results demonstrate that just as people are more sensitive to low magnitude, near-threshold sensory stimuli in certain cardiac phases, so are they more sensitive to low magnitude absolute prediction errors in the same cycles. However, this occurs even when the low magnitude prediction errors are associated with clearly suprathreshold sensory events. In addition, participants exhibiting stronger differences in their prediction error representations between cardiac cycles exhibited higher learning rates and greater task accuracy.

| S-EPMC10998831 | biostudies-literature

AML consolidation therapy: timing matters.

Project description:PurposeInfections due to severe neutropenia are the most common therapy-associated causes of mortality in patients with acute myeloid leukemia (AML). New strategies to lessen the severity and duration of neutropenia are needed.MethodsCytarabine is commonly used for AML consolidation therapy; we compared high- and intermediate-dose cytarabine administration on days 1, 2, and 3 (AC-123) versus days 1, 3, and 5 (AC-135) in consolidation therapy of AML. Recently, clinical trials demonstrated that high-dose AC-123 resulted in a shortened white blood cell (WBC) recovery time compared with high-dose AC-135. Our main hypothesis is that this is also the case for different cytarabine dosage, granulocyte colony-stimulating factor (G-CSF) administration, and cycle lengths. We analyzed 334 treatment schedules on virtual cohorts of digital twins.ResultsComparison of 32,565 simulated consolidation cycles resulted in a reduction in the WBC recovery time for AC-123 in 99.6% of the considered cycles (median reduction 3.5 days) without an increase in the number of leukemic blasts (lower value in 94.2% of all cycles), compared to AC-135.ConclusionOur numerical study supports the use of AC-123 plus G-CSF as standard conventional AML consolidation therapy to reduce the risk for life-threatening infectious complications.

| S-EPMC10590325 | biostudies-literature

Distributed Cerebellar Motor Learning: A Spike-Timing-Dependent Plasticity Model.

Project description:Deep cerebellar nuclei neurons receive both inhibitory (GABAergic) synaptic currents from Purkinje cells (within the cerebellar cortex) and excitatory (glutamatergic) synaptic currents from mossy fibers. Those two deep cerebellar nucleus inputs are thought to be also adaptive, embedding interesting properties in the framework of accurate movements. We show that distributed spike-timing-dependent plasticity mechanisms (STDP) located at different cerebellar sites (parallel fibers to Purkinje cells, mossy fibers to deep cerebellar nucleus cells, and Purkinje cells to deep cerebellar nucleus cells) in close-loop simulations provide an explanation for the complex learning properties of the cerebellum in motor learning. Concretely, we propose a new mechanistic cerebellar spiking model. In this new model, deep cerebellar nuclei embed a dual functionality: deep cerebellar nuclei acting as a gain adaptation mechanism and as a facilitator for the slow memory consolidation at mossy fibers to deep cerebellar nucleus synapses. Equipping the cerebellum with excitatory (e-STDP) and inhibitory (i-STDP) mechanisms at deep cerebellar nuclei afferents allows the accommodation of synaptic memories that were formed at parallel fibers to Purkinje cells synapses and then transferred to mossy fibers to deep cerebellar nucleus synapses. These adaptive mechanisms also contribute to modulate the deep-cerebellar-nucleus-output firing rate (output gain modulation toward optimizing its working range).

| S-EPMC4773604 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data