Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers.

ABSTRACT: Instrumental learning is driven by a history of outcome success and failure. Here, we examined the impact of serotonin on learning from positive and negative outcomes. Healthy human volunteers were assessed twice, once after acute (single-dose), and once after prolonged (week-long) daily administration of the SSRI citalopram or placebo. Using computational modelling, we show that prolonged boosting of serotonin enhances learning from punishment and reduces learning from reward. This valence-dependent learning asymmetry increases subjects' tendency to avoid actions as a function of cumulative failure without leading to detrimental, or advantageous, outcomes. By contrast, no significant modulation of learning was observed following acute SSRI administration. However, differences between the effects of acute and prolonged administration were not significant. Overall, these findings may help explain how serotonergic agents impact on mood disorders.

SUBMITTER: Michely J

PROVIDER: S-EPMC9374781 | biostudies-literature | 2022 Aug

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Serotonin modulates asymmetric learning from reward and punishment in healthy human volunteers.

Michely Jochen J Eldar Eran E Erdman Alon A Martin Ingrid M IM Dolan Raymond J RJ

Communications biology 20220812 1

Instrumental learning is driven by a history of outcome success and failure. Here, we examined the impact of serotonin on learning from positive and negative outcomes. Healthy human volunteers were assessed twice, once after acute (single-dose), and once after prolonged (week-long) daily administration of the SSRI citalopram or placebo. Using computational modelling, we show that prolonged boosting of serotonin enhances learning from punishment and reduces learning from reward. This valence-depe ...[more]

PMID: 35962142

Similar Datasets

Serotonin transporter genotype modulates social reward and punishment in rhesus macaques.

Project description:BackgroundSerotonin signaling influences social behavior in both human and nonhuman primates. In humans, variation upstream of the promoter region of the serotonin transporter gene (5-HTTLPR) has recently been shown to influence both behavioral measures of social anxiety and amygdala response to social threats. Here we show that length polymorphisms in 5-HTTLPR predict social reward and punishment in rhesus macaques, a species in which 5-HTTLPR variation is analogous to that of humans.Methodology/principal findingsIn contrast to monkeys with two copies of the long allele (L/L), monkeys with one copy of the short allele of this gene (S/L) spent less time gazing at face than non-face images, less time looking in the eye region of faces, and had larger pupil diameters when gazing at photos of a high versus low status male macaques. Moreover, in a novel primed gambling task, presentation of photos of high status male macaques promoted risk-aversion in S/L monkeys but promoted risk-seeking in L/L monkeys. Finally, as measured by a "pay-per-view" task, S/L monkeys required juice payment to view photos of high status males, whereas L/L monkeys sacrificed fluid to see the same photos.Conclusions/significanceThese data indicate that genetic variation in serotonin function contributes to social reward and punishment in rhesus macaques, and thus shapes social behavior in humans and rhesus macaques alike.

| S-EPMC2612746 | biostudies-literature

Intention to learn modulates the impact of reward and punishment on sequence learning.

Project description:In real-world settings, learning is often characterised as intentional: learners are aware of the goal during the learning process, and the goal of learning is readily dissociable from the awareness of what is learned. Recent evidence has shown that reward and punishment (collectively referred to as valenced feedback) are important factors that influence performance during learning. Presently, however, studies investigating the impact of valenced feedback on skill learning have only considered unintentional learning, and therefore the interaction between intentionality and valenced feedback has not been systematically examined. The present study investigated how reward and punishment impact behavioural performance when participants are instructed to learn in a goal-directed fashion (i.e. intentionally) rather than unintentionally. In Experiment 1, participants performed the serial response time task with reward, punishment, or control feedback and were instructed to ignore the presence of the sequence, i.e., learn unintentionally. Experiment 2 followed the same design, but participants were instructed to intentionally learn the sequence. We found that punishment significantly benefitted performance during learning only when participants learned unintentionally, and we observed no effect of punishment when participants learned intentionally. Thus, the impact of feedback on performance may be influenced by goal of the learner.

| S-EPMC7264311 | biostudies-literature

Lithium modulates striatal reward anticipation and prediction error coding in healthy volunteers.

Project description:Lithium is one of the most effective mood-stabilizing medications in bipolar disorder. This study was designed to test whether lithium administration may stabilize mood via effects on reward processing. It was hypothesized that lithium administration would modulate reward processing in the striatum and affect both anticipation and outcome computations. Thirty-seven healthy human participants (18 males, 33 with suitable fMRI data) received 11 (±1) days of lithium carbonate or placebo intervention (double-blind), after which they completed the monetary incentive delay task while fMRI data were collected. The monetary incentive delay task is a robust task with excellent test-retest reliability and is well suited to investigate different phases of reward processing within the caudate and nucleus accumbens. To test for correlations with prediction error signals a Rescorla-Wagner reinforcement-learning model was applied. Lithium administration enhanced activity in the caudate during reward anticipation compared to placebo. In contrast, lithium administration reduced caudate and nucleus accumbens activity during reward outcome. This latter effect seems related to learning as reward prediction errors showed a positive correlation with caudate and nucleus accumbens activity during placebo, which was absent after lithium administration. Lithium differentially modulates the anticipation relative to the learning of rewards. This suggests that lithium might reverse dampened reward anticipation while reducing overactive reward updating in patients with bipolar disorder. This specific effect of lithium suggests that a targeted modulation of reward learning may be a viable approach for novel interventions in bipolar disorder.

| S-EPMC7853118 | biostudies-literature

Differential effect of reward and punishment on procedural learning.

Project description:Reward and punishment are potent modulators of associative learning in instrumental and classical conditioning. However, the effect of reward and punishment on procedural learning is not known. The striatum is known to be an important locus of reward-related neural signals and part of the neural substrate of procedural learning. Here, using an implicit motor learning task, we show that reward leads to enhancement of learning in human subjects, whereas punishment is associated only with improvement in motor performance. Furthermore, these behavioral effects have distinct neural substrates with the learning effect of reward being mediated through the dorsal striatum and the performance effect of punishment through the insula. Our results suggest that reward and punishment engage separate motivational systems with distinctive behavioral effects and neural substrates.

| S-EPMC2765863 | biostudies-other

Reward/Punishment reversal learning in older suicide attempters.

Project description:Suicide rates are high in old age, and the contribution of cognitive risk factors remains poorly understood. Suicide may be viewed as an outcome of an altered decision process. The authors hypothesized that impairment in reward/punishment-based learning, a component of affective decision making, is associated with attempted suicide in late-life depression. They expected that suicide attempters would discount past reward/punishment history, focusing excessively on the most recent rewards and punishments. The authors further hypothesized that this impairment could be dissociated from executive abilities, such as forward planning.The authors assessed reward/punishment-based learning using the probabilistic reversal learning task in 65 individuals age 60 and older: suicide attempters, suicide ideators, nonsuicidal depressed elderly, and nondepressed comparison subjects. The authors used a reinforcement learning computational model to decompose reward/punishment processing over time. The Stockings of Cambridge test served as a control measure of executive function.Suicide attempters but not suicide ideators showed impaired probabilistic reversal learning compared to both nonsuicidal depressed elderly and nondepressed comparison subjects, after controlling for effects of education, global cognitive function, and substance use. Model-based analyses revealed that suicide attempters discounted previous history to a higher degree relative to comparison subjects, basing their choice largely on reward/punishment received on the last trial. Groups did not differ in their performance on the Stockings of Cambridge test.Older suicide attempters display impaired reward/punishment-based learning. The authors propose a hypothesis that older suicide attempters make overly present-focused decisions, ignoring past experiences. Modification of this "myopia for the past" may have therapeutic potential.

| S-EPMC3020386 | biostudies-literature

Social stress reactivity alters reward and punishment learning.

Project description:To examine how stress affects cognitive functioning, individual differences in trait vulnerability (punishment sensitivity) and state reactivity (negative affect) to social evaluative threat were examined during concurrent reinforcement learning. Lower trait-level punishment sensitivity predicted better reward learning and poorer punishment learning; the opposite pattern was found in more punishment sensitive individuals. Increasing state-level negative affect was directly related to punishment learning accuracy in highly punishment sensitive individuals, but these measures were inversely related in less sensitive individuals. Combined electrophysiological measurement, performance accuracy and computational estimations of learning parameters suggest that trait and state vulnerability to stress alter cortico-striatal functioning during reinforcement learning, possibly mediated via medio-frontal cortical systems.

| S-EPMC3110431 | biostudies-literature

Asymmetric developmental change regarding the effect of reward and punishment on response inhibition.

Project description:Reward and punishment influence inhibitory performance, but developmental changes in these effects are not well understood. Our aim was to understand the effects of potential reward gains and losses (as indices of reward and punishment) on response inhibition among children and adolescents. We conducted financial and non-financial go/no-go tasks with 40 boys (8- to 15-year-olds). Participants gained or lost money depending on their performance on the financial task, and score rankings were compared to participants on the non-financial task. We found that adolescents' inhibitory control, as reflected in their reaction times when they made inhibitory errors, was lower in the reward-present condition than in the reward-absent condition, although accuracy was higher when the reward was available for all participants. Additionally, inhibitory control, specifically among adolescents, was higher for financial feedback than for non-financial feedback. These results suggest that the effects of reward and feedback type on motor impulsivity differ as a function of developmental stage. We discuss the theoretical implications of the present findings in terms of the interaction between emotional feedback and response inhibition among children and adolescents.

| S-EPMC6734010 | biostudies-literature

Reward and punishment learning in daily life: A replication study.

Project description:Day-to-day experiences are accompanied by feelings of Positive Affect (PA) and Negative Affect (NA). Implicitly, without conscious processing, individuals learn about the reward and punishment value of each context and activity. These associative learning processes, in turn, affect the probability that individuals will re-engage in such activities or seek out that context. So far, implicit learning processes are almost exclusively investigated in controlled laboratory settings and not in daily life. Here we aimed to replicate the first study that investigated implicit learning processes in real life, by means of the Experience Sampling Method (ESM). That is, using an experience-sampling study with 90 time points (three measurements over 30 days), we prospectively measured time spent in social company and amount of physical activity as well as PA and NA in the daily lives of 18-24-year-old young adults (n = 69 with anhedonia, n = 69 without anhedonia). Multilevel analyses showed a punishment learning effect with regard to time spent in company of friends, but not a reward learning effect. Neither reward nor punishment learning effects were found with regard to physical activity. Our study shows promising results for future research on implicit learning processes in daily life, with the proviso of careful consideration of the timescale used. Short-term retrospective ESM design with beeps approximately six hours apart may suffer from mismatch noise that hampers accurate detection of associative learning effects over time.

| S-EPMC5627895 | biostudies-literature

Common neural mechanisms underlying reversal learning by reward and punishment.

Project description:Impairments in flexible goal-directed decisions, often examined by reversal learning, are associated with behavioral abnormalities characterized by impulsiveness and disinhibition. Although the lateral orbital frontal cortex (OFC) has been consistently implicated in reversal learning, it is still unclear whether this region is involved in negative feedback processing, behavioral control, or both, and whether reward and punishment might have different effects on lateral OFC involvement. Using a relatively large sample (N = 47), and a categorical learning task with either monetary reward or moderate electric shock as feedback, we found overlapping activations in the right lateral OFC (and adjacent insula) for reward and punishment reversal learning when comparing correct reversal trials with correct acquisition trials, whereas we found overlapping activations in the right dorsolateral prefrontal cortex (DLPFC) when negative feedback signaled contingency change. The right lateral OFC and DLPFC also showed greater sensitivity to punishment than did their left homologues, indicating an asymmetry in how punishment is processed. We propose that the right lateral OFC and anterior insula are important for transforming affective feedback to behavioral adjustment, whereas the right DLPFC is involved in higher level attention control. These results provide insight into the neural mechanisms of reversal learning and behavioral flexibility, which can be leveraged to understand risky behaviors among vulnerable populations.

| S-EPMC3859585 | biostudies-literature

Contextual modulation of value signals in reward and punishment learning.

Project description:Compared with reward seeking, punishment avoidance learning is less clearly understood at both the computational and neurobiological levels. Here we demonstrate, using computational modelling and fMRI in humans, that learning option values in a relative--context-dependent--scale offers a simple computational solution for avoidance learning. The context (or state) value sets the reference point to which an outcome should be compared before updating the option value. Consequently, in contexts with an overall negative expected value, successful punishment avoidance acquires a positive value, thus reinforcing the response. As revealed by post-learning assessment of options values, contextual influences are enhanced when subjects are informed about the result of the forgone alternative (counterfactual information). This is mirrored at the neural level by a shift in negative outcome encoding from the anterior insula to the ventral striatum, suggesting that value contextualization also limits the need to mobilize an opponent punishment learning system.

| S-EPMC4560823 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data