Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain.
Ontology highlight
ABSTRACT:
SUBMITTER: Kim H
PROVIDER: S-EPMC1484497 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundSelective serotonin reuptake inhibitors (SSRIs) are popular medications for anxiety and depression, but their effectiveness, particularly in patients with prominent symptoms of loss of motivation and pleasure, has been questioned. There are few studies of the effect of SSRIs on neural reward mechanisms in humans.MethodsWe studied 45 healthy participants who were randomly allocated to receive the SSRI citalopram, the noradrenaline reuptake inhibitor reboxetine, or placebo for 7 days in a double-blind, parallel group design. We used functional magnetic resonance imaging to measure the neural response to rewarding (sight and/or flavor of chocolate) and aversive stimuli (sight of moldy strawberries and/or an unpleasant strawberry taste) on the final day of drug treatment.ResultsCitalopram reduced activation to the chocolate stimuli in the ventral striatum and the ventral medial/orbitofrontal cortex. In contrast, reboxetine did not suppress ventral striatal activity and in fact increased neural responses within medial orbitofrontal cortex to reward. Citalopram also decreased neural responses to the aversive stimuli conditions in key "punishment" areas such as the lateral orbitofrontal cortex. Reboxetine produced a similar, although weaker effect.ConclusionsOur findings are the first to show that treatment with SSRIs can diminish the neural processing of both rewarding and aversive stimuli. The ability of SSRIs to decrease neural responses to reward might underlie the questioned efficacy of SSRIs in depressive conditions characterized by decreased motivation and anhedonia and could also account for the experience of emotional blunting described by some patients during SSRI treatment.
| S-EPMC2828549 | biostudies-literature
Project description:Animal approach-avoidance conflict paradigms have been used extensively to operationalize anxiety, quantify the effects of anxiolytic agents, and probe the neural basis of fear and anxiety. Results from human neuroimaging studies support that a frontal-striatal-amygdala neural circuitry is important for approach-avoidance learning. However, the neural basis of decision-making is much less clear in this context. Thus, we combined a recently developed human approach-avoidance paradigm with functional magnetic resonance imaging (fMRI) to identify neural substrates underlying approach-avoidance conflict decision-making. Fifteen healthy adults completed the approach-avoidance conflict (AAC) paradigm during fMRI. Analyses of variance were used to compare conflict to nonconflict (avoid-threat and approach-reward) conditions and to compare level of reward points offered during the decision phase. Trial-by-trial amplitude modulation analyses were used to delineate brain areas underlying decision-making in the context of approach/avoidance behavior. Conflict trials as compared to the nonconflict trials elicited greater activation within bilateral anterior cingulate cortex, anterior insula, and caudate, as well as right dorsolateral prefrontal cortex (PFC). Right caudate and lateral PFC activation was modulated by level of reward offered. Individuals who showed greater caudate activation exhibited less approach behavior. On a trial-by-trial basis, greater right lateral PFC activation related to less approach behavior. Taken together, results suggest that the degree of activation within prefrontal-striatal-insula circuitry determines the degree of approach versus avoidance decision-making. Moreover, the degree of caudate and lateral PFC activation related to individual differences in approach-avoidance decision-making. Therefore, the approach-avoidance conflict paradigm is ideally suited to probe anxiety-related processing differences during approach-avoidance decision-making.
| S-EPMC4300249 | biostudies-literature
Project description:Learning to avoid aversive outcomes is an adaptive strategy to limit one's future exposure to stressful events. However, there is considerable variance in active avoidance learning across a population. The mesolimbic dopamine system contributes to behaviors elicited by aversive stimuli, although it is unclear if the heterogeneity in active avoidance learning is explained by differences in dopamine transmission. Furthermore, it is not known how dopamine signals evolve throughout active avoidance learning. To address these questions, we performed voltammetry recordings of dopamine release in the ventral medial striatum throughout training on inescapable footshock and signaled active avoidance tasks. This approach revealed differences in the pattern of dopamine signaling during the aversive cue and the safety period that corresponded to subsequent task performance. Dopamine transmission throughout the footshock bout did not predict performance but rather was modulated by the prior stress exposure. Additionally, we demonstrate that dopamine encodes a safety prediction error signal, which illustrates that ventral medial striatal dopamine release conveys a learning signal during both appetitive and aversive conditions.
| S-EPMC6613186 | biostudies-literature
Project description:Neural circuits that control aversion are essential for motivational regulation and survival in animals. The nucleus accumbens (NAc) plays an important role in predicting aversive events and translating motivations into actions. However, the NAc circuits that mediate aversive behaviors remain elusive. Here, we report that tachykinin precursor 1 (Tac1) neurons in the NAc medial shell regulate avoidance responses to aversive stimuli. We show that NAcTac1 neurons project to the lateral hypothalamic area (LH) and that the NAcTac1→LH pathway contributes to avoidance responses. Moreover, the medial prefrontal cortex (mPFC) sends excitatory inputs to the NAc, and this circuit is involved in the regulation of avoidance responses to aversive stimuli. Overall, our study reveals a discrete NAc Tac1 circuit that senses aversive stimuli and drives avoidance behaviors.
| S-EPMC10001899 | biostudies-literature
Project description:RationaleAnimal studies indicate that dopamine pathways in the ventral striatum code for the motivational salience of both rewarding and aversive stimuli, but evidence for this mechanism in humans is less established. We have developed a functional magnetic resonance imaging (fMRI) model which permits examination of the neural processing of both rewarding and aversive stimuli.ObjectivesThe aim of the study was to determine the effect of the dopamine receptor antagonist, sulpiride, on the neural processing of rewarding and aversive stimuli in healthy volunteers.MethodsWe studied 30 healthy participants who were randomly allocated to receive a single dose of sulpiride (400 mg) or placebo, in a double-blind, parallel-group design. We used fMRI to measure the neural response to rewarding (taste or sight of chocolate) and aversive stimuli (sight of mouldy strawberries or unpleasant strawberry taste) 4 h after drug treatment.ResultsRelative to placebo, sulpiride reduced blood oxygenation level-dependent responses to chocolate stimuli in the striatum (ventral striatum) and anterior cingulate cortex. Sulpiride also reduced lateral orbitofrontal cortex and insula activations to the taste and sight of the aversive condition.ConclusionsThese results suggest that acute dopamine receptor blockade modulates mesolimbic and mesocortical neural activations in response to both rewarding and aversive stimuli in healthy volunteers. This effect may be relevant to the effects of dopamine receptor antagonists in the treatment of psychosis and may also have implications for the possible antidepressant properties of sulpiride.
| S-EPMC3160552 | biostudies-literature
Project description:Theoretical accounts have linked anxiety to intolerance of ambiguity. However, this relationship has not been well operationalized empirically. Here, we used computational and neuro-imaging methods to characterize anxiety-related differences in aversive decision-making under ambiguity and associated patterns of cortical activity. Adult human participants chose between two urns on each trial. The ratio of tokens ('O's and 'X's) in each urn determined probability of electrical stimulation receipt. A number above each urn indicated the magnitude of stimulation that would be received if a shock was delivered. On ambiguous trials, one of the two urns had tokens occluded. By varying the number of tokens occluded, we manipulated the extent of missing information. At higher levels of missing information, there is greater second order uncertainty, i.e., more uncertainty as to the probability of pulling a given type of token from the urn. Adult human participants demonstrated avoidance of ambiguous options which increased with level of missing information. Extent of 'information-level dependent' ambiguity aversion was significantly positively correlated with trait anxiety. Activity in both the dorsal anterior cingulate cortex and inferior frontal sulcus during the decision-making period increased as a function of missing information. Greater engagement of these regions, on high missing information trials, was observed when participants went on to select the ambiguous option; this was especially apparent in high trait anxious individuals. These findings are consistent with individuals vulnerable to anxiety requiring greater activation of frontal regions supporting rational decision-making to overcome a predisposition to engage in ambiguity avoidance at high levels of missing information.
| S-EPMC9223033 | biostudies-literature
Project description:Both unexpected pain and unexpected pain absence can drive avoidance learning, but whether they do so via shared or separate neural and neurochemical systems is largely unknown. To address this issue, we combined an instrumental pain-avoidance learning task with computational modeling, functional magnetic resonance imaging (fMRI), and pharmacological manipulations of the dopaminergic (100 mg levodopa) and opioidergic (50 mg naltrexone) systems (N = 83). Computational modeling provided evidence that untreated participants learned more from received than avoided pain. Our dopamine and opioid manipulations negated this learning asymmetry by selectively increasing learning rates for avoided pain. Furthermore, our fMRI analyses revealed that pain prediction errors were encoded in subcortical and limbic brain regions, whereas no-pain prediction errors were encoded in frontal and parietal cortical regions. However, we found no effects of our pharmacological manipulations on the neural encoding of prediction errors. Together, our results suggest that human pain-avoidance learning is supported by separate threat- and safety-learning systems, and that dopamine and endogenous opioids specifically regulate learning from successfully avoided pain.
| S-EPMC9217130 | biostudies-literature
Project description:Amphetamines have rewarding and aversive effects. Relative sensitivity to these effects may be a better predictor of vulnerability to addiction than sensitivity to one of these effects alone. We tested this hypothesis in a dose-response study in a second replicate set of mouse lines selectively bred for high vs. low methamphetamine (MA) drinking (MADR). Replicate 2 high (MAHDR-2) and low (MALDR-2) MA drinking mice were bred based on MA consumption in a two-bottle choice procedure and examined for novel tastant drinking. Sensitivities to the rewarding and aversive effects of several doses of MA (0.5, 2 and 4 mg/kg) were measured using a place conditioning procedure. After conditioning, mice were tested in a drug-free and then drug-present state for time spent in the saline- and MA-paired contexts. Similar to the first set of MADR lines, by the end of selection, MAHDR-2 mice consumed about 6 mg MA/kg/18 h, compared to nearly no MA in MALDR-2 mice, but had similar taste preference ratios. MAHDR-2 mice exhibited place preference in both the drug-free and drug-present tests, and no significant place aversion. In contrast, MALDR-2 mice exhibited no place preference or aversion during the drug-free test, but robust place aversion in the drug-present test. These data extend our preliminary findings from the first set of MADR lines and support the hypothesis that the combination of greater sensitivity to the rewarding effects of MA and insensitivity to the aversive effects of MA is genetically associated with heightened risk for MA consumption.
| S-EPMC3320762 | biostudies-literature
Project description:The present study investigates human aversive Pavlovian-to-Instrumental Transfer (PIT) and possible influences of outcome devaluation and instrumental overtraining on this effect. PIT measures the extent to which a Pavlovian conditioned stimulus (CS) can increase instrumental responses independently paired with the same (outcome-specific transfer) or a different (general transfer) reinforcer. Two measures of PIT were obtained: the percentage of instrumental responses and the vigor of such responses. Thirty-eight volunteers performed a standard PIT task sequence. Results showed a double dissociation between outcome-specific and general transfer: the first selectively expressed in the amount of responses, the second in the vigor measure solely. Furthermore, outcome-specific transfer was enhanced by overtraining, but not affected by devaluation. General transfer, on the other hand, was affected by neither overtraining, nor devaluation. A positive correlation between general transfer and sensitivity to punishments was found. Findings are discussed in terms of hypothetically different underlying neurobehavioral mechanisms and their relations to habits and goal-directed behavior.
| S-EPMC5388761 | biostudies-literature
Project description:BackgroundAversive stimuli in the environment influence human actions. This includes valence-dependent influences on action selection, e.g., increased avoidance but decreased approach behavior. However, it is yet unclear how aversive stimuli interact with complex learning and decision-making in the reward and avoidance domain. Moreover, the underlying computational mechanisms of these decision-making biases are unknown.MethodsTo elucidate these mechanisms, 54 healthy young male subjects performed a two-step sequential decision-making task, which allows to computationally model different aspects of learning, e.g., model-free, habitual, and model-based, goal-directed learning. We used a within-subject design, crossing task valence (reward vs. punishment learning) with emotional context (aversive vs. neutral background stimuli). We analyzed choice data, applied a computational model, and performed simulations.ResultsWhereas model-based learning was not affected, aversive stimuli interacted with model-free learning in a way that depended on task valence. Thus, aversive stimuli increased model-free avoidance learning but decreased model-free reward learning. The computational model confirmed this effect: the parameter lambda that indicates the influence of reward prediction errors on decision values was increased in the punishment condition but decreased in the reward condition when aversive stimuli were present. Further, by using the inferred computational parameters to simulate choice data, our effects were captured. Exploratory analyses revealed that the observed biases were associated with subclinical depressive symptoms.ConclusionOur data show that aversive environmental stimuli affect complex learning and decision-making, which depends on task valence. Further, we provide a model of the underlying computations of this affective modulation. Finally, our finding of increased decision-making biases in subjects reporting subclinical depressive symptoms matches recent reports of amplified Pavlovian influences on action selection in depression and suggests a potential vulnerability factor for mood disorders. We discuss our findings in the light of the involvement of the neuromodulators serotonin and dopamine.
| S-EPMC6695365 | biostudies-literature