Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region.

ABSTRACT: Natural environments are uncertain. Uncertainty of emotional outcomes can induce anxiety and raise vigilance, promote and signal the opportunity for learning, modulate economic choice and regulate risk-seeking. Here we demonstrate that a subset of neurons in the anterodorsal region of the primate septum (ADS) are primarily devoted to processing uncertainty in a highly specific manner. Those neurons were selectively activated by visual cues indicating probabilistic delivery of reward (for example, 25%, 50% and 75% reward) and did not respond to cues indicating certain outcomes (0% and 100% reward). The average ADS uncertainty response was graded with the magnitude of reward uncertainty and selectively signaled uncertainty about rewards rather than punishments. The selective and graded information about reward uncertainty encoded by many neurons in the ADS may underlie modulation of uncertainty of value- and sensorimotor-related areas to regulate goal-directed behavior.

SUBMITTER: Monosov IE

PROVIDER: S-EPMC4160807 | biostudies-literature | 2013 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Selective and graded coding of reward uncertainty by neurons in the primate anterodorsal septal region.

Monosov Ilya E IE Hikosaka Okihide O

Nature neuroscience 20130512 6

Natural environments are uncertain. Uncertainty of emotional outcomes can induce anxiety and raise vigilance, promote and signal the opportunity for learning, modulate economic choice and regulate risk-seeking. Here we demonstrate that a subset of neurons in the anterodorsal region of the primate septum (ADS) are primarily devoted to processing uncertainty in a highly specific manner. Those neurons were selectively activated by visual cues indicating probabilistic delivery of reward (for example ...[more]

PMID: 23666181

Similar Datasets

Neurons in the primate dorsal striatum signal the uncertainty of object-reward associations.

Project description:To learn, obtain reward and survive, humans and other animals must monitor, approach and act on objects that are associated with variable or unknown rewards. However, the neuronal mechanisms that mediate behaviours aimed at uncertain objects are poorly understood. Here we demonstrate that a set of neurons in an internal-capsule bordering regions of the primate dorsal striatum, within the putamen and caudate nucleus, signal the uncertainty of object-reward associations. Their uncertainty responses depend on the presence of objects associated with reward uncertainty and evolve rapidly as monkeys learn novel object-reward associations. Therefore, beyond its established role in mediating actions aimed at known or certain rewards, the dorsal striatum also participates in behaviours aimed at reward-uncertain objects.

| S-EPMC5027277 | biostudies-literature

Shared neural coding for social hierarchy and reward value in primate amygdala.

Project description:The social brain hypothesis posits that dedicated neural systems process social information. In support of this, neurophysiological data have shown that some brain regions are specialized for representing faces. It remains unknown, however, whether distinct anatomical substrates also represent more complex social variables, such as the hierarchical rank of individuals within a social group. Here we show that the primate amygdala encodes the hierarchical rank of individuals in the same neuronal ensembles that encode the rewards associated with nonsocial stimuli. By contrast, orbitofrontal and anterior cingulate cortices lack strong representations of hierarchical rank while still representing reward values. These results challenge the conventional view that dedicated neural systems process social information. Instead, information about hierarchical rank-which contributes to the assessment of the social value of individuals within a group-is linked in the amygdala to representations of rewards associated with nonsocial stimuli.

| S-EPMC6092962 | biostudies-literature

Primate prefrontal neurons signal economic risk derived from the statistics of recent reward experience.

Project description:Risk derives from the variation of rewards and governs economic decisions, yet how the brain calculates risk from the frequency of experienced events, rather than from explicit risk-descriptive cues, remains unclear. Here, we investigated whether neurons in dorsolateral prefrontal cortex process risk derived from reward experience. Monkeys performed in a probabilistic choice task in which the statistical variance of experienced rewards evolved continually. During these choices, prefrontal neurons signaled the reward-variance associated with specific objects ('object risk') or actions ('action risk'). Crucially, risk was not derived from explicit, risk-descriptive cues but calculated internally from the variance of recently experienced rewards. Support-vector-machine decoding demonstrated accurate neuronal risk discrimination. Within trials, neuronal signals transitioned from experienced reward to risk (risk updating) and from risk to upcoming choice (choice computation). Thus, prefrontal neurons encode the statistical variance of recently experienced rewards, complying with formal decision variables of object risk and action risk.

| S-EPMC6658165 | biostudies-literature

Reward probability and timing uncertainty alter the effect of dorsal raphe serotonin neurons on patience.

Project description:Recent experiments have shown that optogenetic activation of serotonin neurons in the dorsal raphe nucleus (DRN) in mice enhances patience in waiting for future rewards. Here, we show that serotonin effect in promoting waiting is maximized by both high probability and high timing uncertainty of reward. Optogenetic activation of serotonergic neurons prolongs waiting time in no-reward trials in a task with 75% food reward probability, but not with 50 or 25% reward probabilities. Serotonin effect in promoting waiting increases when the timing of reward presentation becomes unpredictable. To coherently explain the experimental data, we propose a Bayesian decision model of waiting that assumes that serotonin neuron activation increases the prior probability or subjective confidence of reward delivery. The present data and modeling point to the possibility of a generalized role of serotonin in resolving trade-offs, not only between immediate and delayed rewards, but also between sensory evidence and subjective confidence.

| S-EPMC5984631 | biostudies-literature

Cortical visual processing evokes short-latency reward-predicting cue responses in primate midbrain dopamine neurons.

Project description:After classical conditioning dopamine (DA) neurons exhibit short latency responses to reward-predicting visual cues. At least two possible projections could induce such DA responses; the cortical and subcortical visual pathways. Our recent study has shown that after a lesion of the striate cortex (V1), the superior colliculus (SC), a critical node of the subcortical visual pathway, can mediate short latency cue responses in the DA neurons of macaque monkeys. An obvious question then is does the cortical pathway have a similar capacity? Using the monkeys with a unilateral V1 lesion that took part in the preceding study, we recorded DA activity while they were performing the same classical conditioning task. However, in this study conditioned visual stimuli were presented to the intact visual field, and the effects of ipsilateral SC inactivation were examined. We found that after the SC was inactivated by injections of muscimol both conditioned behavioral responding and reward-predicting, short latency (~100 ms) cue-elicited DA neuronal responses were unaffected These results indicate that the intact cortical visual pathway can also mediate short latency cue elicited responses in DA neurons in the absence of a normally functioning subcortical visual system.

| S-EPMC6175936 | biostudies-literature

Retroactive and graded prioritization of memory by reward.

Project description:Many decisions are based on an internal model of the world. Yet, how such a model is constructed from experience and represented in memory remains unknown. We test the hypothesis that reward shapes memory for sequences of events by retroactively prioritizing memory for objects as a function of their distance from reward. Human participants encountered neutral objects while exploring a series of mazes for reward. Across six data sets, we find that reward systematically modulates memory for neutral objects, retroactively prioritizing memory for objects closest to the reward. This effect of reward on memory emerges only after a 24-hour delay and is stronger for mazes followed by a longer rest interval, suggesting a role for post-reward replay and overnight consolidation, as predicted by neurobiological data in animals. These findings demonstrate that reward retroactively prioritizes memory along a sequential gradient, consistent with the role of memory in supporting adaptive decision-making.

| S-EPMC6244210 | biostudies-literature

Learning Reward Uncertainty in the Basal Ganglia.

Project description:Learning the reliability of different sources of rewards is critical for making optimal choices. However, despite the existence of detailed theory describing how the expected reward is learned in the basal ganglia, it is not known how reward uncertainty is estimated in these circuits. This paper presents a class of models that encode both the mean reward and the spread of the rewards, the former in the difference between the synaptic weights of D1 and D2 neurons, and the latter in their sum. In the models, the tendency to seek (or avoid) options with variable reward can be controlled by increasing (or decreasing) the tonic level of dopamine. The models are consistent with the physiology of and synaptic plasticity in the basal ganglia, they explain the effects of dopaminergic manipulations on choices involving risks, and they make multiple experimental predictions.

| S-EPMC5010205 | biostudies-literature

Control of gaze while walking: Task structure, reward, and uncertainty.

Project description:While it is universally acknowledged that both bottom up and top down factors contribute to allocation of gaze, we currently have limited understanding of how top-down factors determine gaze choices in the context of ongoing natural behavior. One purely top-down model by Sprague, Ballard, and Robinson (2007) suggests that natural behaviors can be understood in terms of simple component behaviors, or modules, that are executed according to their reward value, with gaze targets chosen in order to reduce uncertainty about the particular world state needed to execute those behaviors. We explore the plausibility of the central claims of this approach in the context of a task where subjects walk through a virtual environment performing interceptions, avoidance, and path following. Many aspects of both walking direction choices and gaze allocation are consistent with this approach. Subjects use gaze to reduce uncertainty for task-relevant information that is used to inform action choices. Notably the addition of motion to peripheral objects did not affect fixations when the objects were irrelevant to the task, suggesting that stimulus saliency was not a major factor in gaze allocation. The modular approach of independent component behaviors is consistent with the main aspects of performance, but there were a number of deviations suggesting that modules interact. Thus the model forms a useful, but incomplete, starting point for understanding top-down factors in active behavior.

| S-EPMC5256682 | biostudies-literature

Appetite suppressive role of medial septal glutamatergic neurons.

Project description:Feeding behavior is controlled by diverse neurons and neural circuits primarily concentrated in the hypothalamus and hindbrain in mammals. In this study, by using chemo/optogenetic techniques along with feeding assays, we investigate how neurons within the medial septal complex (MSc), a brain area implicated in emotion and cognition, contribute to food intake. We find that chemo/optogenetic activation of MSc glutamatergic neurons profoundly reduces food intake during both light and dark periods of the rodent light cycle. Furthermore, we find that selective activation of MSc glutamatergic projections in paraventricular hypothalamus (PVH) reduces food intake, suggesting that MSc glutamatergic neurons suppress feeding by activating downstream neurons in the PVH. Open-field behavioral assays reveal that these neurons do not overtly affect anxiety levels and locomotion. Collectively, our findings demonstrate that septal glutamatergic neurons exert anorexigenic effects by projecting to the PVH without affecting anxiety and physical activities.

| S-EPMC5748170 | biostudies-literature

Suppression of Dopamine Neurons Mediates Reward.

Project description:Massive activation of dopamine neurons is critical for natural reward and drug abuse. In contrast, the significance of their spontaneous activity remains elusive. In Drosophila melanogaster, depolarization of the protocerebral anterior medial (PAM) cluster dopamine neurons en masse signals reward to the mushroom body (MB) and drives appetitive memory. Focusing on the functional heterogeneity of PAM cluster neurons, we identified that a single class of PAM neurons, PAM-?3, mediates sugar reward by suppressing their own activity. PAM-?3 is selectively required for appetitive olfactory learning, while activation of these neurons in turn induces aversive memory. Ongoing activity of PAM-?3 gets suppressed upon sugar ingestion. Strikingly, transient inactivation of basal PAM-?3 activity can substitute for reward and induces appetitive memory. Furthermore, we identified the satiety-signaling neuropeptide Allatostatin A (AstA) as a key mediator that conveys inhibitory input onto PAM-?3. Our results suggest the significance of basal dopamine release in reward signaling and reveal a circuit mechanism for negative regulation.

| S-EPMC5172549 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data