Dataset Information

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation.

ABSTRACT: The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a chain of instrumental action. Rats (Rattus norvegicus) were trained to respond to cues associated with specific outcomes varying by food pellet magnitude. Animals were exposed to single-outcome sessions followed by mixed-outcome sessions, and neural activity was compared among identical outcome trials from the different behavioral contexts. Results recording striatal activity show that neural responses to different task elements reflect incentive contrast as well as other relative effects that involve generalization between outcomes or possible influences of outcome variety. The activity that was most prevalent was linked to food consumption and post-food consumption periods. Relative encoding was sensitive to magnitude disparity. A within-session analysis showed strong contrast effects that were dependent upon the outcome received in the immediately preceding trial. Significantly higher numbers of responses were found in ventral striatum linked to relative outcome effects. Our results support the idea that relative value can incorporate diverse relationships, including comparisons from specific individual outcomes to general behavioral contexts. The striatum contains these diverse relative processes, possibly enabling both a higher information yield concerning value shifts and a greater behavioral flexibility.

SUBMITTER: Webber ES

PROVIDER: S-EPMC5089537 | biostudies-literature | 2016 Sep-Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation.

Webber Emily S ES Mankin David E DE Cromwell Howard C HC

eNeuro 20160901 5

The striatum is a key brain region involved in reward processing. Striatal activity has been linked to encoding reward magnitude and integrating diverse reward outcome information. Recent work has supported the involvement of striatum in the valuation of outcomes. The present work extends this idea by examining striatal activity during dynamic shifts in value that include different levels and directions of magnitude disparity. A novel task was used to produce diverse relative reward effects on a ...[more]

PMID: 27822506

Similar Datasets

Project description:Reward-processing involves two temporal stages characterized by two distinct neural processes: reward-anticipation and reward-outcome. Intriguingly, very little research has examined the relationship between neural processes involved in reward-anticipation and reward-outcome. To investigate this, one needs to consider the heterogeneity of reward-processing within each stage. To identify different stages of reward processing, we adapted a reward time-estimation task. While EEG data were recorded, participants were instructed to button-press 3.5s after the onset of an Anticipation-Cue and received monetary reward for good time-estimation on the Reward trials, but not on No-Reward trials. We first separated reward-anticipation into event related potentials (ERPs) occurring at three sub-stages: reward/no-reward cue-evaluation, motor-preparation and feedback-anticipation. During reward/no-reward cue-evaluation, the Reward-Anticipation Cue led to a smaller N2 and larger P3. During motor-preparation, we report, for the first time, that the Reward-Anticipation Cue enhanced the Readiness Potential (RP), starting approximately 1s before movement. At the subsequent feedback-anticipation stage, the Reward-Anticipation Cue elevated the Stimulus-Preceding Negativity (SPN). We also separated reward-outcome ERPs into different components occurring at different time-windows: the Feedback-Related Negativity (FRN), Feedback-P3 (FB-P3) and Late-Positive Potentials (LPP). Lastly, we examined the relationship between reward-anticipation and reward-outcome ERPs. We report that individual-differences in specific reward-anticipation ERPs uniquely predicted specific reward-outcome ERPs. In particular, the reward-anticipation Early-RP (1-.8s before movement) predicted early reward-outcome ERPs (FRN and FB-P3), whereas, the reward-anticipation SPN most strongly predicted a later reward-outcome ERP (LPP). Results have important implications for understanding the nature of the relationship between reward-anticipation and reward-outcome neural-processes.

Project description:Insects and vertebrates harbor specific neurons that encode the animal's head direction (HD) and provide an internal compass for spatial navigation. Each HD cell fires most strongly in one preferred direction. As the animal turns its head, however, HD cells in rat anterodorsal thalamic nucleus (ADN) and other brain areas fire already before their preferred direction is reached, as if the neurons anticipated the future HD. This phenomenon has been explained at a mechanistic level, but a functional interpretation is still missing. To close this gap, we use a computational approach based on the movement statistics of male rats and a simple model for the neural responses within the ADN HD network. Network activity is read out using population vectors in a biologically plausible manner, so that only past spikes are taken into account. We find that anticipatory firing improves the representation of the present HD by reducing the motion-induced temporal bias inherent in causal decoding. The amount of anticipation observed in ADN enhances the precision of the HD compass read-out by up to 40%. More generally, our theoretical framework predicts that neural integration times not only reflect biophysical constraints, but also the statistics of behaviorally relevant stimuli; in particular, anticipatory tuning should be found wherever neurons encode sensory signals that change gradually in time.SIGNIFICANCE STATEMENT Across different brain regions, populations of noisy neurons encode dynamically changing stimuli. Decoding a time-varying stimulus from the population response involves a trade-off: For short read-out times, stimulus estimates are unreliable as the number of stochastic spikes is small; for long read-outs, estimates are biased because they lag behind the true stimulus. We show that optimal decoding of temporally correlated stimuli not only relies on finding the right read-out time window but requires neurons to anticipate future stimulus values. We apply this general framework to the rodent head-direction system and show that the experimentally observed anticipation of future head directions can be explained at a quantitative level from the neuronal tuning properties, network size, and the animal's head-movement statistics.

Project description:Bipolar disorder is characterized by impaired decision-making captured in impulsivity and risk-taking. We sought to determine whether this is driven by a failure to effectively weight the lower-order goal of obtaining a strongly desired reward in relation to higher-order goals, and how this relates to trait impulsivity and risk-taking. We hypothesized that in bipolar disorder the weighting of valuation signals converging on ventromedial prefrontal cortex are more heavily weighted towards ventral striatum inputs (lower-order), with less weighting of dorsolateral prefrontal cortex inputs (higher-order). Twenty euthymic patients with bipolar disorder not in receipt of antipsychotic medication and 20 case-matched controls performed a roulette task during functional magnetic resonance imaging. Activity in response to high-probability ('safe') and low-probability ('risky') prospects was measured during both anticipation, and outcome. In control subjects, anticipatory and outcome-locked activity in dorsolateral prefrontal cortex was greater for safe than risky reward prospects. The bipolar disorder group showed the opposite pattern with preferential response to risky rewards. This group also showed increased anticipatory and outcome-locked activity in ventral striatum in response to rewards. In control subjects, however, ventromedial prefrontal activation was positively associated with both ventral striatum and dorsolateral prefrontal activity; patients evidenced a strong positive association with ventral striatum, but a negative association with dorsolateral prefrontal cortex. Response to high-probability rewards in dorsolateral prefrontal cortex was inversely associated with trait impulsivity and risk-taking in the bipolar disorder group. Our findings suggest that clinically impulsive and risky decision-making are related to subjective valuation that is biased towards lower-order preference, with diminished integration of higher-order goals. The findings extend a functional neuroanatomical account of disorders characterized by clinically impulsive decision-making, and provide targets for evaluating interventions that foster self-control.

Dataset Information

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation.

Publications

Striatal Activity and Reward Relativity: Neural Signals Encoding Dynamic Outcome Valuation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets