Risk of punishment influences discrete and coordinated encoding of reward-guided actions by prefrontal cortex and VTA neurons.
Ontology highlight
ABSTRACT:
SUBMITTER: Park J
PROVIDER: S-EPMC5697935 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:BackgroundWhen exposed to chronic social stress, animals display behavioral changes that are relevant to depressive-like phenotypes. However, the cascading relationship between incremental stress exposure and neural dysfunctions over time remains incompletely understood.MethodsWe characterized the longitudinal effect of social defeat on goal-directed actions and prefrontal cortical activity in mice using a novel head-fixed sucrose preference task and two-photon calcium imaging.ResultsBehaviorally, stress-induced loss of reward sensitivity intensifies over days. Motivational anhedonia, the failure to translate positive reinforcements into future actions, requires multiple sessions of stress exposure to become fully established. For neural activity, individual layer 2/3 pyramidal neurons in the cingulate and medial secondary motor subregions of the medial prefrontal cortex have heterogeneous responses to stress. Changes in ensemble activity differ significantly between susceptible and resilient mice after the first defeat session and continue to diverge following successive stress episodes before reaching persistent abnormal levels.ConclusionsCollectively, these results demonstrate that the cumulative impact of an ethologically relevant stress can be observed at the level of cellular activity of individual prefrontal neurons. The distinct neural responses associated with resilience versus susceptibility suggests the hypothesis that the negative impact of social stress is neutralized in resilient animals, in part through an adaptive reorganization of prefrontal cortical activity.
| S-EPMC7434704 | biostudies-literature
Project description:To invest effort into any cognitive task, people must be sufficiently motivated. Whereas prior research has focused primarily on how the cognitive control required to complete these tasks is motivated by the potential rewards for success, it is also known that control investment can be equally motivated by the potential negative consequence for failure. Previous theoretical and experimental work has yet to examine how positive and negative incentives differentially influence the manner and intensity with which people allocate control. Here, we develop and test a normative model of control allocation under conditions of varying positive and negative performance incentives. Our model predicts, and our empirical findings confirm, that rewards for success and punishment for failure should differentially influence adjustments to the evidence accumulation rate versus response threshold, respectively. This dissociation further enabled us to infer how motivated a given person was by the consequences of success versus failure.
| S-EPMC8746743 | biostudies-literature
Project description:Neuropeptides play an important role in modulating mesolimbic system function. However, while synaptic inputs to the ventral tegmental area (VTA) have been extensively mapped, the sources of many neuropeptides are not well resolved. Here, we mapped the anatomical locations of three neuropeptide inputs to the VTA: neurotensin (NTS), corticotrophin releasing factor (CRF), and neurokinin B (NkB). Among numerous labeled inputs we identified the bed nucleus of the stria terminalis (BNST) as a major source of all three peptides, containing similar numbers of NTS, CRF, and NkB VTA projection neurons. Approximately 50% of BNST to VTA inputs co-expressed two or more of the peptides examined. Consistent with this expression pattern, analysis of calcium dynamics in the terminals of these inputs in the VTA revealed both common and distinct patterns of activation during appetitive and aversive conditioning. These data demonstrate additional diversification of the mesolimbic dopamine system through partially overlapping neuropeptidergic inputs.
| S-EPMC9289195 | biostudies-literature
Project description:Animals form and update learned associations between otherwise neutral sensory cues and aversive outcomes (i.e., punishment) to predict and avoid danger in changing environments. When a cue later occurs without punishment, this unexpected omission of aversive outcome is encoded as reward via activation of reward-encoding dopaminergic neurons. How such activation occurs remains unknown. Using real-time in vivo functional imaging, optogenetics, behavioral analysis and synaptic reconstruction from electron microscopy data, we identify the neural circuit mechanism through which Drosophila reward-encoding dopaminergic neurons are activated when an olfactory cue is unexpectedly no longer paired with electric shock punishment. Reduced activation of punishment-encoding dopaminergic neurons relieves depression of olfactory synaptic inputs to cholinergic neurons. Synaptic excitation by these cholinergic neurons of reward-encoding dopaminergic neurons increases their odor response, thus decreasing aversiveness of the odor. These studies reveal how an excitatory cholinergic relay from punishment- to reward-encoding dopaminergic neurons encodes the absence of punishment as reward, revealing a general circuit motif for updating aversive memories that could be present in mammals.
| S-EPMC7893153 | biostudies-literature
Project description:Orchestrating appropriate behavioral responses in the face of competing signals that predict either rewards or threats in the environment is crucial for survival. The basolateral nucleus of the amygdala (BLA) and prelimbic (PL) medial prefrontal cortex have been implicated in reward-seeking and fear-related responses, but how information flows between these reciprocally connected structures to coordinate behavior is unknown. We recorded neuronal activity from the BLA and PL while rats performed a task wherein competing shock- and sucrose-predictive cues were simultaneously presented. The correlated firing primarily displayed a BLA→PL directionality during the shock-associated cue. Furthermore, BLA neurons optogenetically identified as projecting to PL more accurately predicted behavioral responses during competition than unidentified BLA neurons. Finally photostimulation of the BLA→PL projection increased freezing, whereas both chemogenetic and optogenetic inhibition reduced freezing. Therefore, the BLA→PL circuit is critical in governing the selection of behavioral responses in the face of competing signals.
| S-EPMC5448704 | biostudies-literature
Project description:Multiple and unpredictable numbers of actions are often required to achieve a goal. In order to organize behavior and allocate effort so that optimal behavioral policies can be selected, it is necessary to continually monitor ongoing actions. Real-time processing of information related to actions and outcomes is typically assigned to the prefrontal cortex and basal ganglia, but also depends on midbrain regions, especially the ventral tegmental area (VTA). We were interested in how individual VTA neurons, as well as networks within the VTA, encode salient events when an unpredictable number of serial actions are required to obtain a reward. We recorded from ensembles of putative dopamine and non-dopamine neurons in the VTA as animals performed multiple cued trials in a recording session where, in each trial, serial actions were randomly rewarded. While averaging population activity did not reveal a response pattern, we observed that different neurons were selectively tuned to low, medium, or high numbered actions in a trial. This preferential tuning of putative dopamine and non-dopamine VTA neurons to different subsets of actions in a trial allowed information about binned action number to be decoded from the ensemble activity. At the network level, tuning curve similarity was positively associated with action-evoked noise correlations, suggesting that action number selectivity reflects functional connectivity within these networks. Analysis of phasic responses to cue and reward revealed that the requirement to execute multiple and uncertain numbers of actions weakens both cue-evoked responses and cue-reward response correlation. The functional connectivity and ensemble coding scheme that we observe here may allow VTA neurons to cooperatively provide a real-time account of ongoing behavior. These computations may be critical to cognitive and motivational functions that have long been associated with VTA dopamine neurons.
| S-EPMC5550723 | biostudies-literature
Project description:The prefrontal cortex is a critical neuroanatomical hub for controlling motivated behaviours across mammalian species. In addition to intra-cortical connectivity, prefrontal projection neurons innervate subcortical structures that contribute to reward-seeking behaviours, such as the ventral striatum and midline thalamus. While connectivity among these structures contributes to appetitive behaviours, how projection-specific prefrontal neurons encode reward-relevant information to guide reward seeking is unknown. Here we use in vivo two-photon calcium imaging to monitor the activity of dorsomedial prefrontal neurons in mice during an appetitive Pavlovian conditioning task. At the population level, these neurons display diverse activity patterns during the presentation of reward-predictive cues. However, recordings from prefrontal neurons with resolved projection targets reveal that individual corticostriatal neurons show response tuning to reward-predictive cues, such that excitatory cue responses are amplified across learning. By contrast, corticothalamic neurons gradually develop new, primarily inhibitory responses to reward-predictive cues across learning. Furthermore, bidirectional optogenetic manipulation of these neurons reveals that stimulation of corticostriatal neurons promotes conditioned reward-seeking behaviour after learning, while activity in corticothalamic neurons suppresses both the acquisition and expression of conditioned reward seeking. These data show how prefrontal circuitry can dynamically control reward-seeking behaviour through the opposing activities of projection-specific cell populations.
| S-EPMC5772935 | biostudies-literature
Project description:The activity of ventral tegmental area (VTA) dopamine (DA) neurons promotes behavioral responses to rewards and environmental stimuli that predict them. VTA GABA inputs synapse directly onto DA neurons and may regulate DA neuronal activity to alter reward-related behaviors; however, the functional consequences of selective activation of VTA GABA neurons remains unknown. Here, we show that in vivo optogenetic activation of VTA GABA neurons disrupts reward consummatory behavior but not conditioned anticipatory behavior in response to reward-predictive cues. In addition, direct activation of VTA GABA projections to the nucleus accumbens (NAc) resulted in detectable GABA release but did not alter reward consumption. Furthermore, optogenetic stimulation of VTA GABA neurons directly suppressed the activity and excitability of neighboring DA neurons as well as the release of DA in the NAc, suggesting that the dynamic interplay between VTA DA and GABA neurons can control the initiation and termination of reward-related behaviors.
| S-EPMC3314244 | biostudies-literature
Project description:Alongside impulsive suicide attempts, clinicians encounter highly premeditated suicidal acts, particularly in older adults. We have previously found that in contrast to the more impulsive suicide attempters' inability to delay gratification, serious and highly planned suicide attempts were associated with greater willingness to wait for larger rewards. This study examined neural underpinnings of intertemporal preference in suicide attempters. We expected that impulsivity and suicide attempts, particularly poorly planned ones, would predict altered paralimbic subjective value representations. We also examined lateral prefrontal and paralimbic correlates of premeditation in suicidal behavior.A total of 48 participants aged 46-90 years underwent extensive clinical and cognitive characterization and completed the delay discounting task in the scanner: 26 individuals with major depression (13 with and 13 without history of suicide attempts) and 22 healthy controls.More impulsive individuals displayed greater activation in the precuneus/posterior cingulate cortex (PCC) to value difference favoring the delayed option. Suicide attempts, particularly better-planned ones, were associated with deactivation of the lateral prefrontal cortex (lPFC) in response to value difference favoring the immediate option. Findings were robust to medication exposure, depression severity and possible brain damage from suicide attempts, among other confounders. Finally, in suicide attempters longer reward delays were associated with diminished parahippocampal responses.Impulsivity was associated with an altered paralimbic (precuneus/PCC) encoding of value difference during intertemporal choice. By contrast, better-planned suicidal acts were associated with altered lPFC representations of value difference. The study provides preliminary evidence of impaired decision processes in both impulsive and premeditated suicidal behavior.
| S-EPMC4797639 | biostudies-literature
Project description:A team contest entails both public good characteristics within the teams as well as a contest across teams. In an experimental study, we analyse behaviour in such a team contest when allowing to punish or to reward other team members. Moreover, we compare two types of contest environment: One in which two teams compete for a prize and another one in which we switch off the between-group element of the contest. We find that reward giving, as opposed to punishing, induces higher contributions to the team contest. Furthermore, expenditures on rewarding other co-players are significantly higher than those for punishing.
| S-EPMC7498014 | biostudies-literature