Reward-Based Learning Drives Rapid Sensory Signals in Medial Prefrontal Cortex and Dorsal Hippocampus Necessary for Goal-Directed Behavior.
Ontology highlight
ABSTRACT:
SUBMITTER: Le Merre P
PROVIDER: S-EPMC5766832 | biostudies-other | 2018 Jan
REPOSITORIES: biostudies-other
Similar Datasets
Project description:Converging evidence from studies with animals and humans have implicated separate regions of the medial prefrontal cortex (mPFC) corresponding to the anterior cingulate cortex (ACC), in mediating different aspects of reward-related decisions involving uncertainty or risk. However, the dissociable contributions of subregions of the ACC remain unclear, as discrepancies exist between human neuroimaging findings and preclinical rodent studies. To clarify how ventral vs. dorsal regions of the mPFC contribute to risk/reward decision making, the present study assessed the effects of inactivation of different subregions on performance of a "Blackjack task" that measured cue-guided decision making and shares similarities with paradigms used with humans. Male, Long-Evans rats were well-trained to choose between a Small/Certain reward vs a Large/Risky reward delivered with variable probabilities (i.e., good vs. poor-odds, 50% vs. 12.5%). The odds of obtaining the larger reward was signaled by auditory cues at the start of each trial. Inactivation of the ventral, infralimbic region of the mPFC increased risky choice selectively when the odds of winning were poor. By contrast, inactivation of the prelimbic and anterior cingulate regions of the dorsal mPFC led to suboptimal reductions in risky choice on good-odds trials. The effects of prelimbic vs anterior cingulate inactivations were associated with context-dependent alterations in reward vs negative feedback, respectively. These results further clarify the distinct yet complementary manners in which separate ACC regions promote optimal risk/reward decision making and complement neuroimaging findings that activity in human ventral vs dorsal ACC promotes risk aversion or risky choices.
| S-EPMC7021677 | biostudies-literature
Project description:The hippocampus may play a role in categorization because of the need to differentiate stimulus categories (pattern separation) and to recognize category membership of stimuli from partial information (pattern completion). We hypothesized that the hippocampus would be more crucial for categorization of low-density (few relevant features) stimuli-due to the higher demand on pattern separation and pattern completion-than for categorization of high-density (many relevant features) stimuli. Using a touchscreen apparatus, rats were trained to categorize multiple abstract stimuli into two different categories. Each stimulus was a pentagonal configuration of five visual features; some of the visual features were relevant for defining the category whereas others were irrelevant. Two groups of rats were trained with either a high (dense, n?=?8) or low (sparse, n?=?8) number of category-relevant features. Upon reaching criterion discrimination (?75% correct, on 2 consecutive days), bilateral cannulas were implanted in the dorsal hippocampus. The rats were then given either vehicle or muscimol infusions into the hippocampus just prior to various testing sessions. They were tested with: the previously trained stimuli (trained), novel stimuli involving new irrelevant features (novel), stimuli involving relocated features (relocation), and a single relevant feature (singleton). In training, the dense group reached criterion faster than the sparse group, indicating that the sparse task was more difficult than the dense task. In testing, accuracy of both groups was equally high for trained and novel stimuli. However, both groups showed impaired accuracy in the relocation and singleton conditions, with a greater deficit in the sparse group. The testing data indicate that rats encode both the relevant features and the spatial locations of the features. Hippocampal inactivation impaired visual categorization regardless of the density of the category-relevant features for the trained, novel, relocation, and singleton stimuli. Hippocampus-mediated pattern completion and pattern separation mechanisms may be necessary for visual categorization involving overlapping irrelevant features.
| S-EPMC5992064 | biostudies-literature
Project description:BackgroundSuccessful social interaction relies on the ability to attribute mental states to other people. Previous functional neuroimaging studies have shown that this process, described as Theory of Mind (ToM) or mentalization, is reliably associated with activation of the medial prefrontal cortex (mPFC). However, this study presents a novel and surprising finding that provides new insight into the role of the mPFC in mentalization tasks.Methodology/principal findingsTwenty healthy individuals were recruited from a wide range of ages and social backgrounds. Participants underwent functional magnetic resonance imaging (fMRI) while viewing a well-established ToM visual paradigm involving moving triangles. Functional MRI data were analyzed using a classical general linear model. No activation was detected in the medial prefrontal cortex (mPFC) during movement patterns that typically elicit ToM. However, increased activity was observed in the right middle occipital gyrus, right temporoparietal junction (TPJ), left middle occipital gyrus and right inferior frontal gyrus. No correlation was found between participants' age and BOLD response.Conclusions/significanceIn contrast with previous neuroimaging research, our findings support the notion that mPFC function is not critical for reasoning about the mental states of others; furthermore, our data indicate that the right TPJ and right inferior frontal gyrus are able to perform mentalization without any contributions from the mPFC.
| S-EPMC4547759 | biostudies-literature
Project description:The dorsal raphe nucleus (DRN) is involved in organizing reward-related behaviours; however, it remains unclear how genetically defined neurons in the DRN of a freely behaving animal respond to various natural rewards. Here we addressed this question using fibre photometry and single-unit recording from serotonin (5-HT) neurons and GABA neurons in the DRN of behaving mice. Rewards including sucrose, food, sex and social interaction rapidly activate 5-HT neurons, but aversive stimuli including quinine and footshock do not. Both expected and unexpected rewards activate 5-HT neurons. After mice learn to wait for sucrose delivery, most 5-HT neurons fire tonically during waiting and then phasically on reward acquisition. Finally, GABA neurons are activated by aversive stimuli but inhibited when mice seek rewards. Thus, DRN 5-HT neurons positively encode a wide range of reward signals during anticipatory and consummatory phases of reward responses. Moreover, GABA neurons play a complementary role in reward processing.
| S-EPMC4738365 | biostudies-literature
Project description:Pain has been found to promote reward-seeking behaviors, which might be a consequence of modulated brain activities in the reward neural circuitry in a painful state. The present study investigated how pain affected reward processing and reward-related neural activities using fMRI technique. A total of 50 healthy participants were recruited and used for data analyses, with half being treated with topical capsaicin cream and the other half with hand cream (treatment: pain or control). The participants were asked to perform a card-guessing game when their brain activities responding to feedbacks (outcome: win or loss) were recorded. Behavioral results showed that participants in pain group overestimated their correct choices in the card-guess game. Whole-brain fMRI analysis revealed that the main effect of outcome (win vs. loss) activated a typical network of the reward neural circuitry, including the medial prefrontal cortex (mPFC) and the bilateral nucleus accumbens (NAcc). Importantly, the region of interest analysis revealed a significant interaction of treatment and outcome in the mPFC, with increased mPFC neural activity responding to win outcome in pain condition. Moreover, the functional connectivity between the mPFC and the NAcc was decreased in pain condition. We conclude that the pain-induced modulation of the mPFC activity could result in alterations of both the emotional response to and the cognitive evaluation of reward.
| S-EPMC7267926 | biostudies-literature
Project description:Major depressive disorder is a leading cause of disability and significant mortality, yet mechanistic understanding remains limited. Over the past decade evidence has accumulated from case-control studies that depressive illness is associated with blunted reward activation in the basal ganglia and other regions such as the medial prefrontal cortex. However it is unclear whether this finding can be replicated in a large number of subjects. The functional anatomy of the medial prefrontal cortex and basal ganglia has been extensively studied and the former has excitatory glutamatergic projections to the latter. Reduced effect of glutamatergic projections from the prefrontal cortex to the nucleus accumbens has been argued to underlie motivational disorders such as depression, and many prominent theories of major depressive disorder propose a role for abnormal cortico-limbic connectivity. However, it is unclear whether there is abnormal reward-linked effective connectivity between the medial prefrontal cortex and basal ganglia related to depression. While resting state connectivity abnormalities have been frequently reported in depression, it has not been possible to directly link these findings to reward-learning studies. Here, we tested two main hypotheses. First, mood symptoms are associated with blunted striatal reward prediction error signals in a large community-based sample of recovered and currently ill patients, similar to reports from a number of studies. Second, event-related directed medial prefrontal cortex to basal ganglia effective connectivity is abnormally increased or decreased related to the severity of mood symptoms. Using a Research Domain Criteria approach, data were acquired from a large community-based sample of subjects who participated in a probabilistic reward learning task during event-related functional MRI. Computational modelling of behaviour, model-free and model-based functional MRI, and effective connectivity dynamic causal modelling analyses were used to test hypotheses. Increased depressive symptom severity was related to decreased reward signals in areas which included the nucleus accumbens in 475 participants. Decreased reward-related effective connectivity from the medial prefrontal cortex to striatum was associated with increased depressive symptom severity in 165 participants. Decreased striatal activity may have been due to decreased cortical to striatal connectivity consistent with glutamatergic and cortical-limbic related theories of depression and resulted in reduced direct pathway basal ganglia output. Further study of basal ganglia pathophysiology is required to better understand these abnormalities in patients with depressive symptoms and syndromes.
| S-EPMC7296844 | biostudies-literature
Project description:Previous neuroimaging studies have suggested that the experience of flow aligns with a relative increase in activation of the dorsal raphe nucleus (DRN), and relative activation decreases of the medial prefrontal cortex (MPFC) and of the amygdala (AMY). In the present study, Dynamic Causal Modeling (DCM) was used to explore effective connectivity between those brain regions. To test our hypothesis that the DRN causally down-regulates activity of the MPFC and/or of the AMY, 23 healthy male students solved mental arithmetic tasks of varying difficulty during functional magnetic resonance imaging. A "flow" condition, with task demands automatically balanced with participants' skill level, was compared with conditions of "boredom" and "overload". DCM models were constructed modeling full reciprocal endogenous connections between the DRN, the MPFC, the AMY, and the calcarine. The calcarine was included to allow sensory input to enter the system. Experimental conditions were modeled as exerting modulatory effects on various possible connections between the DRN, the MPFC, and the AMY, but not on self-inhibitory connections, yielding a total of 64 alternative DCM models. Model space was partitioned into eight families based on commonalities in the arrangement of the modulatory effects. Random effects Bayesian Model Selection (BMS) was applied to identify a possible winning family (and model). Although BMS revealed a clear winning family, an outstanding winning model could not be identified. Therefore, Bayesian Model Averaging was performed over models within the winning family to obtain representative DCM parameters for subsequent analyses to test our hypothesis. In line with our expectations, Bayesian averaged parameters revealed stronger down-regulatory influence of the DRN on the MPFC when participants experienced flow relative to control conditions. In addition, these condition-dependent modulatory effects significantly predicted participants' experienced degree of flow. The AMY was down-regulated irrespective of condition. The present results suggest a causal role for the DRN in modulating the MPFC, contributing to the experience of flow.
| S-EPMC5011146 | biostudies-literature
Project description:Animals make predictions based on currently available information. In natural settings, sensory cues may not reveal complete information, requiring the animal to infer the "hidden state" of the environment. The brain structures important in hidden state inference remain unknown. A previous study showed that midbrain dopamine neurons exhibit distinct response patterns depending on whether reward is delivered in 100% (task 1) or 90% of trials (task 2) in a classical conditioning task. Here we found that inactivation of the medial prefrontal cortex (mPFC) affected dopaminergic signaling in task 2, in which the hidden state must be inferred ("will reward come or not?"), but not in task 1, where the state was known with certainty. Computational modeling suggests that the effects of inactivation are best explained by a circuit in which the mPFC conveys inference over hidden states to the dopamine system. VIDEO ABSTRACT.
| S-EPMC5934341 | biostudies-literature
Project description:Making a risky decision is a complex process that involves evaluation of both the value of the options and the associated risk level. Yet the neural processes underlying these processes have not so far been clearly identified. Using functional magnetic resonance imaging and a task that simulates risky decisions, we found that the dorsal region of the medial prefrontal cortex (MPFC) was activated whenever a risky decision was made, but the degree of this activity across subjects was negatively correlated with their risk preference. In contrast, the ventral MPFC was parametrically modulated by the received gain/loss, and the activation in this region was positively correlated with an individual's risk preference. These results extend existing neurological evidence by showing that the dorsal and ventral MPFC convey different decision signals (i.e., aversion to uncertainty vs. approach to rewarding outcomes), where the relative strengths of these signals determine behavioral decisions involving risk and uncertainty.
| S-EPMC2665154 | biostudies-literature
Project description:Goal-directed attention is usually studied by providing individuals with explicit instructions on what they should attend to. But in daily life, we often use past experiences to guide our attentional states. Given the importance of memory for predicting upcoming events, we hypothesized that memory-guided attention is supported by neural preparation for anticipated attentional states. We examined preparatory coding in the human hippocampus and mPFC, two regions that are important for memory-guided behaviors, in two tasks: one where attention was guided by memory and another in which attention was explicitly instructed. Hippocampus and mPFC exhibited higher activity for memory-guided vs. explicitly instructed attention. Furthermore, representations in both regions contained information about upcoming attentional states. In the hippocampus, this preparation was stronger for memory-guided attention, and occurred alongside stronger coupling with visual cortex during attentional guidance. These results highlight the mechanisms by which memories are used to prepare for upcoming attentional goals.
| S-EPMC7237206 | biostudies-literature