Validating Habitual and Goal-Directed Decision-Making Performance Online in Healthy Older Adults.
Ontology highlight
ABSTRACT:
SUBMITTER: Ito KL
PROVIDER: S-EPMC8276057 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The prelimbic prefrontal cortex is necessary for associating actions with their consequences, enabling goal-directed decision making. We find that the strength of action-outcome conditioning correlates with dendritic spine density in prelimbic cortex, suggesting that new action-outcome learning involves dendritic spine plasticity. To test this, we inhibited the cytoskeletal regulatory factor Rho kinase. We find that the inhibitor fasudil enhances action-outcome memory, resulting in goal-directed behavior in mice that would otherwise express stimulus-response habits. Fasudil transiently reduces prelimbic cortical dendritic spine densities during a period of presumed memory consolidation, but only when paired with new learning. Fasudil also blocks habitual responding for cocaine, an effect that persists over time, across multiple contexts, and depends on actin polymerization. We suggest that Rho kinase inhibition promotes goal-oriented action selection by augmenting the plasticity of prelimbic cortical dendritic spines during the formation of new action-outcome memories.
| S-EPMC5707361 | biostudies-literature
Project description:When we plan for long-range goals, proximal information cannot be exploited in a blindly myopic way, as relevant future information must also be considered. But when a subgoal must be resolved first, irrelevant future information should not interfere with the processing of more proximal, subgoal-relevant information. We explore the idea that decision making in both situations relies on the flexible modulation of the degree to which different pieces of information under consideration are weighted, rather than explicitly decomposing a problem into smaller parts and solving each part independently. We asked participants to find the shortest goal-reaching paths in mazes and modeled their initial path choices as a noisy, weighted information integration process. In a base task where choosing the optimal initial path required weighting starting-point and goal-proximal factors equally, participants did take both constraints into account, with participants who made more accurate choices tending to exhibit more balanced weighting. The base task was then embedded as an initial subtask in a larger maze, where the same two factors constrained the optimal path to a subgoal, and the final goal position was irrelevant to the initial path choice. In this more complex task, participants' choices reflected predominant consideration of the subgoal-relevant constraints, but also some influence of the initially-irrelevant final goal. More accurate participants placed much less weight on the optimality-irrelevant goal and again tended to weight the two initially-relevant constraints more equally. These findings suggest that humans may rely on a graded, task-sensitive weighting of multiple constraints to generate approximately optimal decision outcomes in both hierarchical and non-hierarchical goal-directed tasks.
| S-EPMC9255770 | biostudies-literature
Project description:IntroductionHarmful behavior such as smoking may reflect a disturbance in the balance of goal-directed and habitual control. Animal models suggest that habitual control develops after prolonged substance use. In this study, we investigated whether smokers (N = 49) differ from controls (N = 46) in the regulation of goal-directed and habitual behavior. It was also investigated whether individual differences in nicotine dependence levels were associated with habitual responding.MethodsWe used two different multistage instrumental learning tasks that consist of an instrumental learning phase, subsequent outcome devaluation, and a testing phase to measure the balance between goal-directed and habitual responding. The testing phases of these tasks occurred after either appetitive versus avoidance instrumental learning. The appetitive versus aversive instrumental learning stages in the two different tasks modeled positive versus negative reinforcement, respectively.ResultsSmokers and nonsmoking controls did not differ on habitual versus goal-directed control in either task. Individual differences in nicotine dependence within the group of smokers, however, were positively associated with habitual responding after appetitive instrumental learning. This effect seems to be due to impaired stimulus-outcome learning, thereby hampering goal-directed task performance and tipping the balance to habitual responding.ConclusionsThe current finding highlights the importance of individual differences within smokers. For future research, neuroimaging studies are suggested to further unravel the nature of the imbalance between goal-directed versus habitual control in severely dependent smokers by directly measuring activity in the corresponding brain systems.ImplicationsGoal-directed versus habitual behavior in substance use and addiction is highly debated. This study investigated goal-directed versus habitual control in smokers. The findings suggest that smokers do not differ from controls in goal-directed versus habitual control. Individual differences in nicotine dependence within smokers, however, were positively associated with habitual responding after appetitive instrumental learning. This effect seems to be due to impaired stimulus-outcome learning, thereby hampering goal-directed task performance and tipping the balance to habitual responding. These findings add to the ongoing debate on habitual versus goal-directed control in addiction and emphasize the importance of individual differences within smokers.
| S-EPMC7004226 | biostudies-literature
Project description:During goal-directed decision-making, animals must integrate information from the external environment and their internal state to maximize resource localization while minimizing energy expenditure. How this complex problem is solved by the nervous system remains poorly understood. Here, using a combined behavioural and neurophysiological approach, we demonstrate that the mollusc Lymnaea performs a sophisticated form of decision-making during food-searching behaviour, using a core system consisting of just two neuron types. The first reports the presence of food and the second encodes motivational state acting as a gain controller for adaptive behaviour in the absence of food. Using an in vitro analogue of the decision-making process, we show that the system employs an energy management strategy, switching between a low- and high-use mode depending on the outcome of the decision. Our study reveals a parsimonious mechanism that drives a complex decision-making process via regulation of levels of tonic inhibition and phasic excitation.
| S-EPMC4895806 | biostudies-other
Project description:Our daily decisions are governed by the arbitration between goal-directed and habitual strategies. However, the neurochemical basis of this arbitration is unclear. We assessed the contribution of dopaminergic, serotonergic, and opioidergic systems to this balance across reward and loss domains. Thirty-nine participants (17 healthy controls, 15 patients with pathological gambling, and 7 with binge eating disorder) underwent positron emission tomography (PET) imaging with [18F]FDOPA, [11C]MADAM and [11C]carfentanil to assess presynaptic dopamine, and serotonin transporter and mu-opioid receptor binding potential. Separately, participants completed a modified two-step task, which quantifies the degree to which decision-making is influenced by goal-directed or habitual strategies. All participants completed a version with reward outcomes; healthy controls additionally completed a version with loss outcomes. In the context of rewarding outcomes, we found that greater serotonin transporter binding potential in prefrontal regions was associated with habitual control, while greater serotonin transporter binding potential in the putamen was marginally associated with goal-directed control; however, the findings were no longer significant when controlling for the opposing valence (loss). In blocks with loss outcomes, we found that the opioidergic system, specifically greater [11C]carfentanil binding potential, was positively associated with goal-directed control and negatively associated with habit-directed control. Our findings illuminate the complex neurochemical basis of goal-directed and habitual behavior, implicating differential roles for prefrontal and subcortical serotonin in decision-making across healthy and pathological populations.
| S-EPMC7054261 | biostudies-literature
Project description:Recent work has given rise to the view that reward-based decision making is governed by two key controllers: a habit system, which stores stimulus-response associations shaped by past reward, and a goal-oriented system that selects actions based on their anticipated outcomes. The current literature provides a rich body of computational theory addressing habit formation, centering on temporal-difference learning mechanisms. Less progress has been made toward formalizing the processes involved in goal-directed decision making. We draw on recent work in cognitive neuroscience, animal conditioning, cognitive and developmental psychology, and machine learning to outline a new theory of goal-directed decision making. Our basic proposal is that the brain, within an identifiable network of cortical and subcortical structures, implements a probabilistic generative model of reward, and that goal-directed decision making is effected through Bayesian inversion of this model. We present a set of simulations implementing the account, which address benchmark behavioral and neuroscientific findings, and give rise to a set of testable predictions. We also discuss the relationship between the proposed framework and other models of decision making, including recent models of perceptual choice, to which our theory bears a direct connection.
| S-EPMC3767755 | biostudies-literature
Project description:RATIONALE: Across species, serotonin (5-HT) depletion in the prefrontal cortex (PFC) has been shown to cause impaired performance on tests of cognitive flexibility and the processing of affective information (e.g. information with an 'emotional' content). While recent work has explored the specific role of the orbital PFC herein, the role of the medial PFC remains unclear. OBJECTIVES: The aim of our current experiments was to study the role of medial PFC 5-HT in both the processing of affective information and reversal learning across stimulus modalities. MATERIALS AND METHODS: To this end, we selectively destroyed 5-HT terminals in the medial PFC of male Wistar rats by means of local infusion of the toxin 5,7-dihydroxytryptamine. Both control and lesioned animals were tested in two reversal learning paradigms with either spatial or odour cues and an affective switch from non-preferred to preferred food rewards. RESULTS: Our results indicate that a pellet switch during reversal learning impaired performance in control animals but not in lesioned animals, independent of the stimulus modality. CONCLUSION: These results indicate that lesioned animals are not guided in their behaviour by the affective value of the reward like intact animals and thus that medial prefrontal 5-HT is needed for affective processing in goal-directed behaviour.
| S-EPMC2080349 | biostudies-other
Project description:Decision-making in the real world presents the challenge of requiring flexible yet prompt behavior, a balance that has been characterized in terms of a trade-off between a slower, prospective goal-directed model-based (MB) strategy and a fast, retrospective habitual model-free (MF) strategy. Theory predicts that flexibility to changes in both reward values and transition contingencies can determine the relative influence of the two systems in reinforcement learning, but few studies have manipulated the latter. Therefore, we developed a novel two-level contingency change task in which transition contingencies between states change every few trials; MB and MF control predict different responses following these contingency changes, allowing their relative influence to be inferred. Additionally, we manipulated the rate of contingency changes in order to determine whether contingency change volatility would play a role in shifting subjects between a MB and MF strategy. We found that human subjects employed a hybrid MB/MF strategy on the task, corroborating the parallel contribution of MB and MF systems in reinforcement learning. Further, subjects did not remain at one level of MB/MF behaviour but rather displayed a shift towards more MB behavior over the first two blocks that was not attributable to the rate of contingency changes but rather to the extent of training. We demonstrate that flexibility to contingency changes can distinguish MB and MF strategies, with human subjects utilizing a hybrid strategy that shifts towards more MB behavior over blocks, consequently corresponding to a higher payoff.
| S-EPMC5634647 | biostudies-literature
Project description:Shifting between goal-directed and habitual actions allows for efficient and flexible decision making. Here we demonstrate a novel, within-subject instrumental lever-pressing paradigm, in which mice shift between goal-directed and habitual actions. We identify a role for orbitofrontal cortex (OFC) in actions following outcome revaluation, and confirm that dorsal medial (DMS) and lateral striatum (DLS) mediate different action strategies. Simultaneous in vivo recordings of OFC, DMS and DLS neuronal ensembles during shifting reveal that the same neurons display different activities depending on whether presses are goal-directed or habitual, with DMS and OFC becoming more and DLS less engaged during goal-directed actions. Importantly, the magnitude of neural activity changes in OFC following changes in outcome value positively correlates with the level of goal-directed behavior. Chemogenetic inhibition of OFC disrupts goal-directed actions, whereas optogenetic activation of OFC specifically increases goal-directed pressing. These results also reveal a role for OFC in action revaluation, which has implications for understanding compulsive behavior.
| S-EPMC4026062 | biostudies-literature
Project description:Behavioral and neural evidence reveal a prospective goal-directed decision process that relies on mental simulation of the environment, and a retrospective habitual process that caches returns previously garnered from available choices. Artificial systems combine the two by simulating the environment up to some depth and then exploiting habitual values as proxies for consequences that may arise in the further future. Using a three-step task, we provide evidence that human subjects use such a normative plan-until-habit strategy, implying a spectrum of approaches that interpolates between habitual and goal-directed responding. We found that increasing time pressure led to shallower goal-directed planning, suggesting that a speed-accuracy tradeoff controls the depth of planning with deeper search leading to more accurate evaluation, at the cost of slower decision-making. We conclude that subjects integrate habit-based cached values directly into goal-directed evaluations in a normative manner.
| S-EPMC5111694 | biostudies-literature