Automatic inhibition of habitual response associated with a non-target object while performing goal-directed actions.
Ontology highlight
ABSTRACT:
SUBMITTER: Vainio L
PROVIDER: S-EPMC8044604 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Shifting between goal-directed and habitual actions allows for efficient and flexible decision making. Here we demonstrate a novel, within-subject instrumental lever-pressing paradigm, in which mice shift between goal-directed and habitual actions. We identify a role for orbitofrontal cortex (OFC) in actions following outcome revaluation, and confirm that dorsal medial (DMS) and lateral striatum (DLS) mediate different action strategies. Simultaneous in vivo recordings of OFC, DMS and DLS neuronal ensembles during shifting reveal that the same neurons display different activities depending on whether presses are goal-directed or habitual, with DMS and OFC becoming more and DLS less engaged during goal-directed actions. Importantly, the magnitude of neural activity changes in OFC following changes in outcome value positively correlates with the level of goal-directed behavior. Chemogenetic inhibition of OFC disrupts goal-directed actions, whereas optogenetic activation of OFC specifically increases goal-directed pressing. These results also reveal a role for OFC in action revaluation, which has implications for understanding compulsive behavior.
| S-EPMC4026062 | biostudies-literature
Project description:Behavioral evidence suggests that instrumental conditioning is governed by two forms of action control: a goal-directed and a habit learning process. Model-based reinforcement learning (RL) has been argued to underlie the goal-directed process; however, the way in which it interacts with habits and the structure of the habitual process has remained unclear. According to a flat architecture, the habitual process corresponds to model-free RL, and its interaction with the goal-directed process is coordinated by an external arbitration mechanism. Alternatively, the interaction between these systems has recently been argued to be hierarchical, such that the formation of action sequences underlies habit learning and a goal-directed process selects between goal-directed actions and habitual sequences of actions to reach the goal. Here we used a two-stage decision-making task to test predictions from these accounts. The hierarchical account predicts that, because they are tied to each other as an action sequence, selecting a habitual action in the first stage will be followed by a habitual action in the second stage, whereas the flat account predicts that the statuses of the first and second stage actions are independent of each other. We found, based on subjects' choices and reaction times, that human subjects combined single actions to build action sequences and that the formation of such action sequences was sufficient to explain habitual actions. Furthermore, based on Bayesian model comparison, a family of hierarchical RL models, assuming a hierarchical interaction between habit and goal-directed processes, provided a better fit of the subjects' behavior than a family of flat models. Although these findings do not rule out all possible model-free accounts of instrumental conditioning, they do show such accounts are not necessary to explain habitual actions and provide a new basis for understanding how goal-directed and habitual action control interact.
| S-EPMC3854489 | biostudies-literature
Project description:IntroductionHarmful behavior such as smoking may reflect a disturbance in the balance of goal-directed and habitual control. Animal models suggest that habitual control develops after prolonged substance use. In this study, we investigated whether smokers (N = 49) differ from controls (N = 46) in the regulation of goal-directed and habitual behavior. It was also investigated whether individual differences in nicotine dependence levels were associated with habitual responding.MethodsWe used two different multistage instrumental learning tasks that consist of an instrumental learning phase, subsequent outcome devaluation, and a testing phase to measure the balance between goal-directed and habitual responding. The testing phases of these tasks occurred after either appetitive versus avoidance instrumental learning. The appetitive versus aversive instrumental learning stages in the two different tasks modeled positive versus negative reinforcement, respectively.ResultsSmokers and nonsmoking controls did not differ on habitual versus goal-directed control in either task. Individual differences in nicotine dependence within the group of smokers, however, were positively associated with habitual responding after appetitive instrumental learning. This effect seems to be due to impaired stimulus-outcome learning, thereby hampering goal-directed task performance and tipping the balance to habitual responding.ConclusionsThe current finding highlights the importance of individual differences within smokers. For future research, neuroimaging studies are suggested to further unravel the nature of the imbalance between goal-directed versus habitual control in severely dependent smokers by directly measuring activity in the corresponding brain systems.ImplicationsGoal-directed versus habitual behavior in substance use and addiction is highly debated. This study investigated goal-directed versus habitual control in smokers. The findings suggest that smokers do not differ from controls in goal-directed versus habitual control. Individual differences in nicotine dependence within smokers, however, were positively associated with habitual responding after appetitive instrumental learning. This effect seems to be due to impaired stimulus-outcome learning, thereby hampering goal-directed task performance and tipping the balance to habitual responding. These findings add to the ongoing debate on habitual versus goal-directed control in addiction and emphasize the importance of individual differences within smokers.
| S-EPMC7004226 | biostudies-literature
Project description:Habituated response tendency associated with affordance of an object is automatically inhibited if this affordance cue is extracted from a non-target object. This study presents two go/no-go experiments investigating whether this response control operates in response selection processes and whether it is linked to conflict-monitoring mechanisms. In the first experiment, the participants performed responses with one hand, and in the second experiment, with two hands. In addition, both experiments consisted of two blocks with varying frequency of go conditions (25%-go vs. 75%-go). The non-target-related response inhibition effect was only observed in Experiment 2 when the task required selecting between two hands. Additionally, the results did not reveal patterns typically related to conflict monitoring when go-frequency is manipulated and when a stimulus-response compatibility effect is examined relative to congruency condition of the previous trial. The study shows that the non-target-related response inhibition assists hand selection and is relatively resistant to conflict-monitoring processes.
| S-EPMC8475350 | biostudies-literature
Project description:Our daily decisions are governed by the arbitration between goal-directed and habitual strategies. However, the neurochemical basis of this arbitration is unclear. We assessed the contribution of dopaminergic, serotonergic, and opioidergic systems to this balance across reward and loss domains. Thirty-nine participants (17 healthy controls, 15 patients with pathological gambling, and 7 with binge eating disorder) underwent positron emission tomography (PET) imaging with [18F]FDOPA, [11C]MADAM and [11C]carfentanil to assess presynaptic dopamine, and serotonin transporter and mu-opioid receptor binding potential. Separately, participants completed a modified two-step task, which quantifies the degree to which decision-making is influenced by goal-directed or habitual strategies. All participants completed a version with reward outcomes; healthy controls additionally completed a version with loss outcomes. In the context of rewarding outcomes, we found that greater serotonin transporter binding potential in prefrontal regions was associated with habitual control, while greater serotonin transporter binding potential in the putamen was marginally associated with goal-directed control; however, the findings were no longer significant when controlling for the opposing valence (loss). In blocks with loss outcomes, we found that the opioidergic system, specifically greater [11C]carfentanil binding potential, was positively associated with goal-directed control and negatively associated with habit-directed control. Our findings illuminate the complex neurochemical basis of goal-directed and habitual behavior, implicating differential roles for prefrontal and subcortical serotonin in decision-making across healthy and pathological populations.
| S-EPMC7054261 | biostudies-literature
Project description:What are the cortical neural correlates that distinguish goal-directed and non-goal-directed movements? We investigated this question in the monkey frontal eye field (FEF), which is implicated in voluntary control of saccades. Here, we compared FEF activity associated with goal-directed (G) saccades and non-goal-directed (nG) saccades made by the monkey. Although the FEF neurons discharged before these nG saccades, there were three major differences in the neural activity: First, the variability in spike rate across trials decreased only for G saccades. Second, the local field potential beta-band power decreased during G saccades but did not change during nG saccades. Third, the time from saccade direction selection to the saccade onset was significantly longer for G saccades compared with nG saccades. Overall, our results reveal unexpected differences in neural signatures for G versus nG saccades in a brain area that has been implicated selectively in voluntary control. Taken together, these data add critical constraints to the way we think about saccade generation in the brain.
| S-EPMC8017686 | biostudies-literature
Project description:Understanding of other's actions as goal-directed is considered a fundamental ability underlying cognitive and social development in human infants. A number of studies using the habituation-dishabituation paradigm have shown that the ability to discern intentional relations, in terms of goal-directedness of an action towards an object, appears around 5 months of age. The question of whether non-human species can perceive other's actions as goal-directed has been more controversial, however there is mounting evidence that at least some primates species do. Recently domestic dogs have been shown to be particularly sensitive to human communicative cues and more so in cooperative and intentional contexts. Furthermore, they have been shown to imitate selectively. Taken together these results suggest that dogs may perceive others' actions as goal-directed, however no study has investigated this issue directly. In the current study, adopting an infant habituation-dishabituation paradigm, we investigated whether dogs attribute intentions to an animate (a human) but not an inanimate (a black box) agent interacting with an object. Following an habituation phase in which the agent interacted always with one of two objects, two sets of 3 trials were presented: new side trials (in which the agent interacted with the same object as in the habituation trial but placed in a novel location) and new goal trials (in which the agent interacted with the other object placed in the old location). Dogs showed a similar pattern of response to that shown in infants, looking longer in the new goal than new side trials when they saw the human agent interact with the object. No such difference emerging with the inanimate agent (the black box). Results provide the first evidence that a non-primate species can perceive another individual's actions as goal-directed. We discuss results in terms of the prevailing mentalisitic and non-mentalistic hypotheses regarding goal-attribution.
| S-EPMC4167693 | biostudies-literature
Project description:Decision-making in the real world presents the challenge of requiring flexible yet prompt behavior, a balance that has been characterized in terms of a trade-off between a slower, prospective goal-directed model-based (MB) strategy and a fast, retrospective habitual model-free (MF) strategy. Theory predicts that flexibility to changes in both reward values and transition contingencies can determine the relative influence of the two systems in reinforcement learning, but few studies have manipulated the latter. Therefore, we developed a novel two-level contingency change task in which transition contingencies between states change every few trials; MB and MF control predict different responses following these contingency changes, allowing their relative influence to be inferred. Additionally, we manipulated the rate of contingency changes in order to determine whether contingency change volatility would play a role in shifting subjects between a MB and MF strategy. We found that human subjects employed a hybrid MB/MF strategy on the task, corroborating the parallel contribution of MB and MF systems in reinforcement learning. Further, subjects did not remain at one level of MB/MF behaviour but rather displayed a shift towards more MB behavior over the first two blocks that was not attributable to the rate of contingency changes but rather to the extent of training. We demonstrate that flexibility to contingency changes can distinguish MB and MF strategies, with human subjects utilizing a hybrid strategy that shifts towards more MB behavior over blocks, consequently corresponding to a higher payoff.
| S-EPMC5634647 | biostudies-literature
Project description:This study explored the neurophysiological mechanisms underlying the planning and execution of an overt goal-related handle rotation task. More specifically, we studied the neural basis of motor actions concerning the influence of the grasp choice. The aim of the present study was to differentiate cerebral activity between grips executed in a habitual and a non-habitual mode, and between specified and free grip choices. To our knowledge, this is the first study to differentiate cerebral activity underlying overt goal-related actions executed with a focus on the habitual mode. In a handle rotation task, participants had to use thumb-toward (habitual) or thumb-away (non-habitual) grips to rotate a handle to a given target position. Reaction and reach times were shorter for the habitual compared to the non-habitual mode indicating that the habitual mode requires less cognitive processing effort than the non-habitual mode. Neural processes for action execution (measured by event-related potentials (ERPs)) differed between habitual and non-habitual conditions. We found differential activity between habitual and non-habitual conditions in left and right frontal areas from -600 to 200 ms time-locked to reaching the target position. No differential neural activity could be traced for the specification of the grip. The results suggested that the frontal negativity reflected increased difficulty in movement precision control in the non-habitual mode compared to the habitual mode during the homing in phase of grasp and rotation actions.
| S-EPMC3972190 | biostudies-literature
Project description:Everyday decision-making is supported by a dual-system of control comprised of parallel goal-directed and habitual systems. Over the past decade, the two-stage Markov decision task has become popularized for its ability to dissociate between goal-directed and habitual decision-making. While a handful of studies have implemented decision-making tasks online, only one study has validated the task by comparing in-person and web-based performance on the two-stage task in children and young adults. To date, no study has validated the dissociation of goal-directed and habitual behaviors in older adults online. Here, we implemented and validated a web-based version of the two-stage Markov task using parameter simulation and recovery and compared behavioral results from online and in-person participation on the two-stage task in both young and healthy older adults. We found no differences in estimated free parameters between online and in-person participation on the two-stage task. Further, we replicate previous findings that young adults are more goal-directed than older adults both in-person and online. Overall, this work demonstrates that the implementation and use of the two-stage Markov decision task for remote participation is feasible in the older adult demographic, which would allow for the study of decision-making with larger and more diverse samples.
| S-EPMC8276057 | biostudies-literature