Dataset Information

Rigid reduced successor representation as a potential mechanism for addiction.

ABSTRACT: Difficulty in cessation of drinking, smoking, or gambling has been widely recognized. Conventional theories proposed relative dominance of habitual over goal-directed control, but human studies have not convincingly supported them. Referring to the recently suggested "successor representation (SR)" of states that enables partially goal-directed control, we propose a dopamine-related mechanism that makes resistance to habitual reward-obtaining particularly difficult. We considered that long-standing behavior towards a certain reward without resisting temptation can (but not always) lead to a formation of rigid dimension-reduced SR based on the goal state, which cannot be updated. Then, in our model assuming such rigid reduced SR, whereas no reward prediction error (RPE) is generated at the goal while no resistance is made, a sustained large positive RPE is generated upon goal reaching once the person starts resisting temptation. Such sustained RPE is somewhat similar to the hypothesized sustained fictitious RPE caused by drug-induced dopamine. In contrast, if rigid reduced SR is not formed and states are represented individually as in simple reinforcement learning models, no sustained RPE is generated at the goal. Formation of rigid reduced SR also attenuates the resistance-dependent decrease in the value of the cue for behavior, makes subsequent introduction of punishment after the goal ineffective, and potentially enhances the propensity of nonresistance through the influence of RPEs via the spiral striatum-midbrain circuit. These results suggest that formation of rigid reduced SR makes cessation of habitual reward-obtaining particularly difficult and can thus be a mechanism for addiction, common to substance and nonsubstance reward.

SUBMITTER: Shimomura K

PROVIDER: S-EPMC8252639 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Humans have the ability to craft abstract, temporally extended and hierarchically organized plans. For instance, when considering how to make spaghetti for dinner, we typically concern ourselves with useful "subgoals" in the task, such as cutting onions, boiling pasta, and cooking a sauce, rather than particulars such as how many cuts to make to the onion, or exactly which muscles to contract. A core question is how such decomposition of a more abstract task into logical subtasks happens in the first place. Previous research has shown that humans are sensitive to a form of higher-order statistical learning named "community structure". Community structure is a common feature of abstract tasks characterized by a logical ordering of subtasks. This structure can be captured by a model where humans learn predictions of upcoming events multiple steps into the future, discounting predictions of events further away in time. One such model is the "successor representation", which has been argued to be useful for hierarchical abstraction. As of yet, no study has convincingly shown that this hierarchical abstraction can be put to use for goal-directed behavior. Here, we investigate whether participants utilize learned community structure to craft hierarchically informed action plans for goal-directed behavior. Participants were asked to search for paintings in a virtual museum, where the paintings were grouped together in "wings" representing community structure in the museum. We find that participants' choices accord with the hierarchical structure of the museum and that their response times are best predicted by a successor representation. The degree to which the response times reflect the community structure of the museum correlates with several measures of performance, including the ability to craft temporally abstract action plans. These results suggest that successor representation learning subserves hierarchical abstractions relevant for goal-directed behavior.

Project description:ImportanceA national policy is under consideration to reduce the nicotine content of cigarettes to lower nicotine addiction potential in the United States.ObjectiveTo examine how smokers with psychiatric disorders and other vulnerabilities to tobacco addiction respond to cigarettes with reduced nicotine content.Design, setting, and participantsA multisite, double-blind, within-participant assessment of acute response to research cigarettes with nicotine content ranging from levels below a hypothesized addiction threshold to those representative of commercial cigarettes (0.4, 2.3, 5.2, and 15.8 mg/g of tobacco) at 3 academic sites included 169 daily smokers from the following 3 vulnerable populations: individuals with affective disorders (n = 56) or opioid dependence (n = 60) and socioeconomically disadvantaged women (n = 53). Data were collected from March 23, 2015, through April 25, 2016.InterventionsAfter a brief smoking abstinence, participants were exposed to the cigarettes with varying nicotine doses across fourteen 2- to 4-hour outpatient sessions.Main outcomes and measuresAddiction potential of the cigarettes was assessed using concurrent choice testing, the Cigarette Purchase Task (CPT), and validated measures of subjective effects, such as the Minnesota Nicotine Withdrawal Scale.ResultsAmong the 169 daily smokers included in the analysis (120 women [71.0%] and 49 men [29.0%]; mean [SD] age, 35.6 [11.4] years), reducing the nicotine content of cigarettes decreased the relative reinforcing effects of smoking in all 3 populations. Across populations, the 0.4-mg/g dose was chosen significantly less than the 15.8-mg/g dose in concurrent choice testing (mean [SEM] 30% [0.04%] vs 70% [0.04%]; Cohen d = 0.40; P < .001) and generated lower demand in the CPT (α = .027 [95% CI, 0.023-0.031] vs α = .019 [95% CI, 0.016-0.022]; Cohen d = 1.17; P < .001). Preference for higher over lower nicotine content cigarettes could be reversed by increasing the response cost necessary to obtain the higher dose (mean [SEM], 61% [0.02%] vs 39% [0.02%]; Cohen d = 0.40; P < .001). All doses reduced Minnesota Nicotine Withdrawal Scale total scores (range of mean decreases, 0.10-0.50; Cohen d range, 0.21-1.05; P < .001 for all), although duration of withdrawal symptoms was greater at higher doses (η2 = 0.008; dose-by-time interaction, P = .002).Conclusions and relevanceReducing the nicotine content of cigarettes may decrease their addiction potential in populations that are highly vulnerable to tobacco addiction. Smokers with psychiatric conditions and socioeconomic disadvantage are more addicted and less likely to quit and experience greater adverse health impacts. Policies to reduce these disparities are needed; reducing the nicotine content in cigarettes should be a policy focus.

Dataset Information

Rigid reduced successor representation as a potential mechanism for addiction.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets