Dataset Information

Altered risk-based decision making following adolescent alcohol use results from an imbalance in reinforcement learning in rats.

ABSTRACT: Alcohol use during adolescence has profound and enduring consequences on decision-making under risk. However, the fundamental psychological processes underlying these changes are unknown. Here, we show that alcohol use produces over-fast learning for better-than-expected, but not worse-than-expected, outcomes without altering subjective reward valuation. We constructed a simple reinforcement learning model to simulate altered decision making using behavioral parameters extracted from rats with a history of adolescent alcohol use. Remarkably, the learning imbalance alone was sufficient to simulate the divergence in choice behavior observed between these groups of animals. These findings identify a selective alteration in reinforcement learning following adolescent alcohol use that can account for a robust change in risk-based decision making persisting into later life.

SUBMITTER: Clark JJ

PROVIDER: S-EPMC3353889 | biostudies-literature | 2012

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Altered risk-based decision making following adolescent alcohol use results from an imbalance in reinforcement learning in rats.

Clark Jeremy J JJ Nasrallah Nicholas A NA Hart Andrew S AS Collins Anne L AL Bernstein Ilene L IL Phillips Paul E M PE

PloS one 20120516 5

Alcohol use during adolescence has profound and enduring consequences on decision-making under risk. However, the fundamental psychological processes underlying these changes are unknown. Here, we show that alcohol use produces over-fast learning for better-than-expected, but not worse-than-expected, outcomes without altering subjective reward valuation. We constructed a simple reinforcement learning model to simulate altered decision making using behavioral parameters extracted from rats with a ...[more]

PMID: 22615989

Similar Datasets

Project description:BackgroundSurgical patients incur preventable harm from cognitive and judgment errors made under time constraints and uncertainty regarding patients' diagnoses and predicted response to treatment. Decision analysis and techniques of reinforcement learning theoretically can mitigate these challenges but are poorly understood and rarely used clinically. This review seeks to promote an understanding of decision analysis and reinforcement learning by describing their use in the context of surgical decision-making.MethodsCochrane, EMBASE, and PubMed databases were searched from their inception to June 2019. Included were 41 articles about cognitive and diagnostic errors, decision-making, decision analysis, and machine-learning. The articles were assimilated into relevant categories according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews guidelines.ResultsRequirements for time-consuming manual data entry and crude representations of individual patients and clinical context compromise many traditional decision-support tools. Decision analysis methods for calculating probability thresholds can inform population-based recommendations that jointly consider risks, benefits, costs, and patient values but lack precision for individual patient-centered decisions. Reinforcement learning, a machine-learning method that mimics human learning, can use a large set of patient-specific input data to identify actions yielding the greatest probability of achieving a goal. This methodology follows a sequence of events with uncertain conditions, offering potential advantages for personalized, patient-centered decision-making. Clinical application would require secure integration of multiple data sources and attention to ethical considerations regarding liability for errors and individual patient preferences.ConclusionTraditional decision-support tools are ill-equipped to accommodate time constraints and uncertainty regarding diagnoses and the predicted response to treatment, both of which often impair surgical decision-making. Decision analysis and reinforcement learning have the potential to play complementary roles in delivering high-value surgical care through sound judgment and optimal decision-making.

Project description:BackgroundActivation of the innate immune system may play a role in the development of alcohol use disorders (AUDs), which often originate with adolescent alcohol abuse. A key player in the innate immune system is microglia, the activation of which occurs along a spectrum from proinflammatory, or M1-like, to anti-inflammatory, or M2-like, phenotypes.MethodsAdolescent, male rats were gavaged with ethanol (EtOH) or isocaloric control diet every 8 hours for 4 days and then sacrificed at 0, 2, 7, and 14 days later. Microglia were isolated from the entorhinal cortex and hippocampus by Percoll gradient centrifugation, labeled with surface antigens for activation, and analyzed by flow cytometry. Polarization states of microglia, defined as CD11b+ CD45low cells, were determined by the expression of M1 surface markers, major histocompatibility complex (MHC) II, CD32, and CD86, and M2 surface marker, CD206 (mannose receptor). Cytokine gene expression was measured by reverse transcriptase polymerase chain reaction.ResultsIsolated cells were a highly enriched population (>95% pure) of microglia/macrophages according to CD11b immunoreactivity. EtOH rats showed the most dramatic increases in microglia activation markers CD11b and CD45, and M1 (MHC-II) and M2 (CD206) markers at T2, when additional M1 markers CD86 and CD32 were also increased. Surprisingly, proinflammatory gene expression of CCL2, IL-1β, IL-6, and TNF-α generally was decreased at all time points in EtOH rats except for IL-6 which was increased at T0 and TNF-α which was not changed at T0 in either region. Simultaneously, BDNF expression was increased at T2 and T7, while IGF1 and TGF-β gene expression was decreased. Arginase was also increased at T0 in hippocampus, but not changed by alcohol otherwise.ConclusionsThese data show that microglia phenotype after alcohol dependence is not a simple M1 or M2 classification, though more indicators of an anti-inflammatory phenotype were observed. Determining microglia phenotype is critical for understanding their role in the development of AUDs.

Project description:The objective of this study was to determine changes in gene expression within the extended amygdala following binge-like alcohol drinking by adolescent alcohol-preferring (P) rats. Starting at 28 days of age, P rats were given concurrent access to 15 and 30 % ethanol for 3 one-h sessions for 5 consecutive days each week until they were 49 days old. Rats were killed by decapitation 3 h after the first ethanol access session on the 15th day of drinking. RNA was prepared from micropunch samples of the nucleus accumbens shell (Acb-sh) and central nucleus of the amygdala (CeA). Ethanol intakes were 2.5 to 3.0 g/kg/session. There were 154 and 182 unique named genes that significantly differed (FDR = 0.2) between the water and ethanol group in the Acb-sh and CeA, respectively. Gene Ontology (GO) analyses indicated that adolescent binge drinking produced changes in the in biological processes involved in cell proliferation and regulation of cellular structure in the Acb-sh, and in neuron projection and positive regulation of cellular organization in the CeA. Ingenuity Pathway Analysis indicated that, in the Acb-sh, there were several major intracellular signaling pathways (e.g., cAMP-mediated and protein kinase A signaling pathways) altered by adolescent drinking, with 3-fold more genes up-regulated than down-regulated in the alcohol group. The cAMP-mediated signaling system was also up-regulated in the CeA of the alcohol group. Weighted gene co-expression network analysis (WGCNA) indicated significant G-protein coupled receptor signaling and transmembrane receptor protein kinase signaling categories in the Acb-sh and CeA, respectively. Overall, the results of this study indicated that binge-like alcohol drinking by adolescent P rats is differentially altering the expression of genes in the Acb-sh and CeA, some of which are involved in intracellular signaling pathways and may produce long-term changes in neuronal function. Differences in gene expression in the central nucleus of the amygdala (CeA) were compared in two groups of alcohol-preferring (P) rats, one given water only and the other given access to 15 & 30% ethanol during adolescence.

Project description:The objective of this study was to determine changes in gene expression within the extended amygdala following binge-like alcohol drinking by adolescent alcohol-preferring (P) rats. Starting at 28 days of age, P rats were given concurrent access to 15 and 30 % ethanol for 3 one-h sessions for 5 consecutive days each week until they were 49 days old. Rats were killed by decapitation 3 h after the first ethanol access session on the 15th day of drinking. RNA was prepared from micropunch samples of the nucleus accumbens shell (Acb-sh) and central nucleus of the amygdala (CeA). Ethanol intakes were 2.5 ‚Äì 3.0 g/kg/session. There were 154 and 182 unique named genes that significantly differed (FDR = 0.2) between the water and ethanol group in the Acb-sh and CeA, respectively. Gene Ontology (GO) analyses indicated that adolescent binge drinking produced changes in the in biological processes involved in cell proliferation and regulation of cellular structure in the Acb-sh, and in neuron projection and positive regulation of cellular organization in the CeA. Ingenuity Pathway Analysis indicated that, in the Acb-sh, there were several major intracellular signaling pathways (e.g., cAMP-mediated and protein kinase A signaling pathways) altered by adolescent drinking, with 3-fold more genes up-regulated than down-regulated in the alcohol group. The cAMP-mediated signaling system was also up-regulated in the CeA of the alcohol group. Weighted gene co-expression network analysis (WGCNA) indicated significant G-protein coupled receptor signaling and transmembrane receptor protein kinase signaling categories in the Acb-sh and CeA, respectively. Overall, the results of this study indicated that binge-like alcohol drinking by adolescent P rats is differentially altering the expression of genes in the Acb-sh and CeA, some of which are involved in intracellular signaling pathways and may produce long-term changes in neuronal function. Differences in gene expression in brain nucleus accumbens shell (Acb-sh) were compared in two groups of alcohol-preferring (P) rats, one given water only and the other given access to 15 & 30% ethanol during adolescence.

Dataset Information

Altered risk-based decision making following adolescent alcohol use results from an imbalance in reinforcement learning in rats.

Publications

Altered risk-based decision making following adolescent alcohol use results from an imbalance in reinforcement learning in rats.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets