Dataset Information

Ageing is associated with disrupted reinforcement learning whilst learning to help others is preserved.

ABSTRACT: Reinforcement learning is a fundamental mechanism displayed by many species. However, adaptive behaviour depends not only on learning about actions and outcomes that affect ourselves, but also those that affect others. Using computational reinforcement learning models, we tested whether young (age 18-36) and older (age 60-80, total n = 152) adults learn to gain rewards for themselves, another person (prosocial), or neither individual (control). Detailed model comparison showed that a model with separate learning rates for each recipient best explained behaviour. Young adults learned faster when their actions benefitted themselves, compared to others. Compared to young adults, older adults showed reduced self-relevant learning rates but preserved prosocial learning. Moreover, levels of subclinical self-reported psychopathic traits (including lack of concern for others) were lower in older adults and the core affective-interpersonal component of this measure negatively correlated with prosocial learning. These findings suggest learning to benefit others is preserved across the lifespan with implications for reinforcement learning and theories of healthy ageing.

SUBMITTER: Cutler J

PROVIDER: S-EPMC8295324 | biostudies-literature | 2021 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Ageing is associated with disrupted reinforcement learning whilst learning to help others is preserved.

Cutler Jo J Wittmann Marco K MK Abdurahman Ayat A Hargitai Luca D LD Drew Daniel D Husain Masud M Lockwood Patricia L PL

Nature communications 20210721 1

Reinforcement learning is a fundamental mechanism displayed by many species. However, adaptive behaviour depends not only on learning about actions and outcomes that affect ourselves, but also those that affect others. Using computational reinforcement learning models, we tested whether young (age 18-36) and older (age 60-80, total n = 152) adults learn to gain rewards for themselves, another person (prosocial), or neither individual (control). Detailed model comparison showed that a model with ...[more]

PMID: 34290236

Similar Datasets

Project description:ADHD is associated with altered dopamine regulated reinforcement learning on prediction errors. Despite evidence of categorically altered error processing in ADHD, neuroimaging advances have largely investigated models of normal reinforcement learning in greater detail. Further, although reinforcement leaning critically relies on ventral striatum exerting error magnitude related thresholding influences on substantia nigra (SN) and dorsal striatum, these thresholding influences have never been identified with neuroimaging. To identify such thresholding influences, we propose that error magnitude related activities must first be separated from opposite activities in overlapping neural regions during error detection. Here we separate error detection from magnitude related adjustment (post-error slowing) during inhibition errors in the stop signal task in typically developing (TD) and ADHD adolescents using fMRI. In TD, we predicted that: 1) deactivation of dorsal striatum on error detection interrupts ongoing processing, and should be proportional to right frontoparietal response phase activity that has been observed in the SST; 2) deactivation of ventral striatum on post-error slowing exerts thresholding influences on, and should be proportional to activity in dorsal striatum. In ADHD, we predicted that ventral striatum would instead correlate with heightened amygdala responses to errors. We found deactivation of dorsal striatum on error detection correlated with response-phase activity in both groups. In TD, post-error slowing deactivation of ventral striatum correlated with activation of dorsal striatum. In ADHD, ventral striatum correlated with heightened amygdala activity. Further, heightened activities in locus coeruleus (norepinephrine), raphe nucleus (serotonin) and medial septal nuclei (acetylcholine), which all compete for control of DA, and are altered in ADHD, exhibited altered correlations with SN. All correlations in TD were replicated in healthy adults. Results in TD are consistent with dopamine regulated reinforcement learning on post-error slowing. In ADHD, results are consistent with heightened activities in the amygdala and non-dopaminergic neurotransmitter nuclei preventing reinforcement learning.

Project description:IntroductionLongitudinal Integrated Clerkships (LICs) have demonstrated benefits for students' learning and development in medical education globally. The model emphasises importance with respect to continuity and time in the workplace for learners. There is a need to explore how LICs become a viable training model for learners. An amalgamative LIC model was drawn upon to inform the design of a placement for trainee pharmacists on a hospital ward. This study sought to determine the local viability of a longitudinal placement for trainee pharmacists, using communities of practice learning theory to interpret findings.MethodsA design-based research approach informed study design. A longitudinal placement was implemented on two hospital wards for 13 weeks. Trainees (n = 3) were interviewed four times over a 14-week period. Ward staff (n = 14) were interviewed at week 14. Interviews were transcribed verbatim. Qualitative longitudinal analysis, using the trajectory approach, was conducted using abductive analysis. The coded data were organised into a framework and subthemes were created.ResultsTrainees acquired membership within the multi-disciplinary ward team over time. This led to an enriched learning experience and the trainee's professional development improved as they attained more responsibilities. This enabled them to make a greater contribution to patient care; more medication consultations occurred, and discharge times improved.DiscussionThe local viability of the longitudinal placement appears to be linked to the trainee's ability to acquire membership within the ward community of practice. Membership gave trainee's access to learning opportunities, supporting their development, and they earnt the trust of staff, leading to more responsibilities for providing patient care. Further research into developing longitudinal placements that support trainee healthcare professionals to acquire membership within communities of practice is warranted.

Project description:Childhood sexual abuse (CSA) has been associated with psychopathology, particularly major depressive disorder (MDD), and high-risk behaviors. Despite the epidemiological data available, the mechanisms underlying these maladaptive outcomes remain poorly understood.We examined whether a history of CSA, particularly in conjunction with a past episode of MDD, is associated with behavioral and neural dysfunction in reinforcement learning, and whether such dysfunction is linked to maladaptive behavior.Participants completed a clinical evaluation and a probabilistic reinforcement task while 128-channel event-related potentials were recorded.Academic setting; participants recruited from the community.Fifteen women with a history of CSA and remitted MDD (CSA + rMDD), 16 women with remitted MDD with no history of CSA (rMDD), and 18 healthy women (controls).Three or more episodes of coerced sexual contact (mean [SD] duration, 3.00 [2.20] years) between the ages of 7 and 12 years by at least 1 male perpetrator.Participants' preference for choosing the most rewarded stimulus and avoiding the most punished stimulus was evaluated. The feedback-related negativity and error-related negativity-hypothesized to reflect activation in the anterior cingulate cortex-were used as electrophysiological indices of reinforcement learning.No group differences emerged in the acquisition of reinforcement contingencies. In trials requiring participants to rely partially or exclusively on previously rewarded information, the CSA + rMDD group showed (1) lower accuracy (relative to both controls and the rMDD group), (2) blunted electrophysiological differentiation between correct and incorrect responses (relative to controls), and (3) increased activation in the subgenual anterior cingulate cortex (relative to the rMDD group). A history of CSA was not associated with impairments in avoiding the most punished stimulus. Self-harm and suicidal behaviors correlated with poorer performance of previously rewarded, but not previously punished, trials.Irrespective of past MDD episodes, women with a history of CSA showed neural and behavioral deficits in utilizing previous reinforcement to optimize decision making in the absence of feedback (blunted "Go learning"). Although our study provides initial evidence for reward-specific deficits associated with CSA, future research is warranted to determine if disrupted positive reinforcement learning predicts high-risk behavior following CSA.

Dataset Information

Ageing is associated with disrupted reinforcement learning whilst learning to help others is preserved.

Publications

Ageing is associated with disrupted reinforcement learning whilst learning to help others is preserved.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets