Dataset Information

Is the encoding of Reward Prediction Error reliable during development?

ABSTRACT: Reward Prediction Errors (RPEs), defined as the difference between the expected and received outcomes, are integral to reinforcement learning models and play an important role in development and psychopathology. In humans, RPE encoding can be estimated using fMRI recordings, however, a basic measurement property of RPE signals, their test-retest reliability across different time scales, remains an open question. In this paper, we examine the 3-month and 3-year reliability of RPE encoding in youth (mean age at baseline?=?10.6?±?0.3 years), a period of developmental transitions in reward processing. We show that RPE encoding is differentially distributed between the positive values being encoded predominantly in the striatum and negative RPEs primarily encoded in the insula. The encoding of negative RPE values is highly reliable in the right insula, across both the long and the short time intervals. Insula reliability for RPE encoding is the most robust finding, while other regions, such as the striatum, are less consistent. Striatal reliability appeared significant as well once covarying for factors, which were possibly confounding the signal to noise ratio. By contrast, task activation during feedback in the striatum is highly reliable across both time intervals. These results demonstrate the valence-dependent differential encoding of RPE signals between the insula and striatum, and the consistency of RPE signals or lack thereof, during childhood and into adolescence. Characterizing the regions where the RPE signal in BOLD fMRI is a reliable marker is key for estimating reward-processing alterations in longitudinal designs, such as developmental or treatment studies.

SUBMITTER: Keren H

PROVIDER: S-EPMC7518449 | biostudies-literature | 2018 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Is the encoding of Reward Prediction Error reliable during development?

Keren Hanna H Chen Gang G Benson Brenda B Ernst Monique M Leibenluft Ellen E Fox Nathan A NA Pine Daniel S DS Stringaris Argyris A

NeuroImage 20180516

Reward Prediction Errors (RPEs), defined as the difference between the expected and received outcomes, are integral to reinforcement learning models and play an important role in development and psychopathology. In humans, RPE encoding can be estimated using fMRI recordings, however, a basic measurement property of RPE signals, their test-retest reliability across different time scales, remains an open question. In this paper, we examine the 3-month and 3-year reliability of RPE encoding in yout ...[more]

PMID: 29777827

Similar Datasets

Project description:AimsTo advance translational studies of the role of reward prediction error (PE) in alcohol use disorder, the present study sought to develop and conduct an initial test of an alcohol-specific PE task paradigm using functional magnetic resonance imaging in humans.MethodsAlcohol dependent or social drinkers received small tastes of their preferred alcohol beverage or control beverage, with preceding visual cues indicating whether alcohol (or water) would be delivered. To assess both positive and negative PE signals, expectancies were systematically violated in both positive (i.e. expecting water and receiving alcohol) and negative (i.e. expecting alcohol and receiving water) directions. Exploratory trial-by-trial analyses were conducted to explore temporal fluctuations of activation within a priori-defined regions of interest that have been implicated in cue reactivity and PE processing.ResultsAcross the entire sample of participants, positive PE-related brain activation was found in a large cluster comprised of frontal lobe regions, as well as insular cortex, and motor/sensory cortices. Compared to social drinking subjects, alcohol dependent subjects had greater positive PE-related brain activity in left superior parietal lobule, lateral occipital cortex and postcentral gyrus. Exploratory trial-by-trial analyses indicated differences in activation specific to type of taste, mostly at earlier trials.ConclusionsThis task-development oriented pilot study found that PE signaling may not be detected in expected brain regions when image analyses average across all PE trials of the task. Rather, a trial-by-trial analysis approach may help detect sparse, temporally distinct PE signaling in expected reward processing regions.Short summaryThis fMRI study of reward prediction error found greater positive prediction error-related activity (i.e. expecting water taste, receiving alcohol taste) in alcohol dependent individuals relative to social drinkers in parietal and occipital cortices. Trial-by-trial analyses may be able to better detect sparse prediction error signaling in expected reward processing regions.

Dataset Information

Is the encoding of Reward Prediction Error reliable during development?

Publications

Is the encoding of Reward Prediction Error reliable during development?

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets