Unknown

Dataset Information

0

Gaze data reveal distinct choice processes underlying model-based and model-free reinforcement learning.


ABSTRACT: Organisms appear to learn and make decisions using different strategies known as model-free and model-based learning; the former is mere reinforcement of previously rewarded actions and the latter is a forward-looking strategy that involves evaluation of action-state transition probabilities. Prior work has used neural data to argue that both model-based and model-free learners implement a value comparison process at trial onset, but model-based learners assign more weight to forward-looking computations. Here using eye-tracking, we report evidence for a different interpretation of prior results: model-based subjects make their choices prior to trial onset. In contrast, model-free subjects tend to ignore model-based aspects of the task and instead seem to treat the decision problem as a simple comparison process between two differentially valued items, consistent with previous work on sequential-sampling models of decision making. These findings illustrate a problem with assuming that experimental subjects make their decisions at the same prescribed time.

SUBMITTER: Konovalov A 

PROVIDER: S-EPMC4987535 | biostudies-literature | 2016 Aug

REPOSITORIES: biostudies-literature

altmetric image

Publications

Gaze data reveal distinct choice processes underlying model-based and model-free reinforcement learning.

Konovalov Arkady A   Krajbich Ian I  

Nature communications 20160811


Organisms appear to learn and make decisions using different strategies known as model-free and model-based learning; the former is mere reinforcement of previously rewarded actions and the latter is a forward-looking strategy that involves evaluation of action-state transition probabilities. Prior work has used neural data to argue that both model-based and model-free learners implement a value comparison process at trial onset, but model-based learners assign more weight to forward-looking com  ...[more]

Similar Datasets

| S-EPMC2895323 | biostudies-other
| S-EPMC4126879 | biostudies-literature
| S-EPMC5487295 | biostudies-literature
| S-EPMC7063100 | biostudies-literature
| S-EPMC5516979 | biostudies-literature
| S-EPMC4728725 | biostudies-literature
| S-EPMC7508815 | biostudies-literature
| S-EPMC5628940 | biostudies-literature
| S-EPMC6893860 | biostudies-literature
| S-EPMC3968946 | biostudies-literature