Unknown

Dataset Information

0

A reservoir of time constants for memory traces in cortical neurons.


ABSTRACT: According to reinforcement learning theory of decision making, reward expectation is computed by integrating past rewards with a fixed timescale. In contrast, we found that a wide range of time constants is available across cortical neurons recorded from monkeys performing a competitive game task. By recognizing that reward modulates neural activity multiplicatively, we found that one or two time constants of reward memory can be extracted for each neuron in prefrontal, cingulate and parietal cortex. These timescales ranged from hundreds of milliseconds to tens of seconds, according to a power law distribution, which is consistent across areas and reproduced by a 'reservoir' neural network model. These neuronal memory timescales were weakly, but significantly, correlated with those of monkey's decisions. Our findings suggest a flexible memory system in which neural subpopulations with distinct sets of long or short memory timescales may be selectively deployed according to the task demands.

SUBMITTER: Bernacchia A 

PROVIDER: S-EPMC3079398 | biostudies-literature | 2011 Mar

REPOSITORIES: biostudies-literature

altmetric image

Publications

A reservoir of time constants for memory traces in cortical neurons.

Bernacchia Alberto A   Seo Hyojung H   Lee Daeyeol D   Wang Xiao-Jing XJ  

Nature neuroscience 20110213 3


According to reinforcement learning theory of decision making, reward expectation is computed by integrating past rewards with a fixed timescale. In contrast, we found that a wide range of time constants is available across cortical neurons recorded from monkeys performing a competitive game task. By recognizing that reward modulates neural activity multiplicatively, we found that one or two time constants of reward memory can be extracted for each neuron in prefrontal, cingulate and parietal co  ...[more]

Similar Datasets

| S-EPMC7132978 | biostudies-literature
| S-EPMC3948171 | biostudies-literature
| S-EPMC4169172 | biostudies-literature
| S-EPMC2596211 | biostudies-literature
| S-EPMC5469894 | biostudies-literature
| S-EPMC7248099 | biostudies-literature
| S-EPMC7867585 | biostudies-literature
| S-EPMC3529061 | biostudies-literature
| S-EPMC5192352 | biostudies-literature
| S-EPMC2788416 | biostudies-literature