Unknown

Dataset Information

0

Spike-based decision learning of Nash equilibria in two-player games.


ABSTRACT: Humans and animals face decision tasks in an uncertain multi-agent environment where an agent's strategy may change in time due to the co-adaptation of others strategies. The neuronal substrate and the computational algorithms underlying such adaptive decision making, however, is largely unknown. We propose a population coding model of spiking neurons with a policy gradient procedure that successfully acquires optimal strategies for classical game-theoretical tasks. The suggested population reinforcement learning reproduces data from human behavioral experiments for the blackjack and the inspector game. It performs optimally according to a pure (deterministic) and mixed (stochastic) Nash equilibrium, respectively. In contrast, temporal-difference(TD)-learning, covariance-learning, and basic reinforcement learning fail to perform optimally for the stochastic strategy. Spike-based population reinforcement learning, shown to follow the stochastic reward gradient, is therefore a viable candidate to explain automated decision learning of a Nash equilibrium in two-player games.

SUBMITTER: Friedrich J 

PROVIDER: S-EPMC3459907 | biostudies-literature | 2012

REPOSITORIES: biostudies-literature

altmetric image

Publications

Spike-based decision learning of Nash equilibria in two-player games.

Friedrich Johannes J   Senn Walter W  

PLoS computational biology 20120927 9


Humans and animals face decision tasks in an uncertain multi-agent environment where an agent's strategy may change in time due to the co-adaptation of others strategies. The neuronal substrate and the computational algorithms underlying such adaptive decision making, however, is largely unknown. We propose a population coding model of spiking neurons with a policy gradient procedure that successfully acquires optimal strategies for classical game-theoretical tasks. The suggested population rein  ...[more]

Similar Datasets

| S-EPMC4506547 | biostudies-literature
| S-EPMC6382789 | biostudies-literature
| S-EPMC7304779 | biostudies-literature
| S-EPMC21404 | biostudies-other
| S-EPMC2714462 | biostudies-literature
| S-EPMC5112854 | biostudies-literature
| S-EPMC5627107 | biostudies-literature
| S-EPMC5415147 | biostudies-literature
| S-EPMC4877102 | biostudies-other
| S-EPMC3144879 | biostudies-literature