Browse
Submit Data
Databases
API
Help

Dataset Information

17 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Time elapsed between choices in a probabilistic task correlates with repeating the same decision.

ABSTRACT: Reinforcement learning causes an action that yields a positive outcome more likely to be taken in the future. Here, we investigate how the time elapsed from an action affects subsequent decisions. Groups of C57BL6/J mice were housed in IntelliCages with access to water and chow ad libitum; they also had access to bottles with a reward: saccharin solution, alcohol, or a mixture of the two. The probability of receiving a reward in two of the cage corners changed between 0.9 and 0.3 every 48 hr over a period of ~33 days. As expected, in most animals, the odds of repeating a corner choice were increased if that choice was previously rewarded. Interestingly, the time elapsed from the previous choice also influenced the probability of repeating the choice, and this effect was independent of previous outcome. Behavioral data were fitted to a series of reinforcement learning models. Best fits were achieved when the reward prediction update was coupled with separate learning rates from positive and negative outcomes and additionally a "fictitious" update of the expected value of the nonselected choice. Additional inclusion of a time-dependent decay of the expected values improved the fit marginally in some cases.

SUBMITTER: Jablonska J

PROVIDER: S-EPMC8248175 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Prefrontal neurons predict choices during an auditory same-different task.

Project description:The detection of stimuli is critical for an animal's survival [1]. However, it is not adaptive for an animal to respond automatically to every stimulus that is present in the environment [2-5]. Given that the prefrontal cortex (PFC) plays a key role in executive function [6-8], we hypothesized that PFC activity should be involved in context-dependent responses to uncommon stimuli. As a test of this hypothesis, monkeys participated in a same-different task, a variant of an oddball task [2]. During this task, a monkey heard multiple presentations of a "reference" stimulus that were followed by a "test" stimulus and reported whether these stimuli were the same or different. While they participated in this task, we recorded from neurons in the ventrolateral prefrontal cortex (vPFC; a cortical area involved in aspects of nonspatial auditory processing [9, 10]). We found that vPFC activity was correlated with the monkeys' choices. This finding demonstrates a direct link between single neurons and behavioral choices in the PFC on a nonspatial auditory task.

| S-EPMC2576490 | biostudies-literature

A Time Duration Discrimination Task for the Study of Elapsed Time Processing in Rats.

Project description:Space and time are both essential features of episodic memory. However, while spatial tasks have been used effectively to study the behavioral relevance of place cells, the behavioral paradigms utilized for the study of time cells have not used time duration as a variable that animals need to be aware of to solve the task. In order to evaluate how time flow is coded into memory, time duration needs to be a variable that animals use to solve the behavioral task. This protocol describes a novel behavioral paradigm, the time duration discrimination (TDD) task, which is designed to directly investigate the neurological mechanisms that underlie temporal processing. During the TDD task, rats navigate around a Figure-8 Maze, which contains a rectangular track with a central arm and a delay box at the end of the central arm. While confined to the delay box, rats experience a 10- or 20-second time delay, during which a tone will play for the duration of the 10- or 20-second delay. When the delay box opens, the rat will choose whether to turn left or right out of the delay box and receive a reward for the correct choice (e.g., 10 seconds = left turn; 20 seconds = right turn). By directly manipulating elapsed time, we can better explore the behavioral relevance of hippocampal time cells and whether the time-dependent activity seen in physiological recordings of hippocampal neurons reflects a neuronal representation of time flow that can be used by the animal for learning and storing memories. Graphic abstract: Elapsed time duration discrimination in rats.

| S-EPMC8032559 | biostudies-literature

Post-decision processing in primate prefrontal cortex influences subsequent choices on an auditory decision-making task.

Project description:Perceptual decisions do not occur in isolation but instead reflect ongoing evaluation and adjustment processes that can affect future decisions. However, the neuronal substrates of these across-decision processes are not well understood, particularly for auditory decisions. We measured and manipulated the activity of choice-selective neurons in the ventrolateral prefrontal cortex (vlPFC) while monkeys made decisions about the frequency content of noisy auditory stimuli. As the decision was being formed, vlPFC activity was not modulated strongly by the task. However, after decision commitment, vlPFC population activity encoded the sensory evidence, choice, and outcome of the current trial and predicted subject-specific choice biases on the subsequent trial. Consistent with these patterns of neuronal activity, electrical microstimulation in vlPFC tended to affect the subsequent, but not current, decision. Thus, distributed post-commitment representations of graded decision-related information in prefrontal cortex can play a causal role in evaluating past decisions and biasing subsequent ones.

| S-EPMC6570479 | biostudies-literature

Time elapsed between Zika and dengue virus infections affects antibody and T cell responses.

Project description:Zika virus (ZIKV) and dengue virus (DENV) are co-endemic in many parts of the world, but the impact of ZIKV infection on subsequent DENV infection is not well understood. Here we show in rhesus macaques that the time elapsed after ZIKV infection affects the immune response to DENV infection. We show that previous ZIKV exposure increases the magnitude of the antibody and T cell responses against DENV. The time interval between ZIKV and subsequent DENV infection further affects the immune response. A mid-convalescent period of 10 months after ZIKV infection results in higher and more durable antibody and T cell responses to DENV infection than a short period of 2 months. In contrast, previous ZIKV infection does not affect DENV viremia or pro-inflammatory status. Collectively, we find no evidence of a detrimental effect of ZIKV immunity in a subsequent DENV infection. This supports the implementation of ZIKV vaccines that could also boost immunity against future DENV epidemics.

| S-EPMC6754404 | biostudies-literature

Optimal multisensory decision-making in a reaction-time task.

Project description:Humans and animals can integrate sensory evidence from various sources to make decisions in a statistically near-optimal manner, provided that the stimulus presentation time is fixed across trials. Little is known about whether optimality is preserved when subjects can choose when to make a decision (reaction-time task), nor when sensory inputs have time-varying reliability. Using a reaction-time version of a visual/vestibular heading discrimination task, we show that behavior is clearly sub-optimal when quantified with traditional optimality metrics that ignore reaction times. We created a computational model that accumulates evidence optimally across both cues and time, and trades off accuracy with decision speed. This model quantitatively explains subjects's choices and reaction times, supporting the hypothesis that subjects do, in fact, accumulate evidence optimally over time and across sensory modalities, even when the reaction time is under the subject's control.

| S-EPMC4102720 | biostudies-literature

Goal-directed decision making as probabilistic inference: a computational framework and potential neural correlates.

Project description:Recent work has given rise to the view that reward-based decision making is governed by two key controllers: a habit system, which stores stimulus-response associations shaped by past reward, and a goal-oriented system that selects actions based on their anticipated outcomes. The current literature provides a rich body of computational theory addressing habit formation, centering on temporal-difference learning mechanisms. Less progress has been made toward formalizing the processes involved in goal-directed decision making. We draw on recent work in cognitive neuroscience, animal conditioning, cognitive and developmental psychology, and machine learning to outline a new theory of goal-directed decision making. Our basic proposal is that the brain, within an identifiable network of cortical and subcortical structures, implements a probabilistic generative model of reward, and that goal-directed decision making is effected through Bayesian inversion of this model. We present a set of simulations implementing the account, which address benchmark behavioral and neuroscientific findings, and give rise to a set of testable predictions. We also discuss the relationship between the proposed framework and other models of decision making, including recent models of perceptual choice, to which our theory bears a direct connection.

| S-EPMC3767755 | biostudies-literature

Neural correlates of forward planning in a spatial decision task in humans.

Project description:Although reinforcement learning (RL) theories have been influential in characterizing the mechanisms for reward-guided choice in the brain, the predominant temporal difference (TD) algorithm cannot explain many flexible or goal-directed actions that have been demonstrated behaviorally. We investigate such actions by contrasting an RL algorithm that is model based, in that it relies on learning a map or model of the task and planning within it, to traditional model-free TD learning. To distinguish these approaches in humans, we used functional magnetic resonance imaging in a continuous spatial navigation task, in which frequent changes to the layout of the maze forced subjects continually to relearn their favored routes, thereby exposing the RL mechanisms used. We sought evidence for the neural substrates of such mechanisms by comparing choice behavior and blood oxygen level-dependent (BOLD) signals to decision variables extracted from simulations of either algorithm. Both choices and value-related BOLD signals in striatum, although most often associated with TD learning, were better explained by the model-based theory. Furthermore, predecessor quantities for the model-based value computation were correlated with BOLD signals in the medial temporal lobe and frontal cortex. These results point to a significant extension of both the computational and anatomical substrates for RL in the brain.

| S-EPMC3108440 | biostudies-other

The Elapsed Time between Dinner and the Midpoint of Sleep is Associated with Adiposity in Young Women.

Project description:Meal timing relative to sleep/wake schedules is relevant in the search for obesity risk factors. However, clock time does not accurately characterize the timing of food intake in the context of internal circadian timing. Therefore, we studied elapsed between dinner and the midpoint of sleep (TDM) as a practical approach to evaluate meal timing relative to internal timing, and its implications on obesity. To do so, adiposity, sleep, diet, physical activity, and TDM were measured in 133 women. The participants were grouped into four categories according to their sleep timing behavior (early-bed/early-rise; early-bed/late-rise; late-bed/early-rise; late-bed/late-rise). Differences among the categories were tested using ANOVA, while restricted cubic splines were calculated to study the association between TDM and adiposity. Our results show that, although participants had dinner at about the same time, those that had the shortest TDM (early-bed/early-rise group) were found to have significantly higher BMI and waist circumference values (2.3 kg/m2 and 5.2 cm) than the other groups. In addition, a TDM of 6 h was associated with the lowest values of adiposity. The TDM could be a practical approach to personalizing meal timing based on individual sleep/wake schedules. Thus, according to our findings, dining 6 h before the midpoint of sleep is an important finding and could be vital for future nutritional recommendations and for obesity prevention and treatment.

| S-EPMC7071164 | biostudies-literature

Electrophysiological Correlates of Response Time Variability During a Sustained Attention Task.

Project description:Individuals with Attention Deficit Hyperactivity Disorder (ADHD) tend to perform cognitive tasks with greater Response Time Variability (RTV). Greater RTV in ADHD may be due to inefficient functional connectivity of the brain during information processing. This study aimed to investigate the relationship between brain connectivity, RTV, and levels of ADHD symptoms. Twenty-eight children aged 9-12 years and 49 adolescents aged 15-18 years performed the Sustained Attention to Response Task (SART) while EEG was recorded. The participants' levels of ADHD symptoms were measured using self- and parent-rated questionnaires. The ex-Gaussian analysis and The Fast Fourier Transform were used to measure multiple aspects of RTV. Functional connectivity between 64 electrodes was computed during task performance, and global efficiency and modularity were calculated, reflecting integration and segregation of the brain, respectively. There was a positive association between multiple RTV measures and the level of ADHD symptoms, where participants with higher levels of ADHD symptoms showed greater RTV, except for sigma from the ex-Gaussian analysis. More efficient brain network activity, measured by global efficiency, was associated with reduced RTV. Children showed greater RTV and less efficient brain network activity compared with the adolescents. These findings support the view that stable responses are achieved with more integrated (and efficient) brain connectivity.

| S-EPMC6803451 | biostudies-literature

Behavioral and neurophysiological correlates of regret in rat decision-making on a neuroeconomic task.

Project description:Disappointment entails the recognition that one did not get the value expected. In contrast, regret entails recognition that an alternative (counterfactual) action would have produced a more valued outcome. In humans, the orbitofrontal cortex is active during expressions of regret, and humans with damage to the orbitofrontal cortex do not express regret. In rats and nonhuman primates, both the orbitofrontal cortex and the ventral striatum have been implicated in reward computations. We recorded neural ensembles from orbitofrontal cortex and ventral striatum in rats encountering wait or skip choices for delayed delivery of different flavors using an economic framework. Economically, encountering a high-cost choice after skipping a low-cost choice should induce regret. In these situations, rats looked backwards toward the lost option, cells within orbitofrontal cortex and ventral striatum represented the missed action, rats were more likely to wait for the long delay, and rats rushed through eating the food after that delay.

| S-EPMC4113023 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data