Reward context determines risky choice in pigeons and humans.
Ontology highlight
ABSTRACT:
SUBMITTER: Ludvig EA
PROVIDER: S-EPMC4155912 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:The maxim "no pain, no gain" summarizes scenarios in which an action leading to reward also entails a cost. Although we know a substantial amount about how the brain represents pain and reward separately, we know little about how they are integrated during goal-directed behavior. Two theoretical models might account for the integration of reward and pain. An additive model specifies that the disutility of costs is summed linearly with the utility of benefits, whereas an interactive model suggests that cost and benefit utilities interact so that the sensitivity to benefits is attenuated as costs become increasingly aversive. Using a novel task that required integration of physical pain and monetary reward, we examined the mechanism underlying cost-benefit integration in humans. We provide evidence in support of an interactive model in behavioral choice. Using functional neuroimaging, we identify a neural signature for this interaction such that, when the consequences of actions embody a mixture of reward and pain, there is an attenuation of a predictive reward signal in both ventral anterior cingulate cortex and ventral striatum. We conclude that these regions subserve integration of action costs and benefits in humans, a finding that suggests a cross-species similarity in neural substrates that implement this function and illuminates mechanisms that underlie altered decision making under aversive conditions.
| S-EPMC2948535 | biostudies-literature
Project description:Choice history effects describe how future choices depend on the history of past choices. In experimental tasks this is typically framed as a bias because it often diminishes the experienced reward rates. However, in natural habitats, choices made in the past constrain choices that can be made in the future. For foraging animals, the probability of earning a reward in a given patch depends on the degree to which the animals have exploited the patch in the past. One problem with many experimental tasks that show choice history effects is that such tasks artificially decouple choice history from its consequences on reward availability over time. To circumvent this, we use a variable interval (VI) reward schedule that reinstates a more natural contingency between past choices and future reward availability. By examining the behavior of optimal agents in the VI task we discover that choice history effects observed in animals serve to maximize reward harvesting efficiency. We further distil the function of choice history effects by manipulating first- and second-order statistics of the environment. We find that choice history effects primarily reflect the growth rate of the reward probability of the unchosen option, whereas reward history effects primarily reflect environmental volatility. Based on observed choice history effects in animals, we develop a reinforcement learning model that explicitly incorporates choice history over multiple time scales into the decision process, and we assess its predictive adequacy in accounting for the associated behavior. We show that this new variant, known as the double trace model, has a higher performance in predicting choice data, and shows near optimal reward harvesting efficiency in simulated environments. These results suggests that choice history effects may be adaptive for natural contingencies between consumption and reward availability. This concept lends credence to a normative account of choice history effects that extends beyond its description as a bias.
| S-EPMC8516315 | biostudies-literature
Project description:Hierarchical organization is widespread in the societies of humans and other animals, both in social structure and in decision-making contexts. In the case of collective motion, the majority of case studies report that dominant individuals lead group movements, in agreement with the common conflation of the terms "dominance" and "leadership." From a theoretical perspective, if social relationships influence interactions during collective motion, then social structure could also affect leadership in large, swarm-like groups, such as fish shoals and bird flocks. Here we use computer-vision-based methods and miniature GPS tracking to study, respectively, social dominance and in-flight leader-follower relations in pigeons. In both types of behavior we find hierarchically structured networks of directed interactions. However, instead of being conflated, dominance and leadership hierarchies are completely independent of each other. Although dominance is an important aspect of variation among pigeons, correlated with aggression and access to food, our results imply that the stable leadership hierarchies in the air must be based on a different set of individual competences. In addition to confirming the existence of independent and context-specific hierarchies in pigeons, we succeed in setting out a robust, scalable method for the automated analysis of dominance relationships, and thus of social structure, applicable to many species. Our results, as well as our methods, will help to incorporate the broader context of animal social organization into the study of collective behavior.
| S-EPMC3740899 | biostudies-other
Project description:Pigeons have shown suboptimal gambling-like behavior when preferring a stimulus that infrequently signals reliable reinforcement over alternatives that provide greater reinforcement overall. As a mechanism for this behavior, recent research proposed that the stimulus value of alternatives with more reliable signals for reinforcement will be preferred relatively independently of their frequencies. The present study tested this hypothesis using a simplified design of a Discriminative alternative that, 50% of the time, led to either a signal for 100% reinforcement or a blackout period indicative of 0% reinforcement against a Nondiscriminative alternative that always led to a signal that predicted 50% reinforcement. Pigeons showed a strong preference for the Discriminative alternative that remained despite reducing the frequency of the signal for reinforcement in subsequent phases to 25% and then 12.5%. In Experiment 2, using the original design of Experiment 1, the stimulus following choice of the Nondiscriminative alternative was increased to 75% and then to 100%. Results showed that preference for the Discriminative alternative decreased only when the signals for reinforcement for the two alternatives predicted the same probability of reinforcement. The ability of several models to predict this behavior are discussed, but the terminal link stimulus value offers the most parsimonious account of this suboptimal behavior.
| S-EPMC4956316 | biostudies-literature
Project description:Epidemiological data suggest that risk taking in the real world increases from childhood into adolescence and declines into adulthood. However, developmental patterns of behaviour in laboratory assays of risk taking and impulsive choice are inconsistent. In this article, we review a growing literature using behavioural economic approaches to understand developmental changes in risk taking and impulsivity. We present findings that have begun to elucidate both the cognitive and neural processes that contribute to risky and impulsive choice, as well as how age-related changes in these neurocognitive processes give rise to shifts in choice behaviour. We highlight how variability in task parameters can be used to identify specific aspects of decision contexts that may differentially influence risky and impulsive choice behaviour across development. This article is part of the theme issue 'Risk taking and impulsive behaviour: fundamental discoveries, theoretical perspectives and clinical implications'.
| S-EPMC6335462 | biostudies-literature
Project description:A key question in decision-making is how people integrate amounts and probabilities to form preferences between risky alternatives. Here we rely on the general principle of integration-to-boundary to develop several biologically plausible process models of risky-choice, which account for both choices and response-times. These models allowed us to contrast two influential competing theories: i) within-alternative evaluations, based on multiplicative interaction between amounts and probabilities, ii) within-attribute comparisons across alternatives. To constrain the preference formation process, we monitored eye-fixations during decisions between pairs of simple lotteries, designed to systematically span the decision-space. The behavioral results indicate that the participants' eye-scanning patterns were associated with risk-preferences and expected-value maximization. Crucially, model comparisons showed that within-alternative process models decisively outperformed within-attribute ones, in accounting for choices and response-times. These findings elucidate the psychological processes underlying preference formation when making risky-choices, and suggest that compensatory, within-alternative integration is an adaptive mechanism employed in human decision-making.
| S-EPMC6738658 | biostudies-literature
Project description:Perceiving motion is a fundamental ability for animals. Primates integrate local 1D motion across orientation and space to compute a rigid 2D motion. It is unknown whether the rule of 2D motion integration is universal within the vertebrate clade; comparative studies of animals with different ecological backgrounds from primates may help answer that question. Here we investigated 2D motion integration in pigeons, using hierarchically structured motion stimuli, namely a barber-pole illusion and plaid motion. The pigeons were trained to report the direction of motion of random dots. When a barber-pole or plaid stimulus was presented, they reported the direction perpendicular to the grating orientation for barber-pole and the vector average of two component gratings for plaid motion. These results demonstrate that pigeons perceive different directions than humans from the same motion stimuli, and suggest that the 2D integrating rules in the primate brain has been elaborated through phylogenetic or ecological factors specific to the clade.
| S-EPMC6746846 | biostudies-literature
Project description:Does risk taking change as a function of age? We conducted a systematic literature search and found 29 comparisons between younger and older adults on behavioral tasks thought to measure risk taking (N= 4,093). The reports relied on various tasks differing in several respects, such as the amount of learning required or the choice framing (gains vs. losses). The results suggest that age-related differences vary considerably as a function of task characteristics, in particular the learning requirements of the task. In decisions from experience, age-related differences in risk taking were a function of decreased learning performance: older adults were more risk seeking compared to younger adults when learning led to risk-avoidant behavior, but were more risk averse when learning led to risk-seeking behavior. In decisions from description, younger adults and older adults showed similar risk-taking behavior for the majority of the tasks, and there were no clear age-related differences as a function of gain/loss framing. We discuss limitations and strengths of past research and provide suggestions for future work on age-related differences in risk taking.
| S-EPMC3332530 | biostudies-literature
Project description:Addictions are characterized by choices made to satisfy the addiction despite the risk it could produce an adverse consequence. Here, we developed a murine version of a 'risky decision-making' task (RDT), in which mice could respond on a touchscreen panel to obtain either a large milkshake reward associated with varying probability of footshock, or a smaller amount of the same reward that was never punished. Results showed that (the following font is incorrectly smaller/subscripted) mice shifted choice from the large to small reward stimulus as shock probability increased. Immunohistochemical analysis revealed more Fos-positive cells in prelimbic cortex (PL) and basal amygdala (BA) after RDT testing, and a strong anti-correlation between infralimbic cortex (IL) activity and choice of the large reward stimulus under likely (75-100 % probability) punishment. These findings establish an assay for risky choice in mice and provide preliminary insight into the underlying neural substrates.
| S-EPMC7423716 | biostudies-literature
Project description:We examine the effects of multiple sources of noise in risky decision making. Noise in the parameters that characterize an individual's preferences can combine with noise in the response process to distort observed choice proportions. Thus, underlying preferences that conform to expected value maximization can appear to show systematic risk aversion or risk seeking. Similarly, core preferences that are consistent with expected utility theory, when perturbed by such noise, can appear to display nonlinear probability weighting. For this reason, modal choices cannot be used simplistically to infer underlying preferences. Quantitative model fits that do not allow for both sorts of noise can lead to wrong conclusions. (PsycINFO Database Record
| S-EPMC5619393 | biostudies-literature