Entropy-based metrics for predicting choice behavior based on local response to reward
Ontology highlight
ABSTRACT:
SUBMITTER: Trepka E
PROVIDER: S-EPMC8590026 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Nodal spreading influence is the capability of a node to activate the rest of the network when it is the seed of spreading. Combining nodal properties (centrality metrics) derived from local and global topological information respectively has been shown to better predict nodal influence than using a single metric. In this work, we investigate to what extent local and global topological information around a node contributes to the prediction of nodal influence and whether relatively local information is sufficient for the prediction. We show that by leveraging the iterative process used to derive a classical nodal centrality such as eigenvector centrality, we can define an iterative metric set that progressively incorporates more global information around the node. We propose to predict nodal influence using an iterative metric set that consists of an iterative metric from order 1 to K produced in an iterative process, encoding gradually more global information as K increases. Three iterative metrics are considered, which converge to three classical node centrality metrics, respectively. In various real-world networks and synthetic networks with community structures, we find that the prediction quality of each iterative based model converges to its optimal when the metric of relatively low orders ( K∼4 ) are included and increases only marginally when further increasing K. This fast convergence of prediction quality with K is further explained by analyzing the correlation between the iterative metric and nodal influence, the convergence rate of each iterative process and network properties. The prediction quality of the best performing iterative metric set with K=4 is comparable with the benchmark method that combines seven centrality metrics: their prediction quality ratio is within the range [91%,106%] across all three quality measures and networks. In two spatially embedded networks with an extremely large diameter, however, iterative metric of higher orders, thus a large K, is needed to achieve comparable prediction quality with the benchmark.
| S-EPMC10901818 | biostudies-literature
Project description:Emotional experience has a pervasive impact on choice behavior, yet the underlying mechanism remains unclear. Introducing facial-expression primes into a probabilistic learning task, we investigated how affective arousal regulates reward-related choice based on behavioral, model fitting, and feedback-related negativity (FRN) data. Sixty-six paid subjects were randomly assigned to the Neutral-Neutral (NN), Angry-Neutral (AN), and Happy-Neutral (HN) groups. A total of 960 trials were conducted. Subjects in each group were randomly exposed to half trials of the pre-determined emotional faces and another half of the neutral faces before choosing between two cards drawn from two decks with different assigned reward probabilities. Trial-by-trial data were fit with a standard reinforcement learning model using the Bayesian estimation approach. The temporal dynamics of brain activity were simultaneously recorded and analyzed using event-related potentials. Our analyses revealed that subjects in the NN group gained more reward values than those in the other two groups; they also exhibited comparatively differential estimated model-parameter values for reward prediction errors. Computing the difference wave of FRNs in reward vs. non-reward trials, we found that, compared to the NN group, subjects in the AN and HN groups had larger "General" FRNs (i.e., FRNs in no-reward trials minus FRNs in reward trials) and "Expected" FRNs (i.e., FRNs in expected reward-omission trials minus FRNs in expected reward-delivery trials), indicating an interruption in predicting reward. Further, both AN and HN groups appeared to be more sensitive to negative outcomes than the NN group. Collectively, our study suggests that affective arousal negatively regulates reward-related choice, probably through overweighting with negative feedback.
| S-EPMC4434921 | biostudies-literature
Project description:Boredom has been defined as an aversive mental state that is induced by the disability to engage in satisfying activity, most often experienced in monotonous environments. However, current understanding of the situational factors inducing boredom and driving subsequent behavior remains incomplete. Here, we introduce a two-alternative forced-choice task coupled with sensory stimulation of different degrees of monotony. We find that human subjects develop a bias in decision-making, avoiding the more monotonous alternative that is correlated with self-reported state boredom. This finding was replicated in independent laboratory and online experiments and proved to be specific for the induction of boredom rather than curiosity. Furthermore, using theoretical modeling we show that the entropy in the sequence of individually experienced stimuli, a measure of information gain, serves as a major determinant to predict choice behavior in the task. With this, we underline the relevance of boredom for driving behavioral responses that ensure a lasting stream of information to the brain.
| S-EPMC8873446 | biostudies-literature
Project description:Spine motility analysis has become the mainstay for investigating synaptic plasticity but is limited in its versatility requiring complex, non automatized instrumentations. We describe an entropy-based method for determining the spatial distribution of dendritic spines that allows successful estimation of spine motility from still images. This method has the potential to extend the applicability of spine motility analysis to ex vivo preparations.
| S-EPMC4588562 | biostudies-literature
Project description:A key function of the nervous system is producing adaptive behavior across changing conditions, like physiological state. Although states like thirst and hunger are known to impact decision-making, the neurobiology of this phenomenon has been studied minimally. Here, we tracked evolving preference for sucrose and water as rats proceeded from a thirsty to sated state. As rats shifted from water choices to sucrose choices across the session, the activity of a majority of neurons in the ventral pallidum, a region crucial for reward-related behaviors, closely matched the evolving behavioral preference. The timing of this signal followed the pattern of a reward prediction error, occurring at the cue or the reward depending on when reward identity was revealed. Additionally, optogenetic stimulation of ventral pallidum neurons at the time of reward was able to reverse behavioral preference. Our results suggest that ventral pallidum neurons guide reward-related decisions across changing physiological states.
| S-EPMC7673692 | biostudies-literature
Project description:Landscape is an ecological category represented by a complex system formed by interactions between society and nature. Spatial patterns of different land uses present in a landscape reveal past and present processes responsible for its dynamics and organisation. Measuring the complexity of these patterns (in the sense of their spatial heterogeneity) allows us to evaluate the integrity and resilience of these complex environmental systems. Here, we show how landscape metrics based on information entropy can be applied to evaluate the complexity (in the sense of spatial heterogeneity) of patches patterns, as well as their transition zones, present in a Cerrado conservation area and its surroundings, located in south-eastern Brazil. The analysis in this study aimed to elucidate how changes in land use and the consequent fragmentation affect the complexity of the landscape. The scripts CompPlex HeROI and CompPlex Janus were created to allow calculation of information entropy (He), variability (He/Hmax), and López-Ruiz, Mancini, and Calbet (LMC) and Shiner, Davison, and Landsberg (SDL) measures. CompPlex HeROI enabled the calculation of these measures for different regions of interest (ROIs) selected in a satellite image of the study area, followed by comparison of the complexity of their patterns, in addition to enabling the generation of complexity signatures for each ROI. CompPlex Janus made it possible to spatialise the results for these four measures in landscape complexity maps. As expected, both for the complexity patterns evaluated by CompPlex HeROI and the complexity maps generated by CompPlex Janus, the areas with vegetation located in a region of intermediate spatial heterogeneity had lower values for the He and He/Hmax measures and higher values for the LMC and SDL measurements. So, these landscape metrics were able to capture the behaviour of the patterns of different types of land use present in the study area, bringing together uses linked to vegetation with increased canopy coverage and differentiating them from urban areas and transition areas that mix different uses. Thus, the algorithms implemented in these scripts were demonstrated to be robust and capable of measuring the variability in information levels from the landscape, not only in terms of spatial datasets but also spectrally. The automation of measurement calculations, owing to informational entropy provided by these scripts, allows a quick assessment of the complexity of patterns present in a landscape, and thus, generates indicators of landscape integrity and resilience.
| S-EPMC8775317 | biostudies-literature
Project description:While it is known that reward induces attentional prioritization, it is not clear what effect reward-learning has when associated with stimuli that are not fully perceived. The masked priming paradigm has been extensively used to investigate the indirect impact of brief stimuli on response behavior. Interestingly, the effect of masked primes is observed even when participants choose their responses freely. While classical theories assume this process to be automatic, recent studies have provided evidence for attentional modulations of masked priming effects. Most such studies have manipulated bottom-up or top-down modes of attentional selection, but the role of "newer" forms of attentional control such as reward-learning and selection history remains unclear. In two experiments, with number and arrow primes, we examined whether reward-mediated attentional selection modulates masked priming when responses are chosen freely. In both experiments, we observed that primes associated with high-reward lead to enhanced free-choice priming compared to primes associated with no-reward. The effect was seen on both proportion of choices and response times, and was more evident in the faster responses. In the slower responses, the effect was diminished. Our study adds to the growing literature showing the susceptibility of masked priming to factors related to attention and executive control.
| S-EPMC7733960 | biostudies-literature
Project description:INTRODUCTION:Unobtrusive metrics that can auto-assess performance during clinical procedures are of value. Three approaches to deriving wearable technology-based metrics are explored: (1) eye tracking, (2) psychophysiological measurements [e.g. electrodermal activity (EDA)] and (3) arm and hand movement via accelerometry. We also measure attentional capacity by tasking the operator with an additional task to track an unrelated object during the procedure. METHODS:Two aspects of performance are measured: (1) using eye gaze and psychophysiology metrics and (2) measuring attentional capacity via an additional unrelated task (to monitor a visual stimulus/playing cards). The aim was to identify metrics that can be used to automatically discriminate between levels of performance or at least between novices and experts. The study was conducted using two groups: (1) novice operators and (2) expert operators. Both groups made two attempts at a coronary angiography procedure using a full-physics virtual reality simulator. Participants wore eye tracking glasses and an E4 wearable wristband. Areas of interest were defined to track visual attention on display screens, including: (1) X-ray, (2) vital signs, (3) instruments and (4) the stimulus screen (for measuring attentional capacity). RESULTS:Experts provided greater dwell time (63% vs 42%, p?=?0.03) and fixations (50% vs 34%, p?=?0.04) on display screens. They also provided greater dwell time (11% vs 5%, p?=?0.006) and fixations (9% vs 4%, p?=?0.007) when selecting instruments. The experts' performance for tracking the unrelated object during the visual stimulus task negatively correlated with total errors (r?=?-?0.95, p?=?0.0009). Experts also had a higher standard deviation of EDA (2.52 µS vs 0.89 µS, p?=?0.04). CONCLUSIONS:Eye tracking metrics may help discriminate between a novice and expert operator, by showing that experts maintain greater visual attention on the display screens. In addition, the visual stimulus study shows that an unrelated task can measure attentional capacity. Trial registration This work is registered through clinicaltrials.gov, a service of the U.S. National Health Institute, and is identified by the trial reference: NCT02928796.
| S-EPMC6420895 | biostudies-literature
Project description:Neuronal alternative splicing is a key gene regulatory mechanism in brain. Yet the spliceosome machinery is insufficient to fully specify splicing complexity. In considering the role of the epigenome in activity-dependent alternative splicing, we and others find the histone modification, H3K36me3, to be a putative splicing regulator. In the current study, we found that mouse cocaine self-administration caused widespread differential alternative splicing, concomitant with enrichment of H3K36me3 at differentially spliced junctions. Importantly, only targeted epigenetic editing can distinguish between a direct role of H3K36me3 in splicing and an indirect role via regulation of splice factor expression elsewhere on the genome. We targeted Srsf11, which was both alternatively spliced and H3K36me3 enriched in brain following cocaine self-administration. Results: Epigenetic editing of H3K36me3 at Srsf11 was sufficient to drive its alternative splicing and enhanced cocaine self-administration, establishing the direct causal relevance of H3K36me3 to alternative splicing of Srsf11 and to reward behavior.
2021-07-31 | GSE180988 | GEO
Project description:Decision making is often considered to arise out of contributions from a model-free habitual system and a model-based goal-directed system. Here, we investigated the effect of a dopamine manipulation on the degree to which either system contributes to instrumental behavior in a two-stage Markov decision task, which has been shown to discriminate model-free from model-based control. We found increased dopamine levels promote model-based over model-free choice.
| S-EPMC3417237 | biostudies-literature