COCO-Search18 fixation dataset for predicting goal-directed attention control.
Ontology highlight
ABSTRACT:
SUBMITTER: Chen Y
PROVIDER: S-EPMC8062491 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Understanding how goals control behavior is a question ripe for interrogation by new methods from machine learning. These methods require large and labeled datasets to train models. To annotate a large-scale image dataset with observed search fixations, we collected 16,184 fixations from people searching for either microwaves or clocks in a dataset of 4,366 images (MS-COCO). We then used this behaviorally-annotated dataset and the machine learning method of inverse-reinforcement learning (IRL) to learn target-specific reward functions and policies for these two target goals. Finally, we used these learned policies to predict the fixations of 60 new behavioral searchers (clock = 30, microwave = 30) in a disjoint test dataset of kitchen scenes depicting both a microwave and a clock (thus controlling for differences in low-level image contrast). We found that the IRL model predicted behavioral search efficiency and fixation-density maps using multiple metrics. Moreover, reward maps from the IRL model revealed target-specific patterns that suggest, not just attention guidance by target features, but also guidance by scene context (e.g., fixations along walls in the search of clocks). Using machine learning and the psychologically meaningful principle of reward, it is possible to learn the visual features used in goal-directed attention control.
| S-EPMC8218820 | biostudies-literature
Project description:Human gaze behavior prediction is important for behavioral vision and for computer vision applications. Most models mainly focus on predicting free-viewing behavior using saliency maps, but do not generalize to goal-directed behavior, such as when a person searches for a visual target object. We propose the first inverse reinforcement learning (IRL) model to learn the internal reward function and policy used by humans during visual search. We modeled the viewer's internal belief states as dynamic contextual belief maps of object locations. These maps were learned and then used to predict behavioral scanpaths for multiple target categories. To train and evaluate our IRL model we created COCO-Search18, which is now the largest dataset of high-quality search fixations in existence. COCO-Search18 has 10 participants searching for each of 18 target-object categories in 6202 images, making about 300,000 goal-directed fixations. When trained and evaluated on COCO-Search18, the IRL model outperformed baseline models in predicting search fixation scanpaths, both in terms of similarity to human search behavior and search efficiency. Finally, reward maps recovered by the IRL model reveal distinctive target-dependent patterns of object prioritization, which we interpret as a learned object context.
| S-EPMC8218821 | biostudies-literature
Project description:Deficits in attention and executive control are some of the most common, debilitating and persistent consequences of brain injuries. Understanding neural mechanisms that support clinically significant improvements, when they do occur, may help advance treatment development. Intervening via rehabilitation provides an opportunity to probe such mechanisms. Our objective was to identify neural mechanisms that underlie improvements in attention and executive control with rehabilitation training. We tested the hypothesis that intensive training enhances modulatory control of neural processing of perceptual information in patients with acquired brain injuries. Patients (n=12) participated either in standardized training designed to target goal-directed attention regulation, or a comparison condition (brief education). Training resulted in significant improvements on behavioural measures of attention and executive control. Functional magnetic resonance imaging methods adapted for testing the effects of intervention for patients with varied injury pathology were used to index modulatory control of neural processing. Pattern classification was utilized to decode individual functional magnetic resonance imaging data acquired during a visual selective attention task. Results showed that modulation of neural processing in extrastriate cortex was significantly enhanced by attention regulation training. Neural changes in prefrontal cortex, a candidate mediator for attention regulation, appeared to depend on individual baseline state. These behavioural and neural effects did not occur with the comparison condition. These results suggest that enhanced modulatory control over visual processing and a rebalancing of prefrontal functioning may underlie improvements in attention and executive control.
| S-EPMC6410956 | biostudies-literature
Project description:Everyday behavior frequently involves encounters with multiple objects that compete for selection. For example, driving a car requires constant shifts of attention between oncoming traffic, rearview mirrors, and traffic signs and signals, among other objects. Behavioral goals often drive this selection process [1, 2]; however, they are not the sole determinant of selection. Physically salient objects, such as flashing, brightly colored hazard signs, or objects that are salient by virtue of learned associations with reward, such as pictures of food on a billboard, often capture attention regardless of the individual's goals [3-6]. It is typically thought that strongly salient distractor objects capture more attention and are more disruptive than weakly salient distractors [7, 8]. Counterintuitively, though, we found that this is true for perception, but not for goal-directed action. In a visually guided reaching task [9-11], we required participants to reach to a shape-defined target while trying to ignore salient distractors. We observed that strongly salient distractors produced less disruption in goal-directed action than weakly salient distractors. Thus, a strongly salient distractor triggers suppression during goal-directed action, resulting in enhanced efficiency and accuracy of target selection relative to when weakly salient distractors are present. In contrast, in a task requiring no goal-directed action, we found greater attentional interference from strongly salient distractors. Thus, while highly salient stimuli interfere strongly with perceptual processing, increased physical salience or associated value attenuates action-related interference.
| S-EPMC4526432 | biostudies-literature
Project description:IntroductionHarmful behavior such as smoking may reflect a disturbance in the balance of goal-directed and habitual control. Animal models suggest that habitual control develops after prolonged substance use. In this study, we investigated whether smokers (N = 49) differ from controls (N = 46) in the regulation of goal-directed and habitual behavior. It was also investigated whether individual differences in nicotine dependence levels were associated with habitual responding.MethodsWe used two different multistage instrumental learning tasks that consist of an instrumental learning phase, subsequent outcome devaluation, and a testing phase to measure the balance between goal-directed and habitual responding. The testing phases of these tasks occurred after either appetitive versus avoidance instrumental learning. The appetitive versus aversive instrumental learning stages in the two different tasks modeled positive versus negative reinforcement, respectively.ResultsSmokers and nonsmoking controls did not differ on habitual versus goal-directed control in either task. Individual differences in nicotine dependence within the group of smokers, however, were positively associated with habitual responding after appetitive instrumental learning. This effect seems to be due to impaired stimulus-outcome learning, thereby hampering goal-directed task performance and tipping the balance to habitual responding.ConclusionsThe current finding highlights the importance of individual differences within smokers. For future research, neuroimaging studies are suggested to further unravel the nature of the imbalance between goal-directed versus habitual control in severely dependent smokers by directly measuring activity in the corresponding brain systems.ImplicationsGoal-directed versus habitual behavior in substance use and addiction is highly debated. This study investigated goal-directed versus habitual control in smokers. The findings suggest that smokers do not differ from controls in goal-directed versus habitual control. Individual differences in nicotine dependence within smokers, however, were positively associated with habitual responding after appetitive instrumental learning. This effect seems to be due to impaired stimulus-outcome learning, thereby hampering goal-directed task performance and tipping the balance to habitual responding. These findings add to the ongoing debate on habitual versus goal-directed control in addiction and emphasize the importance of individual differences within smokers.
| S-EPMC7004226 | biostudies-literature
Project description:In daily life, humans interact with multiple objects in complex environments. A large body of literature demonstrates that target selection is biased toward recently attended features, such that reaches are faster and trajectory curvature is reduced when target features (i.e., color) are repeated (priming of pop-out). In the real world, however, objects are comprised of several features-some of which may be more suitable for action than others. When fetching a mug from the cupboard, for example, attention not only has to be allocated to the object, but also the handle. To date, no study has investigated the impact of hierarchical feature organization on target selection for action. Here, we employed a color-oddity search task in which targets were Pac-men (i.e., a circle with a triangle cut out) oriented to be either consistent or inconsistent with the percept of a global Kanizsa triangle. We found that reaches were initiated faster when a task-irrelevant illusory figure was present independent of color repetition. Additionally, consistent with priming of pop-out, both reach planning and execution were facilitated when local target colors were repeated, regardless of whether a global figure was present. We also demonstrated that figures defined by illusory, but not real contours, afforded an early target selection benefit. In sum, these findings suggest that when local targets are perceptually grouped to form an illusory surface, attention quickly spreads across the global figure and facilitates the early stage of reach planning, but not execution. In contrast, local color priming is evident throughout goal-directed reaching.
| S-EPMC4979628 | biostudies-literature
Project description:Dual-task studies have shown higher sensitivity for stimuli presented at the targets of upcoming actions. We examined whether attention is directed to action targets for the purpose of action selection, or if attention is directed to these locations because they are expected to provide feedback about movement outcomes. In our experiment, endpoint accuracy feedback was spatially separated from the action targets to determine whether attention would be allocated to (a) the action targets, (b) the expected source of feedback, or (c) to both locations. Participants reached towards a location indicated by an arrow while identifying a discrimination target that could appear in any one of eight possible locations. Discrimination target accuracy was used as a measure of attention allocation. Participants were unable to see their hand during reaching and were provided with a small monetary reward for each accurate movement. Discrimination target accuracy was best at action targets but was also enhanced at the spatially separated feedback locations. Separating feedback from the reaching targets did not diminish discrimination accuracy at the movement targets but did result in delayed movement initiation and reduced reaching accuracy, relative to when feedback was presented at the reaching target. The results suggest attention is required for both action planning and monitoring movement outcomes. Dividing attention between these functions negatively impacts action performance.
| S-EPMC7040085 | biostudies-literature
Project description:Our daily decisions are governed by the arbitration between goal-directed and habitual strategies. However, the neurochemical basis of this arbitration is unclear. We assessed the contribution of dopaminergic, serotonergic, and opioidergic systems to this balance across reward and loss domains. Thirty-nine participants (17 healthy controls, 15 patients with pathological gambling, and 7 with binge eating disorder) underwent positron emission tomography (PET) imaging with [18F]FDOPA, [11C]MADAM and [11C]carfentanil to assess presynaptic dopamine, and serotonin transporter and mu-opioid receptor binding potential. Separately, participants completed a modified two-step task, which quantifies the degree to which decision-making is influenced by goal-directed or habitual strategies. All participants completed a version with reward outcomes; healthy controls additionally completed a version with loss outcomes. In the context of rewarding outcomes, we found that greater serotonin transporter binding potential in prefrontal regions was associated with habitual control, while greater serotonin transporter binding potential in the putamen was marginally associated with goal-directed control; however, the findings were no longer significant when controlling for the opposing valence (loss). In blocks with loss outcomes, we found that the opioidergic system, specifically greater [11C]carfentanil binding potential, was positively associated with goal-directed control and negatively associated with habit-directed control. Our findings illuminate the complex neurochemical basis of goal-directed and habitual behavior, implicating differential roles for prefrontal and subcortical serotonin in decision-making across healthy and pathological populations.
| S-EPMC7054261 | biostudies-literature
Project description:What are the cortical neural correlates that distinguish goal-directed and non-goal-directed movements? We investigated this question in the monkey frontal eye field (FEF), which is implicated in voluntary control of saccades. Here, we compared FEF activity associated with goal-directed (G) saccades and non-goal-directed (nG) saccades made by the monkey. Although the FEF neurons discharged before these nG saccades, there were three major differences in the neural activity: First, the variability in spike rate across trials decreased only for G saccades. Second, the local field potential beta-band power decreased during G saccades but did not change during nG saccades. Third, the time from saccade direction selection to the saccade onset was significantly longer for G saccades compared with nG saccades. Overall, our results reveal unexpected differences in neural signatures for G versus nG saccades in a brain area that has been implicated selectively in voluntary control. Taken together, these data add critical constraints to the way we think about saccade generation in the brain.
| S-EPMC8017686 | biostudies-literature
Project description:BackgroundAttentional processes are modulated by current goal pursuit. While pursuing salient cognitive goals, individuals prioritize goal-related information and suppress goal-irrelevant ones. This occurs in the context of pain too, where nonpain cognitive goal pursuit was found to have inhibitory effects on pain-related attention. Crucially, how pursuing nonpain motor goals affects pain-related somatosensory attention is still unknown. The aim of this study was to investigate whether nonpain motor goal pursuit would attenuate pain-related somatosensory attention.MethodsHealthy volunteers (N = 45) performed a robotic arm conditioning task where movements were paired with conflicting (pain and reward), threatening (only pain) or neutral (no pain and no reward) outcomes. To increase the motivational value of pursuing the nonpain motor goal, in the conflicting condition participants could receive a reward for a good motor performance. To examine somatosensory attention during movement, somatosensory evoked potentials (SEPs; N120 and P200) were obtained in response to innocuous tactile stimuli administered on a pain-relevant or pain-irrelevant body location. We expected that the threat of pain would enhance somatosensory attention. Furthermore, we expected that the possibility of getting a reward would inhibit this effect, due to pain-reward interactions.ResultsAgainst our predictions, the amplitude of the N120 did not differ across movement types and locations. Furthermore, the P200 component showed significantly larger SEPs for conflicting and threat movements compared to neutral, suggesting that the threat of pain increased somatosensory attention. However, this effect was not modulated by nonpain motor goal pursuit, as reflected by the lack of modulation of the N120 and P200 in the conflicting condition as compared to the threat condition. This study corroborates the idea that pain-related somatosensory attention is enhanced by threat of pain, even when participants were motivated to move to obtain a reward.
| S-EPMC10748472 | biostudies-literature