Dataset Information

Behavioral and oculomotor evidence for visual simulation of object movement.

ABSTRACT: We regularly interact with moving objects in our environment. Yet, little is known about how we extrapolate the future movements of visually perceived objects. One possibility is that movements are experienced by a mental visual simulation, allowing one to internally picture an object's upcoming motion trajectory, even as the object itself remains stationary. Here we examined this possibility by asking human participants to make judgments about the future position of a falling ball on an obstacle-filled display. We found that properties of the ball's trajectory were highly predictive of subjects' reaction times and accuracy on the task. We also found that the eye movements subjects made while attempting to ascertain where the ball might fall had significant spatiotemporal overlap with those made while actually perceiving the ball fall. These findings suggest that subjects simulated the ball's trajectory to inform their responses. Finally, we trained a convolutional neural network to see whether this problem could be solved by simple image analysis as opposed to the more intricate simulation strategy we propose. We found that while the network was able to solve our task, the model's output did not effectively or consistently predict human behavior. This implies that subjects employed a different strategy for solving our task, and bolsters the conclusion that they were engaging in visual simulation. The current study thus provides support for visual simulation of motion as a means of understanding complex visual scenes and paves the way for future investigations of this phenomenon at a neural level.

SUBMITTER: Ahuja A

PROVIDER: S-EPMC6559752 | biostudies-literature | 2019 Jun

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Behavioral and oculomotor evidence for visual simulation of object movement.

Ahuja Aarit A Sheinberg David L DL

Journal of vision 20190601 6

We regularly interact with moving objects in our environment. Yet, little is known about how we extrapolate the future movements of visually perceived objects. One possibility is that movements are experienced by a mental visual simulation, allowing one to internally picture an object's upcoming motion trajectory, even as the object itself remains stationary. Here we examined this possibility by asking human participants to make judgments about the future position of a falling ball on an obstacl ...[more]

PMID: 31185095

Similar Datasets

Project description:BackgroundDuring visual exploration or free-view, gaze positioning is largely determined by the tendency to maximize visual saliency: more salient locations are more likely to be fixated. However, when visual input is completely irrelevant for performance, such as with non-visual tasks, this saliency maximization strategy may be less advantageous and potentially even disruptive for task-performance. Here, we examined whether visual saliency remains a strong driving force in determining gaze positions even in non-visual tasks. We tested three alternative hypotheses: a) That saliency is disadvantageous for non-visual tasks and therefore gaze would tend to shift away from it and towards non-salient locations; b) That saliency is irrelevant during non-visual tasks and therefore gaze would not be directed towards it but also not away-from it; c) That saliency maximization is a strong behavioral drive that would prevail even during non-visual tasks.MethodsGaze position was monitored as participants performed visual or non-visual tasks while they were presented with complex or simple images. The effect of attentional demands was examined by comparing an easy non-visual task with a more difficult one.ResultsExploratory behavior was evident, regardless of task difficulty, even when the task was non-visual and the visual input was entirely irrelevant. The observed exploratory behaviors included a strong tendency to fixate salient locations, central fixation bias and a gradual reduction in saliency for later fixations. These exploratory behaviors were spatially similar to those of an explicit visual exploration task but they were, nevertheless, attenuated. Temporal differences were also found: in the non-visual task there were longer fixations and later first fixations than in the visual task, reflecting slower visual sampling in this task.ConclusionWe conclude that in the presence of a rich visual environment, visual exploration is evident even when there is no explicit instruction to explore. Compared to visually motivated tasks, exploration in non-visual tasks follows similar selection mechanisms, but occurs at a lower rate. This is consistent with the view that the non-visual task is the equivalent of a dual-task: it combines the instructed task with an uninstructed, perhaps even mandatory, exploratory behavior.

Project description:Background:Athletic performance is affected by emotional state. Athletes may underperform in competition due to poor emotion regulation. Movement speed plays an important role in many competition events. Flexible control of movement speed is critical for effective athletic performance. Although behavioral evidence showed that negative emotion can influence movement speed, the nature of the relationship remains controversial. Thus, the present study investigated how negative emotion affects movement speed and the neural mechanism underlying the interaction between emotion processing and movement control. Methods:The present study combined electroencephalography (EEG) technology with a cued-action task to investigate the effect of negative emotion on movement speed. In total, 21 undergraduate students were recruited for this study. Participants were asked to perform six consecutive action tasks after viewing an emotional picture. Pictures were presented in two blocks (one negative and one neutral). After the participants completed a set of tasks (neutral of negative), they were subjected to complete a 9-point self-assessment manikin scale. Participants underwent EEG while performing the tasks. Results:At the behavior level, there was a significant main effect of emotional valence on movement speed, with participants exhibiting significantly slower movements in the negative emotional condition than in the neutral condition. EEG data showed increased theta oscillation and larger P1 amplitude in response to negative than to neural images suggesting that more cognitive resources were required to process negative than neutral images. EEG data also showed a larger late CNV area in the neutral condition than in the negative condition, which suggested that there was a significant decrease in brain activation during action tasks in negative emotional condition than in the neural. While the early CNV did not reveal a significant main effect of emotional valence. Conclusion:The present results indicate that a negative emotion can slow movement, which is largely due to negative emotional processing consuming more resources than non-emotional processing and this interference effect mainly occurred in the late movement preparation phase.

Dataset Information

Behavioral and oculomotor evidence for visual simulation of object movement.

Publications

Behavioral and oculomotor evidence for visual simulation of object movement.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets