Humans use Optokinetic Eye Movements to Track Waypoints for Steering.
Ontology highlight
ABSTRACT:
SUBMITTER: Lappi O
PROVIDER: S-EPMC7060325 | biostudies-literature | 2020 Mar
REPOSITORIES: biostudies-literature
Publications
Humans use Optokinetic Eye Movements to Track Waypoints for Steering.
Lappi Otto O Pekkanen Jami J Rinkkala Paavo P Tuhkanen Samuel S Tuononen Ari A Virtanen Juho-Pekka JP
Scientific reports 20200306 1
It is well-established how visual stimuli and self-motion in laboratory conditions reliably elicit retinal-image-stabilizing compensatory eye movements (CEM). Their organization and roles in natural-task gaze strategies is much less understood: are CEM applied in active sampling of visual information in human locomotion in the wild? If so, how? And what are the implications for guidance? Here, we directly compare gaze behavior in the real world (driving a car) and a fixed base simulation steerin ...[more]
Similar Datasets
Project description:A major unresolved question in understanding visually guided locomotion in humans is whether actions are driven solely by the immediately available optical information (model-free online control mechanisms), or whether internal models have a role in anticipating the future path. We designed two experiments to investigate this issue, measuring spontaneous gaze behaviour while steering, and predictive gaze behaviour when future path information was withheld. In Experiment 1 participants (N = 15) steered along a winding path with rich optic flow: gaze patterns were consistent with tracking waypoints on the future path 1-3 s ahead. In Experiment 2, participants (N = 12) followed a path presented only in the form of visual waypoints located on an otherwise featureless ground plane. New waypoints appeared periodically every 0.75 s and predictably 2 s ahead, except in 25% of the cases the waypoint at the expected location was not displayed. In these cases, there were always other visible waypoints for the participant to fixate, yet participants continued to make saccades to the empty, but predictable, waypoint locations (in line with internal models of the future path guiding gaze fixations). This would not be expected based upon existing model-free online steering control models, and strongly points to a need for models of steering control to include mechanisms for predictive gaze control that support anticipatory path following behaviours.
| S-EPMC6554351 | biostudies-literature
Project description:Some locomotor tasks involve steering at high speeds through multiple waypoints within cluttered environments. Although in principle actors could treat each individual waypoint in isolation, skillful performance would seem to require them to adapt their trajectory to the most immediate waypoint in anticipation of subsequent waypoints. To date, there have been few studies of such behavior, and the evidence that does exist is inconclusive about whether steering is affected by multiple future waypoints. The present study was designed to address the need for a clearer understanding of how humans adapt their steering movements in anticipation of future goals. Subjects performed a simulated drone flying task in a forest-like virtual environment that was presented on a monitor while their eye movements were tracked. They were instructed to steer through a series of gates while the distance at which gates first became visible (i.e., lookahead distance) was manipulated between trials. When gates became visible at least 1-1/2 segments in advance, subjects successfully flew through a high percentage of gates, rarely collided with obstacles, and maintained a consistent speed. They also approached the most immediate gate in a way that depended on the angular position of the subsequent gate. However, when the lookahead distance was less than 1-1/2 segments, subjects followed longer paths and flew at slower, more variable speeds. The findings demonstrate that the control of steering through multiple waypoints does indeed depend on information from beyond the most immediate waypoint. Discussion focuses on the possible control strategies for steering through multiple waypoints.
| S-EPMC11305437 | biostudies-literature
Project description:Across species, the optokinetic reflex (OKR) stabilizes vision during self-motion. OKR occurs when ON direction-selective retinal ganglion cells (oDSGCs) detect slow, global image motion on the retina. How oDSGC activity is integrated centrally to generate behavior remains unknown. Here, we discover mechanisms that contribute to motion encoding in vertically tuned oDSGCs and leverage these findings to empirically define signal transformation between retinal output and vertical OKR behavior. We demonstrate that motion encoding in vertically tuned oDSGCs is contrast-sensitive and asymmetric for oDSGC types that prefer opposite directions. These phenomena arise from the interplay between spike threshold nonlinearities and differences in synaptic input weights, including shifts in the balance of excitation and inhibition. In behaving mice, these neurophysiological observations, along with a central subtraction of oDSGC outputs, accurately predict the trajectories of vertical OKR across stimulus conditions. Thus, asymmetric tuning across competing sensory channels can critically shape behavior.
| S-EPMC10023158 | biostudies-literature
Project description:Experiments in animal models have shown that running increases neuronal activity in early visual areas in light as well as in darkness. This suggests that visual processing is influenced by locomotion independent of visual input. Combining mobile electroencephalography, motion- and eye-tracking, we investigated the influence of overground free walking on cortical alpha activity (~10 Hz) and eye movements in healthy humans. Alpha activity has been considered a valuable marker of inhibition of sensory processing and shown to negatively correlate with neuronal firing rates. We found that walking led to a decrease in alpha activity over occipital cortex compared to standing. This decrease was present during walking in darkness as well as during light. Importantly, eye movements could not explain the change in alpha activity. Nevertheless, we found that walking and eye related movements were linked. While the blink rate increased with increasing walking speed independent of light or darkness, saccade rate was only significantly linked to walking speed in the light. Pupil size, on the other hand, was larger during darkness than during light, but only showed a modulation by walking in darkness. Analyzing the effect of walking with respect to the stride cycle, we further found that blinks and saccades preferentially occurred during the double support phase of walking. Alpha power, as shown previously, was lower during the swing phase than during the double support phase. We however could exclude the possibility that the alpha modulation was introduced by a walking movement induced change in electrode impedance. Overall, our work indicates that the human visual system is influenced by the current locomotion state of the body. This influence affects eye movement pattern as well as neuronal activity in sensory areas and might form part of an implicit strategy to optimally extract sensory information during locomotion.
| S-EPMC7782973 | biostudies-literature
Project description:Lesion studies argue for an involvement of cortical area dorsal medial superior temporal area (MSTd) in the control of optokinetic response (OKR) eye movements to planar visual stimulation. Neural recordings during OKR suggested that MSTd neurons directly encode stimulus velocity. On the other hand, studies using radial visual flow together with voluntary smooth pursuit eye movements showed that visual motion responses were modulated by eye movement-related signals. Here, we investigated neural responses in MSTd during continuous optokinetic stimulation using an information-theoretic approach for characterizing neural tuning with high resolution. We show that the majority of MSTd neurons exhibit gain-field-like tuning functions rather than directly encoding one variable. Neural responses showed a large diversity of tuning to combinations of retinal and extraretinal input. Eye velocity-related activity was observed prior to the actual eye movements, reflecting an efference copy. The observed tuning functions resembled those emerging in a network model trained to perform summation of 2 population-coded signals. Together, our findings support the hypothesis that MSTd implements the visuomotor transformation from retinal to head-centered stimulus velocity signals for the control of OKR.
| S-EPMC4494029 | biostudies-literature
Project description:Contralateral hemispheric representation of sensory inputs (the right visual hemifield in the left hemisphere and vice versa) is a fundamental feature of primate sensorimotor organization, in particular the visuomotor system. However, many higher-order cognitive functions in humans show an asymmetric hemispheric lateralization--e.g., right brain specialization for spatial processing--necessitating a convergence of information from both hemifields. Electrophysiological studies in monkeys and functional imaging in humans have investigated space and action representations at different stages of visuospatial processing, but the transition from contralateral to unified global spatial encoding and the relationship between these encoding schemes and functional lateralization are not fully understood. Moreover, the integration of data across monkeys and humans and elucidation of interspecies homologies is hindered, because divergent findings may reflect actual species differences or arise from discrepancies in techniques and measured signals (electrophysiology vs. imaging). Here, we directly compared spatial cue and memory representations for action planning in monkeys and humans using event-related functional MRI during a working-memory oculomotor task. In monkeys, cue and memory-delay period activity in the frontal, parietal, and temporal regions was strongly contralateral. In putative human functional homologs, the contralaterality was significantly weaker, and the asymmetry between the hemispheres was stronger. These results suggest an inverse relationship between contralaterality and lateralization and elucidate similarities and differences in human and macaque cortical circuits subserving spatial awareness and oculomotor goal-directed actions.
| S-EPMC2867911 | biostudies-literature
Project description:Animal behavior constantly adapts to changes, for example when the statistical properties of the environment change unexpectedly. For an agent that interacts with this volatile setting, it is important to react accurately and as quickly as possible. It has already been shown that when a random sequence of motion ramps of a visual target is biased to one direction (e.g. right or left), human observers adapt their eye movements to accurately anticipate the target's expected direction. Here, we prove that this ability extends to a volatile environment where the probability bias could change at random switching times. In addition, we also recorded the explicit prediction of the next outcome as reported by observers using a rating scale. Both results were compared to the estimates of a probabilistic agent that is optimal in relation to the assumed generative model. Compared to the classical leaky integrator model, we found a better match between our probabilistic agent and the behavioral responses, both for the anticipatory eye movements and the explicit task. Furthermore, by controlling the level of preference between exploitation and exploration in the model, we were able to fit for each individual's experimental dataset the most likely level of volatility and analyze inter-individual variability across participants. These results prove that in such an unstable environment, human observers can still represent an internal belief about the environmental contingencies, and use this representation both for sensory-motor control and for explicit judgments. This work offers an innovative approach to more generically test the diversity of human cognitive abilities in uncertain and dynamic environments.
| S-EPMC7179935 | biostudies-literature
Project description:Fast saccades are rapid automatic oculomotor responses to salient and ecologically important visual stimuli such as animals and faces. Discriminating the number of friends, foe, or prey may also have an evolutionary advantage. In this study, participants were asked to saccade rapidly towards the more numerous of two arrays. Participants could discriminate numerosities with high accuracy and great speed, as fast as 190 ms. Intermediate numerosities were more likely to elicit fast saccades than very low or very high numerosities. Reaction-times for vocal responses (collected in a separate experiment) were slower, did not depend on numerical range, and correlated only with the slow not the fast saccades, pointing to different systems. The short saccadic reaction-times we observe are surprising given that discrimination using numerosity estimation is thought to require a relatively complex neural circuit, with several relays of information through the parietal and prefrontal cortex. Our results suggest that fast numerosity-driven saccades may be generated on a single feed-forward pass of information recruiting a primitive system that cuts through the cortical hierarchy and rapidly transforms the numerosity information into a saccade command.
| S-EPMC7542817 | biostudies-literature
Project description:Despite the enduring interest in motion integration, a direct measure of the space-time filter that the brain imposes on a visual scene has been elusive. This is perhaps because of the challenge of estimating a 3D function from perceptual reports in psychophysical tasks. We take a different approach. We exploit the close connection between visual motion estimates and smooth pursuit eye movements to measure stimulus-response correlations across space and time, computing the linear space-time filter for global motion direction in humans and monkeys. Although derived from eye movements, we find that the filter predicts perceptual motion estimates quite well. To distinguish visual from motor contributions to the temporal duration of the pursuit motion filter, we recorded single-unit responses in the monkey middle temporal cortical area (MT). We find that pursuit response delays are consistent with the distribution of cortical neuron latencies and that temporal motion integration for pursuit is consistent with a short integration MT subpopulation. Remarkably, the visual system appears to preferentially weight motion signals across a narrow range of foveal eccentricities rather than uniformly over the whole visual field, with a transiently enhanced contribution from locations along the direction of motion. We find that the visual system is most sensitive to motion falling at approximately one-third the radius of the stimulus aperture. Hypothesizing that the visual drive for pursuit is related to the filtered motion energy in a motion stimulus, we compare measured and predicted eye acceleration across several other target forms.SIGNIFICANCE STATEMENT A compact model of the spatial and temporal processing underlying global motion perception has been elusive. We used visually driven smooth eye movements to find the 3D space-time function that best predicts both eye movements and perception of translating dot patterns. We found that the visual system does not appear to use all available motion signals uniformly, but rather weights motion preferentially in a narrow band at approximately one-third the radius of the stimulus. Although not universal, the filter predicts responses to other types of stimuli, demonstrating a remarkable degree of generalization that may lead to a deeper understanding of visual motion processing.
| S-EPMC5299399 | biostudies-other
Project description:Automated vehicles (AVs) will change the role of the driver, from actively controlling the vehicle to primarily monitoring it. Removing the driver from the control loop could fundamentally change the way that drivers sample visual information from the scene, and in particular, alter the gaze patterns generated when under AV control. To better understand how automation affects gaze patterns this experiment used tightly controlled experimental conditions with a series of transitions from 'Manual' control to 'Automated' vehicle control. Automated trials were produced using either a 'Replay' of the driver's own steering trajectories or standard 'Stock' trials that were identical for all participants. Gaze patterns produced during Manual and Automated conditions were recorded and compared. Overall the gaze patterns across conditions were very similar, but detailed analysis shows that drivers looked slightly further ahead (increased gaze time headway) during Automation with only small differences between Stock and Replay trials. A novel mixture modelling method decomposed gaze patterns into two distinct categories and revealed that the gaze time headway increased during Automation. Further analyses revealed that while there was a general shift to look further ahead (and fixate the bend entry earlier) when under automated vehicle control, similar waypoint-tracking gaze patterns were produced during Manual driving and Automation. The consistency of gaze patterns across driving modes suggests that active-gaze models (developed for manual driving) might be useful for monitoring driver engagement during Automated driving, with deviations in gaze behaviour from what would be expected during manual control potentially indicating that a driver is not closely monitoring the automated system.
| S-EPMC7794576 | biostudies-literature