A novel role for visual perspective cues in the neural computation of depth.
Ontology highlight
ABSTRACT:
SUBMITTER: Kim HR
PROVIDER: S-EPMC4281299 | biostudies-literature | 2015 Jan
REPOSITORIES: biostudies-literature
Publications
A novel role for visual perspective cues in the neural computation of depth.
Kim HyungGoo R HR Angelaki Dora E DE DeAngelis Gregory C GC
Nature neuroscience 20141201 1
As we explore a scene, our eye movements add global patterns of motion to the retinal image, complicating visual motion produced by self-motion or moving objects. Conventionally, it has been assumed that extraretinal signals, such as efference copy of smooth pursuit commands, are required to compensate for the visual consequences of eye rotations. We consider an alternative possibility: namely, that the visual system can infer eye rotations from global patterns of image motion. We visually simul ...[more]
Similar Datasets
Project description:BackgroundHow it is possible to "faithfully" represent a three-dimensional stereoscopic scene using Cartesian coordinates on a plane, and how three-dimensional perceptions differ between an actual scene and an image of the same scene are questions that have not yet been explored in depth. They seem like commonplace phenomena, but in fact, they are important and difficult issues for visual information processing, neural computation, physics, psychology, cognitive psychology, and neuroscience.ResultsThe results of this study show that the use of plenoptic (or all-optical) functions and their dual plane parameterizations can not only explain the nature of information processing from the retina to the primary visual cortex and, in particular, the characteristics of the visual pathway's optical system and its affine transformation, but they can also clarify the reason why the vanishing point and line exist in a visual image. In addition, they can better explain the reasons why a three-dimensional Cartesian coordinate system can be introduced into the two-dimensional plane to express a real three-dimensional scene.Conclusions1. We introduce two different mathematical expressions of the plenoptic functions, Pw and Pv that can describe the objective world. We also analyze the differences between these two functions when describing visual depth perception, that is, the difference between how these two functions obtain the depth information of an external scene.2. The main results include a basic method for introducing a three-dimensional Cartesian coordinate system into a two-dimensional plane to express the depth of a scene, its constraints, and algorithmic implementation. In particular, we include a method to separate the plenoptic function and proceed with the corresponding transformation in the retina and visual cortex.3. We propose that size constancy, the vanishing point, and vanishing line form the basis of visual perception of the outside world, and that the introduction of a three-dimensional Cartesian coordinate system into a two dimensional plane reveals a corresponding mapping between a retinal image and the vanishing point and line.
| S-EPMC4023552 | biostudies-literature
Project description:Strabismus is a relatively common ophthalmological condition where the coordination of eye muscles to binocularly fixate a single point in space is impaired. This leads to deficits in vision and particularly in three-dimensional (3D) space perception. The exact nature of the deficits in 3D perception is poorly understood as much of understanding has relied on anecdotal reports or conjecture. Here, we investigated, for the first time, the perception of relative depth comparing strabismic and typically developed binocular observers. Specifically, we assessed the susceptibility to the depth cue of perspective convergence as well as the capacity to use this cue to make accurate judgements of relative depth. Susceptibility was measured by examining a 3D bias in making two-dimensional (2D) interval equidistance judgements and accuracy was measured by examining 3D interval equidistance judgements. We tested both monocular and binocular viewing of images of perspective scenes under two different psychophysical methods: two-alternative forced-choice (2AFC) and the method of adjustment. The biasing effect of perspective information on the 2D judgements (3D cue susceptibility) was highly significant and comparable for both subject groups in both the psychophysical tasks (all ps < 0.001) with no statistically significant difference found between the two groups. Both groups showed an underestimation in the 3D task with no significant difference between the group's judgements in the 2AFC task, but a small statistically significant difference (ratio difference of approx. 10%, p = 0.016) in the method of adjustment task. A small but significant effect of viewing condition (monocular versus binocular) was revealed only in the non-strabismic group (ratio difference of approx. 6%, p = 0.002). Our results show that both the automatic susceptibility to, and accuracy in the use of, the perspective convergence cue in strabismus is largely comparable to that found in typically developed binocular vision, and have implications on the nature of the encoding of depth in the human visual system.
| S-EPMC7813253 | biostudies-literature
Project description:We investigated how interactions between monocular motion parallax and binocular cues to depth vary in human motion areas for wide-field visual motion stimuli (110 × 100°). We used fMRI with an extensive 2 × 3 × 2 factorial blocked design in which we combined two types of self-motion (translational motion and translational + rotational motion), with three categories of motion inflicted by the degree of noise (self-motion, distorted self-motion, and multiple object-motion), and two different view modes of the flow patterns (stereo and synoptic viewing). Interactions between disparity and motion category revealed distinct contributions to self- and object-motion processing in 3D. For cortical areas V6 and CSv, but not the anterior part of MT(+) with bilateral visual responsiveness (MT(+)/b), we found a disparity-dependent effect of rotational flow and noise: When self-motion perception was degraded by adding rotational flow and moderate levels of noise, the BOLD responses were reduced compared with translational self-motion alone, but this reduction was cancelled by adding stereo information which also rescued the subject's self-motion percept. At high noise levels, when the self-motion percept gave way to a swarm of moving objects, the BOLD signal strongly increased compared to self-motion in areas MT(+)/b and V6, but only for stereo in the latter. BOLD response did not increase for either view mode in CSv. These different response patterns indicate different contributions of areas V6, MT(+)/b, and CSv to the processing of self-motion perception and the processing of multiple independent motions.
| S-EPMC3857528 | biostudies-literature
Project description:Humans exploit a range of visual depth cues to estimate three-dimensional structure. For example, the slant of a nearby tabletop can be judged by combining information from binocular disparity, texture and perspective. Behavioral tests show humans combine cues near-optimally, a feat that could depend on discriminating the outputs from cue-specific mechanisms or on fusing signals into a common representation. Although fusion is computationally attractive, it poses a substantial challenge, requiring the integration of quantitatively different signals. We used functional magnetic resonance imaging (fMRI) to provide evidence that dorsal visual area V3B/KO meets this challenge. Specifically, we found that fMRI responses are more discriminable when two cues (binocular disparity and relative motion) concurrently signal depth, and that information provided by one cue is diagnostic of depth indicated by the other. This suggests a cortical node important when perceiving depth, and highlights computations based on fusion in the dorsal stream.
| S-EPMC3378632 | biostudies-literature
Project description:Humans can distinguish visual stimuli that differ by features the size of only a few photoreceptors. This is possible despite the incessant image motion due to fixational eye movements, which can be many times larger than the features to be distinguished. To perform well, the brain must identify the retinal firing patterns induced by the stimulus while discounting similar patterns caused by spontaneous retinal activity. This is a challenge since the trajectory of the eye movements, and consequently, the stimulus position, are unknown. We derive a decision rule for using retinal spike trains to discriminate between two stimuli, given that their retinal image moves with an unknown random walk trajectory. This algorithm dynamically estimates the probability of the stimulus at different retinal locations, and uses this to modulate the influence of retinal spikes acquired later. Applied to a simple orientation-discrimination task, the algorithm performance is consistent with human acuity, whereas naive strategies that neglect eye movements perform much worse. We then show how a simple, biologically plausible neural network could implement this algorithm using a local, activity-dependent gain and lateral interactions approximately matched to the statistics of eye movements. Finally, we discuss evidence that such a network could be operating in the primary visual cortex.
| S-EPMC2222970 | biostudies-literature
Project description:We studied the influence of perceived surface orientation on vergence accompanying a saccade while viewing an ambiguous stimulus. We used the slant rivalry stimulus, in which perspective foreshortening and disparity specified opposite surface orientations. This rivalrous configuration induces alternations of perceived surface orientation, while the slant cues remain constant. Subjects were able to voluntarily control their perceptual state while viewing the ambiguous stimulus. They were asked to make a saccade across the perceived slanted surface. Our data show that vergence responses closely approximated the vergence response predicted by the disparity cue, irrespective of voluntarily controlled perceived orientation. However, comparing the data obtained while viewing the ambiguous stimulus with data from an unambiguous stimulus condition (when disparity and perspective specified similar surface orientations) revealed an effect of perspective cues on vergence. Collectively our results show that depth cues rather than perceived depth govern vergence.
| S-EPMC2048826 | biostudies-other
Project description:The posterior parietal cortex (PPC) is understood to be active when observers perceive three-dimensional (3D) structure. However, it is not clear how central this activity is in the construction of 3D spatial representations. Here, we examine whether PPC is essential for two aspects of visual depth perception by testing patients with lesions affecting this region. First, we measured subjects' ability to discriminate depth structure in various 3D surfaces and objects using binocular disparity. Patients with lesions to right PPC (N = 3) exhibited marked perceptual deficits on these tasks, whereas those with left hemisphere lesions (N = 2) were able to reliably discriminate depth as accurately as control subjects. Second, we presented an ambiguous 3D stimulus defined by structure from motion to determine whether PPC lesions influence the rate of bistable perceptual alternations. Patients' percept durations for the 3D stimulus were generally within a normal range, although the two patients with bilateral PPC lesions showed the fastest perceptual alternation rates in our sample. Intermittent stimulus presentation reduced the reversal rate similarly across subjects. Together, the results suggest that PPC plays a causal role in both inferring and maintaining the perception of 3D structure with stereopsis supported primarily by the right hemisphere, but do not lend support to the view that PPC is a critical contributor to bistable perceptual alternations.This article is part of the themed issue 'Vision in our three-dimensional world'.
| S-EPMC4901457 | biostudies-literature
Project description:Perception of depth is a fundamental challenge for the visual system, particularly for observers moving through their environment. The brain makes use of multiple visual cues to reconstruct the three-dimensional structure of a scene. One potent cue, motion parallax, frequently arises during translation of the observer because the images of objects at different distances move across the retina with different velocities. Human psychophysical studies have demonstrated that motion parallax can be a powerful depth cue, and motion parallax seems to be heavily exploited by animal species that lack highly developed binocular vision. However, little is known about the neural mechanisms that underlie this capacity. Here we show, by using a virtual-reality system to translate macaque monkeys (Macaca mulatta) while they viewed motion parallax displays that simulated objects at different depths, that many neurons in the middle temporal area (area MT) signal the sign of depth (near versus far) from motion parallax in the absence of other depth cues. To achieve this, neurons must combine visual motion with extra-retinal (non-visual) signals related to the animal's movement. Our findings suggest a new neural substrate for depth perception and demonstrate a robust interaction of visual and non-visual cues in area MT. Combined with previous studies that implicate area MT in depth perception based on binocular disparities, our results suggest that area MT contains a more general representation of three-dimensional space that makes use of multiple cues.
| S-EPMC2422877 | biostudies-literature
Project description:On warm sunny days, female hoverflies are often observed feeding from a wide range of wild and cultivated flowers. In doing so, hoverflies serve a vital role as alternative pollinators, and are suggested to be the most important pollinators after bees and bumblebees. Unless the flower hoverflies are feeding from is large, they do not readily share the space with other insects, but instead opt to leave if another insect approaches. We used high-speed videography followed by 3D reconstruction of flight trajectories to quantify how female Eristalis hoverflies respond to approaching bees, wasps and two different hoverfly species. We found that, in 94% of the interactions, the occupant female left the flower when approached by another insect. We found that compared with spontaneous take-offs, the occupant hoverfly's escape response was performed at ∼3 times higher speed (spontaneous take-off at 0.2±0.05 m s-1 compared with 0.55±0.08 m s-1 when approached by another Eristalis). The hoverflies tended to take off upward and forward, while taking the incomer's approach angle into account. Intriguingly, we found that, when approached by wasps, the occupant Eristalis took off at a higher speed and when the wasp was further away. This suggests that feeding hoverflies may be able to distinguish these predators, demanding impressive visual capabilities. Our results, including quantification of the visual information available before occupant take-off, provide important insight into how freely behaving hoverflies perform escape responses from competitors and predators (e.g. wasps) in the wild.
| S-EPMC5992577 | biostudies-literature
Project description:Rbfox1 is a splicing regulator that has been associated with various neurological conditions such as autism spectrum disorder, mental retardation, epilepsy, attention-deficit/hyperactivity disorder, and schizophrenia. We show that in adult rodent retinas, Rbfox1 is expressed in all types of retinal ganglion cells (RGCs) as well as in certain subsets of amacrine cells (ACs) within the inner nuclear and ganglion cell layers. In developing retinas, Rbfox1 can be detected as early as E12. At that age, Rbfox1 is localized in the cytoplasm of differentiated RGCs. Between P0 and P5, strong expression of Rbfox1 in the inner plexiform layer was observed. This coincided with switching of Rbfox1 localization in RGC somas from cytoplasmic to a predominantly nuclear. Dynamic changes in Rbfox1 expression during first 10 postnatal days are correlated with the stage II spontaneous retinal waves of excitation, which in mice begins around the time of birth and continues for as long as two weeks. By P10, dendritic staining of Rbfox1 was dramatically reduced and remained so in the fully developed retina. In Rbfox1 knockout (KO) animals no detectable changes in retinal gross morphology were observed two months after Rbfox1 downregulation. However, the visual cliff test revealed marked abnormalities of depth perception of these animals. Retinal transcriptome analysis of Rbfox1 KO mice identified a number of genes that are involved in establishing neural circuits and synaptic transmission, including Vamp1, Vamp2, Snap25, Trak2, and Slc1A7, suggesting a role of Rbfox1 in the regulation of genes that facilitate AC and RGC synaptic communication.
2018-07-19 | GSE105084 | GEO