Nonlinear circuits for naturalistic visual motion estimation.
Ontology highlight
ABSTRACT:
SUBMITTER: Fitzgerald JE
PROVIDER: S-EPMC4663970 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Many animals guide their movements using optic flow, the displacement of stationary objects across the retina caused by self-motion. How do animals selectively synthesize a global motion pattern from its local motion components? To what extent does this feature selectivity rely on circuit mechanisms versus dendritic processing? Here we used in vivo calcium imaging to identify pre- and postsynaptic mechanisms for processing local motion signals in global motion detection circuits in Drosophila. Lobula plate tangential cells (LPTCs) detect global motion by pooling input from local motion detectors, T4/T5 neurons. We show that T4/T5 neurons suppress responses to adjacent local motion signals whereas LPTC dendrites selectively amplify spatiotemporal sequences of local motion signals consistent with preferred global patterns. We propose that sequential nonlinear suppression and amplification operations allow optic flow circuitry to simultaneously prevent saturating responses to local signals while creating selectivity for global motion patterns critical to behavior.
| S-EPMC6274635 | biostudies-literature
Project description:In higher-order motion stimuli, the direction of object motion does not follow the direction of luminance change. Such stimuli could be generated by the wing movements of a flying butterfly and further complicated by its motion in and out of shadows. Human subjects readily perceive the direction of higher-order motion, although this stands in stark contrast to prevailing motion vision models. Flies and humans compute motion in similar ways, and because flies behaviorally track bars containing higher-order motion cues, they become an attractive model system for investigating the neurophysiology underlying higher-order motion sensitivity. We here use intracellular electrophysiology of motion-vision-sensitive neurons in the hoverfly lobula plate to quantify responses to stimuli containing higher-order motion. We show that motion sensitivity can be broken down into two separate streams, directionally coding for elementary motion and figure motion, respectively, and that responses to Fourier and theta motion can be predicted from these. The sensitivity is affected both by the stimulus' time course and by the neuron's underlying receptive field. Responses to preferred-direction theta motion are sexually dimorphic and particularly robust along the visual midline.
| S-EPMC3365167 | biostudies-literature
Project description:Detecting motion is a feature of all advanced visual systems [1], nowhere more so than in flying animals, like insects [2, 3]. In flies, an influential autocorrelation model for motion detection, the elementary motion detector circuit (EMD; [4, 5]), compares visual signals from neighboring photoreceptors to derive information on motion direction and velocity. This information is fed by two types of interneuron, L1 and L2, in the first optic neuropile, or lamina, to downstream local motion detectors in columns of the second neuropile, the medulla. Despite receiving carefully matched photoreceptor inputs, L1 and L2 drive distinct, separable pathways responding preferentially to moving "on" and "off" edges, respectively [6, 7]. Our serial electron microscopy (EM) identifies two types of transmedulla (Tm) target neurons, Tm1 and Tm2, that receive apparently matched synaptic inputs from L2. Tm2 neurons also receive inputs from two retinotopically posterior neighboring columns via L4, a third type of lamina neuron. Light microscopy reveals that the connections in these L2/L4/Tm2 circuits are highly determinate. Single-cell transcript profiling suggests that nicotinic acetylcholine receptors mediate transmission within the L2/L4/Tm2 circuits, whereas L1 is apparently glutamatergic. We propose that Tm2 integrates sign-conserving inputs from neighboring columns to mediate the detection of front-to-back motion generated during forward motion.
| S-EPMC3265035 | biostudies-literature
Project description:Like the mammalian visual cortex, the fly visual system is organized into retinotopic columns. A widely accepted biophysical model for computing visual motion, the elementary motion detector proposed nearly 50 years ago posits a temporal correlation of spatially separated visual inputs implemented across neighboring retinotopic visual columns. Whereas the inputs are defined, the neural substrate for motion computation remains enigmatic. Indeed, it is not known where in the visual processing hierarchy the computation occurs. Here, we combine genetic manipulations with a novel high-throughput dynamic behavioral analysis system to dissect visual circuits required for directional optomotor responses. An enhancer trap screen of synapse-inactivated neural circuits revealed one particularly striking phenotype, which is completely insensitive to motion yet displays fully intact fast phototaxis, indicating that these animals are generally capable of seeing and walking but are unable to respond to motion stimuli. The enhancer circuit is localized within the first optic relay and strongly labels the only columnar interneuron known to interact with neighboring columns both in the lamina and medulla, spatial synaptic interactions that correspond with the two dominant axes of elementary motion detectors on the retinal lattice.
| S-EPMC2846117 | biostudies-literature
Project description:To achieve a high precision estimation of indoor robot motion, a tightly coupled RGB-D visual-inertial SLAM system is proposed herein based on multiple features. Most of the traditional visual SLAM methods only rely on points for feature matching and they often underperform in low textured scenes. Besides point features, line segments can also provide geometrical structure information of the environment. This paper utilized both points and lines in low-textured scenes to increase the robustness of RGB-D SLAM system. In addition, we implemented a fast initialization process based on the RGB-D camera to improve the real-time performance of the proposed system and designed a new backend nonlinear optimization framework. By minimizing the cost function formed by the pre-integrated IMU residuals and re-projection errors of points and lines in sliding windows, the state vector is optimized. The experiments evaluated on public datasets show that our system achieves higher accuracy and robustness on trajectories and in pose estimation compared with several state-of-the-art visual SLAM systems.
| S-EPMC7506712 | biostudies-literature
Project description:This paper proposes an adaptive absolute ego-motion estimation method using wearable visual-inertial sensors for indoor positioning. We introduce a wearable visual-inertial device to estimate not only the camera ego-motion, but also the 3D motion of the moving object in dynamic environments. Firstly, a novel method dynamic scene segmentation is proposed using two visual geometry constraints with the help of inertial sensors. Moreover, this paper introduces a concept of "virtual camera" to consider the motion area related to each moving object as if a static object were viewed by a "virtual camera". We therefore derive the 3D moving object's motion from the motions for the real and virtual camera because the virtual camera's motion is actually the combined motion of both the real camera and the moving object. In addition, a multi-rate linear Kalman-filter (MR-LKF) as our previous work was selected to solve both the problem of scale ambiguity in monocular camera tracking and the different sampling frequencies of visual and inertial sensors. The performance of the proposed method is evaluated by simulation studies and practical experiments performed in both static and dynamic environments. The results show the method's robustness and effectiveness compared with the results from a Pioneer robot as the ground truth.
| S-EPMC6187464 | biostudies-literature
Project description:Much study of the visual system has focused on how humans and monkeys integrate moving stimuli over space and time. Such assessments of spatiotemporal integration provide fundamental grounding for the interpretation of neurophysiological data, as well as how the resulting neural signals support perceptual decisions and behavior. However, the insights supported by classical characterizations of integration performed in humans and rhesus monkeys are potentially limited with respect to both generality and detail: Standard tasks require extensive amounts of training, involve abstract stimulus-response mappings, and depend on combining data across many trials and/or sessions. It is thus of concern that the integration observed in classical tasks involves the recruitment of brain circuits that might not normally subsume natural behaviors, and that quantitative analyses have limited power for characterizing single-trial or single-session processes. Here we bridge these gaps by showing that three primate species (humans, macaques, and marmosets) track the focus of expansion of an optic flow field continuously and without substantial training. This flow-tracking behavior was volitional and reflected substantial temporal integration. Most strikingly, gaze patterns exhibited lawful and nuanced dependencies on random perturbations in the stimulus, such that repetitions of identical flow movies elicited remarkably similar eye movements over long and continuous time periods. These results demonstrate the generality of spatiotemporal integration in natural vision, and offer a means for studying integration outside of artificial tasks while maintaining lawful and highly reliable behavior.
| S-EPMC6217422 | biostudies-literature
Project description:Future quantum computation and networks require scalable monolithic circuits, which incorporate various advanced functionalities on a single physical substrate. Although substantial progress for various applications has already been demonstrated on different platforms, the range of diversified manipulation of photonic states on demand on a single chip has remained limited, especially dynamic time management. Here, we demonstrate an electro-optic device, including photon pair generation, propagation, electro-optical path routing, as well as a voltage-controllable time delay of up to ~12 ps on a single Ti:LiNbO3 waveguide chip. As an example, we demonstrate Hong-Ou-Mandel interference with a visibility of more than 93 ± 1.8%. Our chip not only enables the deliberate manipulation of photonic states by rotating the polarization but also provides precise time control. Our experiment reveals that we have full flexible control over single-qubit operations by harnessing the complete potential of fast on-chip electro-optic modulation.
| S-EPMC6314874 | biostudies-other
Project description:There is increasing evidence that the brain possesses mechanisms to integrate incoming sensory information as it unfolds over time-periods of 2-3 seconds. The ubiquity of this mechanism across modalities, tasks, perception and production has led to the proposal that it may underlie our experience of the subjective present. A critical test of this claim is that this phenomenon should be apparent in naturalistic visual experiences. We tested this using movie-clips as a surrogate for our day-to-day experience, temporally scrambling them to require (re-) integration within and beyond the hypothesized 2-3 second interval. Two independent experiments demonstrate a step-wise increase in the difficulty to follow stimuli at the hypothesized 2-3 second scrambling condition. Moreover, only this difference could not be accounted for by low-level visual properties. This provides the first evidence that this 2-3 second integration window extends to complex, naturalistic visual sequences more consistent with our experience of the subjective present.
| S-EPMC4092072 | biostudies-literature
Project description:BackgroundVisual estimation (VE) is an essential tool for evaluation of range of motion. Few papers discussed its validity in children orthopedics' practice. The purpose of our study was to assess validity and reliability of VE for passive range of motions (PROMs) of children's lower limbs.MethodsFifty typically developing children (100 lower limbs) were examined. Visual estimations for PROMs of hip (flexion, adduction, abduction, internal and external rotations), knee (flexion and popliteal angle) and ankle (dorsiflexion and plantarflexion) were made by a pediatric orthopaedic surgeon (POS) and a 5th year resident in orthopaedics. A last year medical student did goniometric measurements. Three weeks later, same measurements were performed to assess reliability of visual estimation for each examiner.ResultsVisual estimations of the POS were highly reliable for hip flexion, hip rotations and popliteal angle (rhoc >or= 0.8). Reliability was good for hip abduction, knee flexion, ankle dorsiflexion and plantarflexion (rhoc >or= 0.7) but poor for hip adduction (rhoc = 0.5). Reproducibility for all PROMs was verified. Resident's VE showed high reliability (rhoc >or= 0.8) for hip flexion and popliteal angle. Good correlation was found for hip rotations and knee flexion (rhoc >or= 0.7). Poor results were obtained for ankle PROMs (rhoc < 0.6) as well as hip adduction and abduction, the results of which not being reproducible. Influence of experience was clearly demonstrated for PROMs of hip rotations, adduction and abduction as well as ankle plantarflexion.ConclusionAccuracy of VE of passive hip flexion and knee PROMs is high regardless of the examiner's experience. Same accuracy can be found for hip rotations and abduction whenever VE is performed by an experienced examiner. Goniometric evaluation is recommended for passive hip adduction and for ankle PROMs.
| S-EPMC2765954 | biostudies-literature