Binocular viewing geometry shapes the neural representation of the dynamic three-dimensional environment.
Ontology highlight
ABSTRACT:
SUBMITTER: Bonnen K
PROVIDER: S-EPMC8023341 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Binocular vision is often assumed to make a specific, critical contribution to online visual control of grasping by providing precise information about the separation between digits and object. This account overlooks the 'viewing geometry' typically encountered in grasping, however. Separation of hand and object is rarely aligned precisely with the line of sight (the visual depth dimension), and analysis of the raw signals suggests that, for most other viewing angles, binocular feedback is less precise than monocular feedback. Thus, online grasp control relying selectively on binocular feedback would not be robust to natural changes in viewing geometry. Alternatively, sensory integration theory suggests that different signals contribute according to their relative precision, in which case the role of binocular feedback should depend on viewing geometry, rather than being 'hard-wired'. We manipulated viewing geometry, and assessed the role of binocular feedback by measuring the effects on grasping of occluding one eye at movement onset. Loss of binocular feedback resulted in a significantly less extended final slow-movement phase when hand and object were separated primarily in the frontoparallel plane (where binocular information is relatively imprecise), compared to when they were separated primarily along the line of sight (where binocular information is relatively precise). Consistent with sensory integration theory, this suggests the role of binocular (and monocular) vision in online grasp control is not a fixed, 'architectural' property of the visuo-motor system, but arises instead from the interaction of viewer and situation, allowing robust online control across natural variations in viewing geometry.
| S-EPMC5671520 | biostudies-literature
Project description:Quantum interferometry uses quantum resources to improve phase estimation with respect to classical methods. Here we propose and theoretically investigate a new quantum interferometric scheme based on three-dimensional waveguide devices. These can be implemented by femtosecond laser waveguide writing, recently adopted for quantum applications. In particular, multiarm interferometers include "tritter" and "quarter" as basic elements, corresponding to the generalization of a beam splitter to a 3- and 4-port splitter, respectively. By injecting Fock states in the input ports of such interferometers, fringe patterns characterized by nonclassical visibilities are expected. This enables outperforming the quantum Fisher information obtained with classical fields in phase estimation. We also discuss the possibility of achieving the simultaneous estimation of more than one optical phase. This approach is expected to open new perspectives to quantum enhanced sensing and metrology performed in integrated photonics.
| S-EPMC3504357 | biostudies-literature
Project description:The visual perception of identity in humans and other primates is thought to draw upon cortical areas specialized for the analysis of facial structure. A prominent theory of face recognition holds that the brain computes and stores average facial structure, which it then uses to efficiently determine individual identity, though the neural mechanisms underlying this process are controversial. Here, we demonstrate that the dynamic suppression of average facial structure plays a prominent role in the responses of neurons in three fMRI-defined face patches of the macaque. Using photorealistic face stimuli that systematically varied in identity level according to a psychophysically based face space, we found that single units in the AF, AM, and ML face patches exhibited robust tuning around average facial structure. This tuning emerged after the initial excitatory response to the face and was expressed as the selective suppression of sustained responses to low-identity faces. The coincidence of this suppression with increased spike timing synchrony across the population suggests a mechanism of active inhibition underlying this effect. Control experiments confirmed that the diminished responses to low-identity faces were not due to short-term adaptation processes. We propose that the brain's neural suppression of average facial structure facilitates recognition by promoting the extraction of distinctive facial characteristics and suppressing redundant or irrelevant responses across the population.
| S-EPMC7855058 | biostudies-literature
Project description:Judging the poses, sizes, and shapes of objects accurately is necessary for organisms and machines to operate successfully in the world. Retinal images of three-dimensional objects are mapped by the rules of projective geometry and preserve the invariants of that geometry. Since Plato, it has been debated whether geometry is innate to the human brain, and Poincare and Einstein thought it worth examining whether formal geometry arises from experience with the world. We examine if humans have learned to exploit projective geometry to estimate sizes and aspects of three-dimensional shape that are related to relative lengths and aspect ratios. Numerous studies have examined size invariance as a function of physical distance, which changes scale on the retina. However, it is surprising that possible constancy or inconstancy of relative size seems not to have been investigated for object pose, which changes retinal image size differently along different axes. We show systematic underestimation of length for extents pointing toward or away from the observer, both for static objects and dynamically rotating objects. Observers do correct for projected shortening according to the optimal back-transform, obtained by inverting the projection function, but the correction is inadequate by a multiplicative factor. The clue is provided by the greater underestimation for longer objects, and the observation that they seem to be more slanted toward the observer. Adding a multiplicative factor for perceived slant in the back-transform model provides good fits to the corrections used by observers. We quantify the slant illusion with two different slant matching measurements, and use a dynamic demonstration to show that the slant illusion perceptually dominates length nonrigidity. In biological and mechanical objects, distortions of shape are manifold, and changes in aspect ratio and relative limb sizes are functionally important. Our model shows that observers try to retain invariance of these aspects of shape to three-dimensional rotation by correcting retinal image distortions due to perspective projection, but the corrections can fall short. We discuss how these results imply that humans have internalized particular aspects of projective geometry through evolution or learning, and if humans assume that images are preserving the continuity, collinearity, and convergence invariances of projective geometry, that would simply explain why illusions such as Ames' chair appear cohesive despite being a projection of disjointed elements, and thus supplement the generic viewpoint assumption.
| S-EPMC7438683 | biostudies-literature
Project description:Three-dimensional (3D) display technology has continuously been attracting public attention with the progress in today's 3D television and mature display technologies. The primary characteristics of conventional glasses-free autostereoscopic displays, such as spatial resolution, image depths, and viewing angle, are often limited due to the use of optical lenses or optical gratings. We present a 3D display using MEMS-scanning-mechanism-based light homogeneous emitting (LHE) approach and demonstrate that the display can directly generate an autostereoscopic 3D image without the need for optical lenses or gratings. The generated 3D image has the advantages of non-aberration and a high-definition spatial resolution, making it the first to exhibit animated 3D images with image depth of six meters. Our LHE 3D display approach can be used to generate a natural flat-panel 3D display with super long viewing distance and alternative real-time image update.
| S-EPMC5383051 | biostudies-literature
Project description:Statistical and machine learning approaches predict drug-to-target relationships from 2D small-molecule topology patterns. One might expect 3D information to improve these calculations. Here we apply the logic of the extended connectivity fingerprint (ECFP) to develop a rapid, alignment-invariant 3D representation of molecular conformers, the extended three-dimensional fingerprint (E3FP). By integrating E3FP with the similarity ensemble approach (SEA), we achieve higher precision-recall performance relative to SEA with ECFP on ChEMBL20 and equivalent receiver operating characteristic performance. We identify classes of molecules for which E3FP is a better predictor of similarity in bioactivity than is ECFP. Finally, we report novel drug-to-target binding predictions inaccessible by 2D fingerprints and confirm three of them experimentally with ligand efficiencies from 0.442-0.637 kcal/mol/heavy atom.
| S-EPMC6075869 | biostudies-literature
Project description:Prior to the onset of vision, neurons in the developing mammalian retina spontaneously fire in correlated activity patterns known as retinal waves. Experimental evidence suggests that retinal waves strongly influence the emergence of sensory representations before visual experience. We aim to model this early stage of functional development by using movies of neurally active developing retinas as pre-training data for neural networks. Specifically, we pre-train a ResNet-18 with an unsupervised contrastive learning objective (SimCLR) on both simulated and experimentally-obtained movies of retinal waves, then evaluate its performance on image classification tasks. We find that pre-training on retinal waves significantly improves performance on tasks that test object invariance to spatial translation, while slightly improving performance on more complex tasks like image classification. Notably, these performance boosts are realized on held-out natural images even though the pre-training procedure does not include any natural image data. We then propose a geometrical explanation for the increase in network performance, namely that the spatiotemporal characteristics of retinal waves facilitate the formation of separable feature representations. In particular, we demonstrate that networks pre-trained on retinal waves are more effective at separating image manifolds than randomly initialized networks, especially for manifolds defined by sets of spatial translations. These findings indicate that the broad spatiotemporal properties of retinal waves prepare networks for higher order feature extraction.
| S-EPMC10723543 | biostudies-literature
Project description:BackgroundTricuspid regurgitation (TR) is a significant contributor to morbidity and mortality in patients with hypoplastic left heart syndrome. The goal of this study was to characterize the dynamic annular motion of the tricuspid valve in patients with HLHS with a Fontan circulation and assess the relation to tricuspid valve function.MethodsTricuspid annuli of 48 patients with HLHS with a Fontan circulation were modeled at end-diastole, mid-systole, end-systole, and mid-diastole using transthoracic three-dimensional echocardiography and custom code in 3D Slicer. The angle of the anterior papillary muscle (APM) relative to the annular plane in each systolic phase was also measured.ResultsImaging was performed 5.0 years (interquartile range, 2-11 years) after Fontan operation. The tricuspid annulus varies in shape significantly throughout the cardiac cycle, changing in sphericity (P < .001) but not in annular height or bending angle. In univariate modeling, patients with significant TR had larger changes in septolateral diameter, lateral quadrant area, and posterior quadrant area (P < .05 for all) as well as lower (more laterally directed) APM angles (P < .001) than patients with mild or less TR. In multivariate modeling, a 1 mm/(body surface area)0.5 increase in the maximum change in septolateral diameter was associated with a 1.7-fold increase in having moderate or greater TR, while a 10° decrease in APM angle at mid-systole was associated with an almost 2.5-fold increase in moderate or greater TR (P ≤ .01 for all).ConclusionsThe tricuspid annulus in patients with HLHS with a Fontan circulation changes in shape significantly throughout the cardiac cycle but remains relatively planar. Increased change in septolateral diameter and decreased APM angle are strongly associated with the presence of TR. These findings may inform annuloplasty methods and subvalvular interventions in these complex patients.
| S-EPMC6502661 | biostudies-literature
Project description:Dynamic bone histomorphometry is the standard method for measuring bone remodeling at the level of individual events. Although dynamic bone histomorphometry is an invaluable tool for understanding osteoporosis and other metabolic bone diseases, the technique's two-dimensional nature requires the use of stereology and prevents measures of individual remodeling event number and size. Here, we used a novel three-dimensional fluorescence imaging technique to achieve measures of individual resorption cavities and formation events. We performed this three-dimensional histomorphometry approach using a common model of postmenopausal osteoporosis, the ovariectomized rat. The three-dimensional images demonstrated the spatial relationship between resorption cavities and formation events consistent with the hemiosteonal model of cancellous bone remodeling. Established ovariectomy was associated with significant increases in the number of resorption cavities per unit bone surface (2.38 ± 0.24 mm⁻² sham surgery versus 3.86 ± 0.35 mm⁻² bilateral ovariectomy [OVX], mean ± SD, p < 0.05) and total volume occupied by cavities per unit bone volume (0.38% ± 0.06% sham versus 1.12% ± 0.18% OVX, p < 0.001), but there was no difference in surface area per resorption cavity, maximum cavity depth, or cavity volume. In addition, we found that established ovariectomy is associated with increased size of bone formation events because of the merging of formation events (23,700 ± 6,890 µm² sham verusus 33,300 ± 7,950 µm² OVX). No differences in mineral apposition rate (determined in 3D) were associated with established ovariectomy. That established estrogen depletion is associated with increased number of remodeling events with only subtle changes in remodeling event size suggests that circulating estrogens may have their primary effect on the origination of new basic multicellular units with relatively little effect on the progression and termination of active remodeling events.
| S-EPMC3288521 | biostudies-literature
Project description:From measurements of wavefront aberrations in 16 emmetropic eyes, we calculated where objects in the world create best-focused images across the central 27\(^\circ\) (diameter) of the retina. This is the retinal conjugate surface. We calculated how the surface changes as the eye accommodates from near to far and found that it mostly maintains its shape. The conjugate surface is pitched top-back, meaning that the upper visual field is relatively hyperopic compared to the lower field. We extended the measurements of best image quality into the binocular domain by considering how the retinal conjugate surfaces for the two eyes overlap in binocular viewing. We call this binocular extension the blur horopter. We show that in combining the two images with possibly different sharpness, the visual system creates a larger depth of field of apparently sharp images than occurs with monocular viewing. We examined similarities between the blur horopter and its analog in binocular vision: the binocular horopter. We compared these horopters to the statistics of the natural visual environment. The binocular horopter and scene statistics are strikingly similar. The blur horopter and natural statistics are qualitatively, but not quantitatively, similar. Finally, we used the measurements to refine what is commonly referred to as the zone of clear single binocular vision.
| S-EPMC7938023 | biostudies-literature