Keep an eye on your hands: on the role of visual mechanisms in processing of haptic space.
Ontology highlight
ABSTRACT:
SUBMITTER: Postma A
PROVIDER: S-EPMC2254467 | biostudies-other | 2008 Mar
REPOSITORIES: biostudies-other
Similar Datasets
Project description:In perceptual psychology, estimations of visual depth and size under different spatial layouts have been extensively studied. However, research evidence in virtual environments (VE) is relatively lacking. The emergence of human-computer interaction (HCI) and virtual reality (VR) has raised the question of how human operators perform actions based on the estimation of visual properties in VR, especially when the sensory cues associated with the same object are conflicting. We report on an experiment in which participants compared the size of a visual sphere to a haptic sphere, belonging to the same object in a VE. The sizes from the visual and haptic modalities were either identical or conflicting (with visual size being larger than haptic size, or vice versa). We used three standard haptic references (small, medium, and large sizes) and asked participants to compare the visual sizes with the given reference, by method of constant stimuli. Results show a dominant functional priority of the visual size perception. Moreover, observers demonstrated a central tendency effect: over-estimation for smaller haptic sizes but under-estimation for larger haptic sizes. The results are in-line with previous studies in real environments (RE). We discuss the current findings in the framework of adaptation level theory for haptic size reference. This work provides important implications for the optimal design of human-computer interactions when integrating 3D visual-haptic information in a VE.
| S-EPMC7177043 | biostudies-literature
Project description:Visual form perception is essential for correct interpretation of, and interaction with, our environment. Form perception depends on visual acuity and processing of specific form characteristics, such as luminance contrast, spatial frequency, color, orientation, depth, and even motion information. As other cognitive processes, form perception matures with age. This paper aims at providing a concise overview of our current understanding of the typical development, from birth to adulthood, of form-characteristic processing, as measured both behaviorally and neurophysiologically. Two main conclusions can be drawn. First, the current literature conveys that for most reviewed characteristics a developmental pattern is apparent. These trajectories are discussed in relation to the organization of the visual system. The second conclusion is that significant gaps in the literature exist for several age-ranges. To complete our understanding of the typical and, by consequence, atypical development of visual mechanisms underlying form processing, future research should uncover these missing segments.
| S-EPMC3299398 | biostudies-literature
Project description:We investigated coordinated movements between the eyes and head ("eye-head coordination") in relation to vision for action. Several studies have measured eye and head movements during a single gaze shift, focusing on the mechanisms of motor control during eye-head coordination. However, in everyday life, gaze shifts occur sequentially and are accompanied by movements of the head and body. Under such conditions, visual cognitive processing influences eye movements and might also influence eye-head coordination because sequential gaze shifts include cycles of visual processing (fixation) and data acquisition (gaze shifts). In the present study, we examined how the eyes and head move in coordination during visual search in a large visual field. Subjects moved their eyes, head, and body without restriction inside a 360° visual display system. We found patterns of eye-head coordination that differed those observed in single gaze-shift studies. First, we frequently observed multiple saccades during one continuous head movement, and the contribution of head movement to gaze shifts increased as the number of saccades increased. This relationship between head movements and sequential gaze shifts suggests eye-head coordination over several saccade-fixation sequences; this could be related to cognitive processing because saccade-fixation cycles are the result of visual cognitive processing. Second, distribution bias of eye position during gaze fixation was highly correlated with head orientation. The distribution peak of eye position was biased in the same direction as head orientation. This influence of head orientation suggests that eye-head coordination is involved in gaze fixation, when the visual system processes retinal information. This further supports the role of eye-head coordination in visual cognitive processing.
| S-EPMC4370616 | biostudies-literature
Project description:Although motor actions can profoundly affect the perceptual interpretation of sensory inputs, it is not known whether the combination of sensory and movement signals occurs only for sensory surfaces undergoing movement or whether it is a more general phenomenon. In the haptic modality, the independent movement of multiple sensory surfaces poses a challenge to the nervous system when combining the tactile and kinesthetic signals into a coherent percept. When exploring a stationary object, the tactile and kinesthetic signals come from the same hand. Here we probe the internal structure of haptic combination by directing the two signal streams to separate hands: one hand moves but receives no tactile stimulation, while the other hand feels the consequences of the first hand's movement but remains still. We find that both discrete and continuous tactile and kinesthetic signals are combined as if they came from the same hand. This combination proceeds by direct coupling or transfer of the kinesthetic signal from the moving to the feeling hand, rather than assuming the displacement of a mediating object. The combination of signals is due to perception rather than inference, because a small temporal offset between the signals significantly degrades performance. These results suggest that the brain simplifies the complex coordinate transformation task of remapping sensory inputs to take into account the movements of multiple body parts in haptic perception, and they show that the effects of action are not limited to moving sensors.
| S-EPMC4299183 | biostudies-other
Project description:The main goal of our study is to gain insight into the reference frames involved in three-dimensional haptic spatial processing. Previous research has shown that two-dimensional haptic spatial processing is prone to large systematic deviations. A weighted average model that identifies the origin of the systematic error patterns in the biasing influence of an egocentric reference frame on the allocentric reference frame was proposed as an explanation of the results. The basis of the egocentric reference frame was linked either to the hand or to the body. In the present study participants had to construct a field of parallel bars that could be oriented in three dimensions. First, systematic error patterns were found also in this three-dimensional haptic parallelity task. Second, among the different models tested for their accuracy in explaining the error patterns, the Hand-centered weighted average model proved to most closely resemble the data. A participant-specific weighting factor determined the biasing influence of the hand-centered egocentric reference frame. A shift from the allocentric towards the egocentric frame of reference of approximately 20% was observed. These results support the hypothesis that haptic spatial processing is a product of the interplay of diverse, but synergistically operating frames of reference.
| S-EPMC2440965 | biostudies-other
Project description:Visual cortex shows smooth retinotopic organization on the macroscopic scale, but it is unknown how receptive fields are organized at the level of neighboring neurons. This information is crucial for discriminating among models of visual cortex. We used in vivo two-photon calcium imaging to independently map ON and OFF receptive field subregions of local populations of layer 2/3 neurons in mouse visual cortex. Receptive field subregions were often precisely shared among neighboring neurons. Furthermore, large subregions seem to be assembled from multiple smaller, non-overlapping subregions of other neurons in the same local population. These experiments provide, to our knowledge, the first characterization of the diversity of receptive fields in a dense local network of visual cortex and reveal elementary units of receptive field organization. Our results suggest that a limited pool of afferent receptive fields is available to a local population of neurons and reveal new organizational principles for the neural circuitry of the mouse visual cortex.
| S-EPMC2999824 | biostudies-literature
Project description:The primary purpose of this study was to examine the effects of non-informative vision and visual interference upon haptic spatial processing, which supposedly derives from an interaction between an allocentric and egocentric reference frame. To this end, a haptic parallelity task served as baseline to determine the participant-dependent biasing influence of the egocentric reference frame. As expected, large systematic participant-dependent deviations from veridicality were observed. In the second experiment we probed the effect of non-informative vision on the egocentric bias. Moreover, orienting mechanisms (gazing directions) were studied with respect to the presentation of haptic information in a specific hemispace. Non-informative vision proved to have a beneficial effect on haptic spatial processing. No effect of gazing direction or hemispace was observed. In the third experiment we investigated the effect of simultaneously presented interfering visual information on the haptic bias. Interfering visual information parametrically influenced haptic performance. The interplay of reference frames that subserves haptic spatial processing was found to be related to both the effects of non-informative vision and visual interference. These results suggest that spatial representations are influenced by direct cross-modal interactions; inter-participant differences in the haptic modality resulted in differential effects of the visual modality.
| S-EPMC2515586 | biostudies-other
Project description:We used local field potentials (LFPs) and spikes to investigate representations of visual space in prefrontal cortex and the dynamics of those representations during eye movements. Spatial information contained in LFPs of the frontal eye field (FEF) was differentially distributed across frequencies, with a majority of that information being carried in alpha and high-gamma bands and minimal signal in the low-gamma band. During fixation, spatial information from alpha and high-gamma bands and spiking activity was robust across cortical layers. Receptive fields (RFs) derived from alpha and high-gamma bands were retinocentrically organized, and they were spatially correlated both with each other and with spiking RFs. However, alpha and high-gamma RFs probed before eye movements were dissociated. Whereas high-gamma and spiking RFs immediately converged toward the movement goal, alpha RFs remained largely unchanged during the initial probe response, but they converged later. These observations reveal possible mechanisms of dynamic spatial representations that underlie visual perception during eye movements.
| S-EPMC5850980 | biostudies-literature
Project description:Neuroprosthetic limbs reconnect severed neural pathways for control of (and increasingly sensation from) an artificial limb. However, the plastic interaction between robotic and biological components is poorly understood. To gain such insight, we developed a novel noninvasive neuroprosthetic research platform that enables bidirectional electrical communications (action, sensory perception) between a dexterous artificial hand and neuronal cultures living in a multichannel microelectrode array (MEA) chamber. Artificial tactile sensations from robotic fingertips were encoded to mimic slowly adapting (SA) or rapidly adapting (RA) mechanoreceptors. Afferent spike trains were used to stimulate neurons in a region of the neuronal culture. Electrical activity from neurons at another region in the MEA chamber was used as the motor control signal for the artificial hand. Results from artificial neural networks (ANNs) showed that the haptic model used to encode RA or SA fingertip sensations affected biological neural network (BNN) activity patterns, which in turn impacted the behavior of the artificial hand. That is, the exhibited finger tapping behavior of this closed-loop neurorobotic system showed statistical significance (p<0.01) between the haptic encoding methods across two different neuronal cultures and over multiple days. These findings suggest that our noninvasive neuroprosthetic research platform can be used to devise high-throughput experiments exploring how neural plasticity is affected by the mutual interactions between perception and action.
| S-EPMC10566548 | biostudies-literature
Project description:When we feel and see an object, the nervous system integrates visual and haptic information optimally, exploiting the redundancy in multiple signals to estimate properties more precisely than is possible from either signal alone. We examined whether optimal integration is similarly achieved when using articulated tools. Such tools (tongs, pliers, etc) are a defining characteristic of human hand function, but complicate the classical sensory 'correspondence problem' underlying multisensory integration. Optimal integration requires establishing the relationship between signals acquired by different sensors (hand and eye) and, therefore, in fundamentally unrelated units. The system must also determine when signals refer to the same property of the world-seeing and feeling the same thing-and only integrate those that do. This could be achieved by comparing the pattern of current visual and haptic input to known statistics of their normal relationship. Articulated tools disrupt this relationship, however, by altering the geometrical relationship between object properties and hand posture (the haptic signal). We examined whether different tool configurations are taken into account in visual-haptic integration. We indexed integration by measuring the precision of size estimates, and compared our results to optimal predictions from a maximum-likelihood integrator. Integration was near optimal, independent of tool configuration/hand posture, provided that visual and haptic signals referred to the same object in the world. Thus, sensory correspondence was determined correctly (trial-by-trial), taking tool configuration into account. This reveals highly flexible multisensory integration underlying tool use, consistent with the brain constructing internal models of tools' properties.
| S-EPMC5380699 | biostudies-literature