The influence of visual and haptic material information on early grasping force.
Ontology highlight
ABSTRACT:
SUBMITTER: Bergmann Tiest WM
PROVIDER: S-EPMC6458396 | biostudies-literature | 2019 Mar
REPOSITORIES: biostudies-literature
Publications
The influence of visual and haptic material information on early grasping force.
Bergmann Tiest Wouter M WM Kappers Astrid M L AML
Royal Society open science 20190306 3
In this paper, we assess the importance of visual and haptic information about materials for scaling the grasping force when picking up an object. We asked 12 participants to pick up and lift objects with six different textures, either blindfolded or with visual information present. We measured the grip force and estimated the load force from the object's weight and vertical acceleration. The coefficient of friction of the materials was measured separately. Already at an early phase in the grasp ...[more]
Similar Datasets
Project description:The data is related to minimal force thresholds perception in robotic surgical grasping applications. The experimental setup included an indenter-based haptic device acting on the fingertip of a participant and a visual system that displays grasping tasks by a surgical grasper. The experiments included the display of two presentations at different force levels (i.e., grasping and indentation) in three different modes, namely, visual-alone, haptic-alone, and bimodal (i.e., combined). For each mode, the participants were asked to identify which of the two presentations was higher. Each experiment was repeated till the termination conditions were met. Sixty participants took part in these experiments. The experiments were randomized and the threshold forces were calculated based on an algorthim. The datasets contain the individual responses of each participant, the threshold forces calculations, and the number of iterations.
| S-EPMC8943423 | biostudies-literature
Project description:Neurodecoders have been developed by researchers mostly to control neuroprosthetic devices, but also to shed new light on neural functions. In this study, we show that signals representing grip configurations can be reliably decoded from neural data acquired from area V6A of the monkey medial posterior parietal cortex. Two Macaca fascicularis monkeys were trained to perform an instructed-delay reach-to-grasp task in the dark and in the light toward objects of different shapes. Population neural activity was extracted at various time intervals on vision of the objects, the delay before movement, and grasp execution. This activity was used to train and validate a Bayes classifier used for decoding objects and grip types. Recognition rates were well over chance level for all the epochs analyzed in this study. Furthermore, we detected slightly different decoding accuracies, depending on the task's visual condition. Generalization analysis was performed by training and testing the system during different time intervals. This analysis demonstrated that a change of code occurred during the course of the task. Our classifier was able to discriminate grasp types fairly well in advance with respect to grasping onset. This feature might be important when the timing is critical to send signals to external devices before the movement start. Our results suggest that the neural signals from the dorsomedial visual pathway can be a good substrate to feed neural prostheses for prehensile actions.SIGNIFICANCE STATEMENT Recordings of neural activity from nonhuman primate frontal and parietal cortex have led to the development of methods of decoding movement information to restore coordinated arm actions in paralyzed human beings. Our results show that the signals measured from the monkey medial posterior parietal cortex are valid for correctly decoding information relevant for grasping. Together with previous studies on decoding reach trajectories from the medial posterior parietal cortex, this highlights the medial parietal cortex as a target site for transforming neural activity into control signals to command prostheses to allow human patients to dexterously perform grasping actions.
| S-EPMC6596562 | biostudies-literature
Project description:Segregation of information flow along a dorsally directed pathway for processing object location and a ventrally directed pathway for processing object identity is well established in the visual and auditory systems, but is less clear in the somatosensory system. We hypothesized that segregation of location vs. identity information in touch would be evident if texture is the relevant property for stimulus identity, given the salience of texture for touch. Here, we used functional magnetic resonance imaging (fMRI) to investigate whether the pathways for haptic and visual processing of location and texture are segregated, and the extent of bisensory convergence. Haptic texture-selectivity was found in the parietal operculum and posterior visual cortex bilaterally, and in parts of left inferior frontal cortex. There was bisensory texture-selectivity at some of these sites in posterior visual and left inferior frontal cortex. Connectivity analyses demonstrated, in each modality, flow of information from unisensory non-selective areas to modality-specific texture-selective areas and further to bisensory texture-selective areas. Location-selectivity was mostly bisensory, occurring in dorsal areas, including the frontal eye fields and multiple regions around the intraparietal sulcus bilaterally. Many of these regions received input from unisensory areas in both modalities. Together with earlier studies, the activation and connectivity analyses of the present study establish that somatosensory processing flows into segregated pathways for location and object identity information. The location-selective somatosensory pathway converges with its visual counterpart in dorsal frontoparietal cortex, while the texture-selective somatosensory pathway runs through the parietal operculum before converging with its visual counterpart in visual and frontal cortex. Both segregation of sensory processing according to object property and multisensory convergence appear to be universal organizing principles.
| S-EPMC3128427 | biostudies-literature
Project description:Our brain is known to automatically optimize effort expenditure during motor coordination, such that for example, during bimanual braking of a bicycle, a well-oiled brake will automatically be used more than a corroded, heavy brake. But how does our brain infer the effort expenditure? All previous motor coordination models have believed that the effort in a task is known precisely to our brain, solely from the motor commands it generates. Here we show that this belief is incorrect. Through experiments and simulation we exhibit that in addition to the motor commands, the returning haptic signals play a crucial role in the inference of the effort during a force sharing task. Our results thus elucidate a previously unknown sensory-motor association that has major ramifications for our understanding of motor coordination and provides new insights into how sensory modifications due to ergonomics, stroke and disease can affect motor coordination in humans.
| S-EPMC3770969 | biostudies-other
Project description:When touching the surface of an object, its spatial structure translates into a vibration on the skin. The perceptual system evolved to translate this pattern into a representation that allows to distinguish between different materials. Here, we show that perceptual haptic representation of materials emerges from efficient encoding of vibratory patterns elicited by the interaction with materials. We trained a deep neural network with unsupervised learning (Autoencoder) to reconstruct vibratory patterns elicited by human haptic exploration of different materials. The learned compressed representation (i.e., latent space) allows for classification of material categories (i.e., plastic, stone, wood, fabric, leather/wool, paper, and metal). More importantly, classification performance is higher with perceptual category labels as compared to ground truth ones, and distances between categories in the latent space resemble perceptual distances, suggesting a similar coding. Crucially, the classification performance and the similarity between the perceptual and the latent space decrease with decreasing compression level. We could further show that the temporal tuning of the emergent latent dimensions is similar to properties of human tactile receptors.
| S-EPMC8865843 | biostudies-literature
Project description:BackgroundPartial hand amputation forms more than 90% of all upper limb amputations. This amputation has a notable effect on the amputee's life. To improve the quality of life for partial hand amputees different prosthesis options, including externally-powered prosthesis, have been investigated. The focus of this work is to explore force myography (FMG) as a technique for regressing grasping movement accompanied by wrist position variations. This study can lay the groundwork for a future investigation of FMG as a technique for controlling externally-powered prostheses continuously.MethodsTen able-bodied participants performed three hand movements while their wrist was fixed in one of six predefined positions. The angle between Thumb and Index finger ([Formula: see text]), and Thumb and Middle finger ([Formula: see text]) were calculated as measures of grasping movements. Two approaches were examined for estimating each angle: (i) one regression model, trained on data from all wrist positions and hand movements; (ii) a classifier that identified the wrist position followed by a separate regression model for each wrist position. The possibility of training the system using a limited number of wrist positions and testing it on all positions was also investigated.ResultsThe first approach had a correlation of determination ([Formula: see text]) of 0.871 for [Formula: see text] and [Formula: see text]. Using the second approach [Formula: see text] and [Formula: see text] were obtained. The first approach is over two times faster than the second approach while having similar performance; thus the first approach was selected to investigate the effect of the wrist position variations. Training with 6 or 5 wrist positions yielded results which were not statistically significant. A statistically significant decrease in performance resulted when less than five wrist positions were used for training.ConclusionsThe results indicate the potential of FMG to regress grasping movement, accompanied by wrist position variations, with a regression model for each angle. Also, it is necessary to include more than one wrist position in the training phase.
| S-EPMC6199756 | biostudies-literature
Project description:When we feel and see an object, the nervous system integrates visual and haptic information optimally, exploiting the redundancy in multiple signals to estimate properties more precisely than is possible from either signal alone. We examined whether optimal integration is similarly achieved when using articulated tools. Such tools (tongs, pliers, etc) are a defining characteristic of human hand function, but complicate the classical sensory 'correspondence problem' underlying multisensory integration. Optimal integration requires establishing the relationship between signals acquired by different sensors (hand and eye) and, therefore, in fundamentally unrelated units. The system must also determine when signals refer to the same property of the world-seeing and feeling the same thing-and only integrate those that do. This could be achieved by comparing the pattern of current visual and haptic input to known statistics of their normal relationship. Articulated tools disrupt this relationship, however, by altering the geometrical relationship between object properties and hand posture (the haptic signal). We examined whether different tool configurations are taken into account in visual-haptic integration. We indexed integration by measuring the precision of size estimates, and compared our results to optimal predictions from a maximum-likelihood integrator. Integration was near optimal, independent of tool configuration/hand posture, provided that visual and haptic signals referred to the same object in the world. Thus, sensory correspondence was determined correctly (trial-by-trial), taking tool configuration into account. This reveals highly flexible multisensory integration underlying tool use, consistent with the brain constructing internal models of tools' properties.
| S-EPMC5380699 | biostudies-literature
Project description:In perceptual psychology, estimations of visual depth and size under different spatial layouts have been extensively studied. However, research evidence in virtual environments (VE) is relatively lacking. The emergence of human-computer interaction (HCI) and virtual reality (VR) has raised the question of how human operators perform actions based on the estimation of visual properties in VR, especially when the sensory cues associated with the same object are conflicting. We report on an experiment in which participants compared the size of a visual sphere to a haptic sphere, belonging to the same object in a VE. The sizes from the visual and haptic modalities were either identical or conflicting (with visual size being larger than haptic size, or vice versa). We used three standard haptic references (small, medium, and large sizes) and asked participants to compare the visual sizes with the given reference, by method of constant stimuli. Results show a dominant functional priority of the visual size perception. Moreover, observers demonstrated a central tendency effect: over-estimation for smaller haptic sizes but under-estimation for larger haptic sizes. The results are in-line with previous studies in real environments (RE). We discuss the current findings in the framework of adaptation level theory for haptic size reference. This work provides important implications for the optimal design of human-computer interactions when integrating 3D visual-haptic information in a VE.
| S-EPMC7177043 | biostudies-literature
Project description:The parietal operculum (OP) contains haptic memory on the geometry of objects that is readily transferrable to the motor cortex but a causal role of OP in memory-guided grasping is only speculative. We explored this issue by using online high-frequency repetitive transcranial magnetic stimulation (rTMS). The experimental task was performed by blindfolded participants acting on objects of variable size. Trials consisted in three phases: haptic exploration of an object, delay, and reach-grasp movement onto the explored object. Motor performance was evaluated by the kinematics of finger aperture. Online rTMS was applied to the left OP region separately in each of the three phases of the task. The results showed that rTMS altered grip aperture only when applied in the delay phase to the OP. In a second experiment a haptic discriminative (match-to-sample) task was carried out on objects similar to those used in the first experiment. Online rTMS was applied to the left OP. No psychophysical effects were induced by rTMS on the detection of explicit haptic object size. We conclude that neural activity in the OP region is necessary for proficient memory-guided haptic grasping. The function of OP seems to be critical while maintaining the haptic memory trace and less so while encoding it or retrieving it.
| S-EPMC6869740 | biostudies-literature
Project description:We have exposed human participants to both full-movement and pulsatile viscous force perturbations to study the effect of force duration on the incremental transformation of sensation into adaptation. Traditional views of movement biomechanics could suggest that pulsatile forces would largely be attenuated as stiffness and viscosity act as a natural low-pass filter. Sensory transduction, however, tends to react to changes in stimuli and therefore could underlie heightened sensitivity to briefer, pulsatile forces. Here, participants adapted within perturbation duration conditions in a manner proportionate to sensed force and positional errors. Across perturbation conditions, we found participants had greater adaptive sensitivity when experiencing pulsatile forces rather than full-movement forces. In a follow-up experiment, we employed error-clamped, force channel trials to determine changes in predictive force generation. We found that while participants learned to closely compensate for the amplitude and breadth of full-movement forces, they exhibited a persistent mismatch in amplitude and breadth between adapted motor output and experienced pulsatile forces. This mismatch could generate higher salience of error signals that contribute to heightened sensitivity to pulsatile forces.
| S-EPMC3646637 | biostudies-literature