Browse
Submit Data
Databases
API
Help

Dataset Information

22 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Leveraging Human Perception in Robot Grasping and Manipulation Through Crowdsourcing and Gamification.

ABSTRACT: Robot grasping in unstructured and dynamic environments is heavily dependent on the object attributes. Although Deep Learning approaches have delivered exceptional performance in robot perception, human perception and reasoning are still superior in processing novel object classes. Furthermore, training such models requires large, difficult to obtain datasets. This work combines crowdsourcing and gamification to leverage human intelligence, enhancing the object recognition and attribute estimation processes of robot grasping. The framework employs an attribute matching system that encodes visual information into an online puzzle game, utilizing the collective intelligence of players to expand the attribute database and react to real-time perception conflicts. The framework is deployed and evaluated in two proof-of-concept applications: enhancing the control of a robotic exoskeleton glove and improving object identification for autonomous robot grasping. In addition, a model for estimating the framework response time is proposed. The obtained results demonstrate that the framework is capable of rapid adaptation to novel object classes, based purely on visual information and human experience.

SUBMITTER: Gorjup G

PROVIDER: S-EPMC8116898 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Exploring Non-Expert Robot Programming Through Crowdsourcing.

Project description:A longstanding barrier to deploying robots in the real world is the ongoing need to author robot behavior. Remote data collection-particularly crowdsourcing-is increasingly receiving interest. In this paper, we make the argument to scale robot programming to the crowd and present an initial investigation of the feasibility of this proposed method. Using an off-the-shelf visual programming interface, non-experts created simple robot programs for two typical robot tasks (navigation and pick-and-place). Each needed four subtasks with an increasing number of programming statements (if statement, while loop, variables) for successful completion of the programs. Initial findings of an online study (N = 279) indicate that non-experts, after minimal instruction, were able to create simple programs using an off-the-shelf visual programming interface. We discuss our findings and identify future avenues for this line of research.

| S-EPMC8358272 | biostudies-literature

Crowdsourcing biomedical research: leveraging communities as innovation engines.

Project description:The generation of large-scale biomedical data is creating unprecedented opportunities for basic and translational science. Typically, the data producers perform initial analyses, but it is very likely that the most informative methods may reside with other groups. Crowdsourcing the analysis of complex and massive data has emerged as a framework to find robust methodologies. When the crowdsourcing is done in the form of collaborative scientific competitions, known as Challenges, the validation of the methods is inherently addressed. Challenges also encourage open innovation, create collaborative communities to solve diverse and important biomedical problems, and foster the creation and dissemination of well-curated data repositories.

| S-EPMC5918684 | biostudies-literature

Trends in Haptic Communication of Human-Human Dyads: Toward Natural Human-Robot Co-manipulation.

Project description:In this paper, we analyze and report on observable trends in human-human dyads performing collaborative manipulation (co-manipulation) tasks with an extended object (object with significant length). We present a detailed analysis relating trends in interaction forces and torques with other metrics and propose that these trends could provide a way of improving communication and efficiency for human-robot dyads. We find that the motion of the co-manipulated object has a measurable oscillatory component. We confirm that haptic feedback alone represents a sufficient communication channel for co-manipulation tasks, however we find that the loss of visual and auditory channels has a significant effect on interaction torque and velocity. The main objective of this paper is to lay the essential groundwork in defining principles of co-manipulation between human dyads. We propose that these principles could enable effective and intuitive human-robot collaborative manipulation in future co-manipulation research.

| S-EPMC7925623 | biostudies-literature

Reaching and Grasping a Glass of Water by Locked-In ALS Patients through a BCI-Controlled Humanoid Robot.

Project description:Locked-in Amyotrophic Lateral Sclerosis (ALS) patients are fully dependent on caregivers for any daily need. At this stage, basic communication and environmental control may not be possible even with commonly used augmentative and alternative communication devices. Brain Computer Interface (BCI) technology allows users to modulate brain activity for communication and control of machines and devices, without requiring a motor control. In the last several years, numerous articles have described how persons with ALS could effectively use BCIs for different goals, usually spelling. In the present study, locked-in ALS patients used a BCI system to directly control the humanoid robot NAO (Aldebaran Robotics, France) with the aim of reaching and grasping a glass of water. Four ALS patients and four healthy controls were recruited and trained to operate this humanoid robot through a P300-based BCI. A few minutes training was sufficient to efficiently operate the system in different environments. Three out of the four ALS patients and all controls successfully performed the task with a high level of accuracy. These results suggest that BCI-operated robots can be used by locked-in ALS patients as an artificial alter-ego, the machine being able to move, speak and act in his/her place.

| S-EPMC5331030 | biostudies-literature

Crowdsourcing visual perception experiments: a case of contrast threshold.

Project description:Crowdsourcing has commonly been used for psychological research but not for studies on sensory perception. A reason is that in online experiments, one cannot ensure that the rigorous settings required for the experimental environment are replicated. The present study examined the suitability of online experiments on basic visual perception, particularly the contrast threshold. We conducted similar visual experiments in the laboratory and online, employing three experimental conditions. The first was a laboratory experiment, where a small sample of participants (n = 24; laboratory condition) completed a task with 10 iterations. The other two conditions were online experiments: participants were either presented with a task without repetition of trials (n = 285; online non-repetition condition) or one with 10 iterations (n = 166; online repetition condition). The results showed significant equivalence in the contrast thresholds between the laboratory and online repetition conditions, although a substantial amount of data needed to be excluded from the analyses in the latter condition. The contrast threshold was significantly higher in the online non-repetition condition compared with the laboratory and online repetition conditions. To make crowdsourcing more suitable for investigating the contrast threshold, ways to reduce data wastage need to be formulated.

| S-EPMC6927342 | biostudies-literature

A Mixed-Perception Approach for Safe Human-Robot Collaboration in Industrial Automation.

Project description:Digital-enabled manufacturing systems require a high level of automation for fast and low-cost production but should also present flexibility and adaptiveness to varying and dynamic conditions in their environment, including the presence of human beings; however, this presence of workers in the shared workspace with robots decreases the productivity, as the robot is not aware about the human position and intention, which leads to concerns about human safety. This issue is addressed in this work by designing a reliable safety monitoring system for collaborative robots (cobots). The main idea here is to significantly enhance safety using a combination of recognition of human actions using visual perception and at the same time interpreting physical human-robot contact by tactile perception. Two datasets containing contact and vision data are collected by using different volunteers. The action recognition system classifies human actions using the skeleton representation of the latter when entering the shared workspace and the contact detection system distinguishes between intentional and incidental interactions if physical contact between human and cobot takes place. Two different deep learning networks are used for human action recognition and contact detection, which in combination, are expected to lead to the enhancement of human safety and an increase in the level of cobot perception about human intentions. The results show a promising path for future AI-driven solutions in safe and productive human-robot collaboration (HRC) in industrial automation.

| S-EPMC7664417 | biostudies-literature

Neural correlates of tactile hardness intensity perception during active grasping.

Project description:While tactile sensation plays an essential role in interactions with the surroundings, relatively little is known about the neural processes involved in the perception of tactile information. In particular, it remains unclear how different intensities of tactile hardness are represented in the human brain during object manipulation. This study aims to investigate neural responses to various levels of tactile hardness using functional magnetic resonance imaging while people grasp objects to perceive hardness intensity. We used four items with different hardness levels but otherwise identical in shape and texture. A total of Twenty-five healthy volunteers participated in this study. Before scanning, participants performed a behavioral task in which they received a pair of stimuli and they were to report the perceived difference of hardness between them. During scanning, without any visual information, they were randomly given one of the four objects and asked to grasp it. We found significant blood oxygen-level-dependent (BOLD) responses in the posterior insula in the right hemisphere (rpIns) and the right posterior lobe of the cerebellum (rpCerebellum), which parametrically tracked hardness intensity. These responses were supported by BOLD signal changes in the rpCerebellum and rpIns correlating with tactile hardness intensity. Multidimensional scaling analysis showed similar representations of hardness intensity among physical, perceptual, and neural information. Our findings demonstrate the engagement of the rpCerebellum and rpIns in perceiving tactile hardness intensity during active object manipulation.

| S-EPMC8340901 | biostudies-literature

Programmable droplet manipulation by a magnetic-actuated robot.

Project description:Droplet manipulations are fundamental to numerous applications, such as water collection, medical diagnostics, and drug delivery. Structure-based liquid operations have been widely used both in nature and in artificial materials. However, current strategies depend mainly on fixed structures to realize unidirectional water movement, while multiple manipulation of droplets is still challenging. Here, we propose a magnetic-actuated robot with adjustable structures to achieve programmable multiple manipulations of droplets. The adjustable structure redistributes the resisting forces from the front and rear ends of the droplets, which determine the droplet behaviors. We can transport, split, release, and rotate the droplets using the robot. This robot is universally applicable for manipulation of various fluids in rough environments. These findings offer an efficient strategy for automated manipulation of droplets.

| S-EPMC7021501 | biostudies-literature

A direct effect of perception on action when grasping a cup.

Project description:Affordances represent features of an object that trigger specific actions. Here we tested whether the presence and orientation of a handle on a cup could bias grasping movements towards it in conditions where subjects were explicitly told to ignore the handle. We quantified the grip aperture profile of twelve healthy participants instructed to grasp a cup from its body while it either had no handle, a handle pointing towards, or away from the grasping hand (3 'move' conditions, with large grip aperture). To ensure the smaller grip aperture afforded by the handle was implicitly processed, we interspersed trials in which participants had to grasp the cup from its handle or a handle not attached to a cup with a small grip aperture. We found that grip aperture was smaller in the presence of a handle in the 'move' conditions, independently of its orientation. Our finding, of an effect of the handle during the execution of a grasp action, extends previous evidence of such an influence measured during motor preparation using simple reaction times. It suggests that the specific action elicited by an object's attribute can affect movement performance in a sustained manner throughout movement execution.

| S-EPMC5760564 | biostudies-literature

Grasping of Real-World Objects Is Not Biased by Ensemble Perception.

Project description:The visual system is known to extract summary representations of visually similar objects which bias the perception of individual objects toward the ensemble average. Although vision plays a large role in guiding action, less is known about whether ensemble representation is informative for action. Motor behavior is tuned to the veridical dimensions of objects and generally considered resistant to perceptual biases. However, when the relevant grasp dimension is not available or is unconstrained, ensemble perception may be informative to behavior by providing gist information about surrounding objects. In the present study, we examined if summary representations of a surrounding ensemble display influenced grip aperture and orientation when participants reached-to-grasp a central circular target which had an explicit size but importantly no explicit orientation that the visuomotor system could selectively attend to. Maximum grip aperture and grip orientation were not biased by ensemble statistics during grasping, although participants were able to perceive and provide manual estimations of the average size and orientation of the ensemble display. Support vector machine classification of ensemble statistics achieved above-chance classification accuracy when trained on kinematic and electromyography data of the perceptual but not grasping conditions, supporting our univariate findings. These results suggest that even along unconstrained grasping dimensions, visually-guided behaviors toward real-world objects are not biased by ensemble processing.

| S-EPMC8071954 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data