Dataset Information

A Mixed-Perception Approach for Safe Human-Robot Collaboration in Industrial Automation.

ABSTRACT: Digital-enabled manufacturing systems require a high level of automation for fast and low-cost production but should also present flexibility and adaptiveness to varying and dynamic conditions in their environment, including the presence of human beings; however, this presence of workers in the shared workspace with robots decreases the productivity, as the robot is not aware about the human position and intention, which leads to concerns about human safety. This issue is addressed in this work by designing a reliable safety monitoring system for collaborative robots (cobots). The main idea here is to significantly enhance safety using a combination of recognition of human actions using visual perception and at the same time interpreting physical human-robot contact by tactile perception. Two datasets containing contact and vision data are collected by using different volunteers. The action recognition system classifies human actions using the skeleton representation of the latter when entering the shared workspace and the contact detection system distinguishes between intentional and incidental interactions if physical contact between human and cobot takes place. Two different deep learning networks are used for human action recognition and contact detection, which in combination, are expected to lead to the enhancement of human safety and an increase in the level of cobot perception about human intentions. The results show a promising path for future AI-driven solutions in safe and productive human-robot collaboration (HRC) in industrial automation.

SUBMITTER: Mohammadi Amin F

PROVIDER: S-EPMC7664417 | biostudies-literature | 2020 Nov

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Mixed-Perception Approach for Safe Human-Robot Collaboration in Industrial Automation.

Mohammadi Amin Fatemeh F Rezayati Maryam M van de Venn Hans Wernher HW Karimpour Hossein H

Sensors (Basel, Switzerland) 20201107 21

Digital-enabled manufacturing systems require a high level of automation for fast and low-cost production but should also present flexibility and adaptiveness to varying and dynamic conditions in their environment, including the presence of human beings; however, this presence of workers in the shared workspace with robots decreases the productivity, as the robot is not aware about the human position and intention, which leads to concerns about human safety. This issue is addressed in this work ...[more]

PMID: 33171709

Similar Datasets

Project description:This article provides a perspective on estimation and control problems in cyberphysical human systems (CPHSs) that work at the intersection of cyberphysical systems and human systems. The article also discusses solutions to some of the problems in CPHSs. One example of a CPHS is a close-proximity human-robot collaboration (HRC) in a manufacturing setting. The issue of the joint operation's efficiency and human factors, such as safety, attention, mental states, and comfort, naturally arise in the HRC context. By considering human factors, robots' actions can be controlled to achieve objectives, including safe operations and human comfort. Alternately, questions arise when robot factors are considered. For example, can we provide direct inputs and information to humans about an environment and the robots in the area such that the objectives of safety, efficiency, and comfort can be satisfied by considering the robots' current capabilities? The article discusses specific problems involved in HRC related to controlling a robot's motion by taking the current actions of the human in the loop with the robot's control system. To this end, two main challenges are discussed: 1) inferring the intention behind human actions by analyzing a person's motion as observed through skeletal tracking and gaze data and 2) a controller design that keeps robot motion constrained to a boundary in a 3D space by using control barrier functions. The intention inference method fuses skeleton-joint tracking data obtained using the Microsoft Kinect sensor and human gaze data gathered from red-green-blue Kinect images. The direction of a human's hand-reaching motion and a goal-reaching point is estimated while performing a joint pick-and-place task. The trajectory of the hand is estimated forward in time based on the gaze and hand motion data at the current time instance. A barrier function method is applied to generate safe robot trajectories along with forecast hand movements to complete the collaborative displacement of an object by a person and a robot. An adaptive controller is then used to track the reference trajectories using the Baxter robot, which is tested in a Gazebo simulation environment.

Project description:Transhumeral percutaneous osseointegrated prostheses provide upper-extremity amputees with increased range of motion, more natural movement patterns, and enhanced proprioception. However, direct skeletal attachment of the endoprosthesis elevates the risk of bone fracture, which could necessitate revision surgery or result in loss of the residual limb. Bone fracture loads are direction dependent, strain rate dependent, and load rate dependent. Furthermore, in vivo, bone experiences multiaxial loading. Yet, mechanical characterization of the bone-implant interface is still performed with simple uni- or bi-axial loading scenarios that do not replicate the dynamic multiaxial loading environment inherent in human motion. The objective of this investigation was to reproduce the dynamic multiaxial loading conditions that the humerus experiences in vivo by robotically replicating humeral kinematics of advanced activities of daily living typical of an active amputee population. Specifically, 115 jumping jack, 105 jogging, 15 jug lift, and 15 internal rotation trials-previously recorded via skin-marker motion capture-were replicated on an industrial robot and the resulting humeral trajectories were verified using an optical tracking system. To achieve this goal, a computational pipeline that accepts a motion capture trajectory as input and outputs a motion program for an industrial robot was implemented, validated, and made accessible via public code repositories. The industrial manipulator utilized in this study was able to robotically replicate over 95% of the aforementioned trials to within the characteristic error present in skin-marker derived motion capture datasets. This investigation demonstrates the ability to robotically replicate human motion that recapitulates the inertial forces and moments of high-speed, multiaxial activities for biomechanical and orthopaedic investigations. It also establishes a library of robotically replicated motions that can be utilized in future studies to characterize the interaction of prosthetic devices with the skeletal system, and introduces a computational pipeline for expanding this motion library.

Dataset Information

A Mixed-Perception Approach for Safe Human-Robot Collaboration in Industrial Automation.

Publications

A Mixed-Perception Approach for Safe Human-Robot Collaboration in Industrial Automation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets