Browse
Submit Data
Databases
API
Help

Dataset Information

7 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

3D Recognition Based on Sensor Modalities for Robotic Systems: A Survey

ABSTRACT: 3D visual recognition is a prerequisite for most autonomous robotic systems operating in the real world. It empowers robots to perform a variety of tasks, such as tracking, understanding the environment, and human–robot interaction. Autonomous robots equipped with 3D recognition capability can better perform their social roles through supportive task assistance in professional jobs and effective domestic services. For active assistance, social robots must recognize their surroundings, including objects and places to perform the task more efficiently. This article first highlights the value-centric role of social robots in society by presenting recently developed robots and describes their main features. Instigated by the recognition capability of social robots, we present the analysis of data representation methods based on sensor modalities for 3D object and place recognition using deep learning models. In this direction, we delineate the research gaps that need to be addressed, summarize 3D recognition datasets, and present performance comparisons. Finally, a discussion of future research directions concludes the article. This survey is intended to show how recent developments in 3D visual recognition based on sensor modalities using deep-learning-based approaches can lay the groundwork to inspire further research and serves as a guide to those who are interested in vision-based robotics applications.

SUBMITTER: Manzoor S

PROVIDER: S-EPMC8587961 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

A Wearable Textile 3D Gesture Recognition Sensor Based on Screen-Printing Technology.

Project description:Research has developed various solutions in order for computers to recognize hand gestures in the context of human machine interface (HMI). The design of a successful hand gesture recognition system must address functionality and usability. The gesture recognition market has evolved from touchpads to touchless sensors, which do not need direct contact. Their application in textiles ranges from the field of medical environments to smart home applications and the automotive industry. In this paper, a textile capacitive touchless sensor has been developed by using screen-printing technology. Two different designs were developed to obtain the best configuration, obtaining good results in both cases. Finally, as a real application, a complete solution of the sensor with wireless communications is presented to be used as an interface for a mobile phone.

| S-EPMC6928654 | biostudies-literature

3D-Printed electrochemical sensor-integrated transwell systems.

Project description:This work presents a 3D-printed, modular, electrochemical sensor-integrated transwell system for monitoring cellular and molecular events in situ without sample extraction or microfluidics-assisted downstream omics. Simple additive manufacturing techniques such as 3D printing, shadow masking, and molding are used to fabricate this modular system, which is autoclavable, biocompatible, and designed to operate following standard operating protocols (SOPs) of cellular biology. Integral to the platform is a flexible porous membrane, which is used as a cell culture substrate similarly to a commercial transwell insert. Multimodal electrochemical sensors fabricated on the membrane allow direct access to cells and their products. A pair of gold electrodes on the top side of the membrane measures impedance over the course of cell attachment and growth, characterized by an exponential decrease (~160% at 10 Hz) due to an increase in the double layer capacitance from secreted extracellular matrix (ECM) proteins. Cyclic voltammetry (CV) sensor electrodes, fabricated on the bottom side of the membrane, enable sensing of molecular release at the site of cell culture without the need for downstream fluidics. Real-time detection of ferrocene dimethanol injection across the membrane showed a three order-of-magnitude higher signal at the membrane than in the bulk media after reaching equilibrium. This modular sensor-integrated transwell system allows unprecedented direct, real-time, and noninvasive access to physical and biochemical information, which cannot be obtained in a conventional transwell system.

| S-EPMC8433167 | biostudies-literature

Face Recognition Systems: A Survey.

Project description:Over the past few decades, interest in theories and algorithms for face recognition has been growing rapidly. Video surveillance, criminal identification, building access control, and unmanned and autonomous vehicles are just a few examples of concrete applications that are gaining attraction among industries. Various techniques are being developed including local, holistic, and hybrid approaches, which provide a face image description using only a few face image features or the whole facial features. The main contribution of this survey is to review some well-known techniques for each approach and to give the taxonomy of their categories. In the paper, a detailed comparison between these techniques is exposed by listing the advantages and the disadvantages of their schemes in terms of robustness, accuracy, complexity, and discrimination. One interesting feature mentioned in the paper is about the database used for face recognition. An overview of the most commonly used databases, including those of supervised and unsupervised learning, is given. Numerical results of the most interesting techniques are given along with the context of experiments and challenges handled by these techniques. Finally, a solid discussion is given in the paper about future directions in terms of techniques to be used for face recognition.

| S-EPMC7013584 | biostudies-literature

Mass-Manufacturable 3D Magnetic Force Sensor for Robotic Grasping and Slip Detection.

Project description:The manipulation of delicate objects remains a key challenge in the development of industrial robotic grippers. Magnetic force sensing solutions, which provide the required sense of touch, have been demonstrated in previous work. The sensors feature a magnet embedded within a deformable elastomer, which is mounted on top of a magnetometer chip. A key drawback of these sensors lies in the manufacturing process, which relies on the manual assembly of the magnet-elastomer transducer, impacting both the repeatability of measurements across sensors and the potential for a cost-effective solution through mass-manufacturing. In this paper, a magnetic force sensor solution is presented with an optimized manufacturing process that will facilitate mass production. The elastomer-magnet transducer was fabricated using injection molding, and the assembly of the transducer unit, on top of the magnetometer chip, was achieved using semiconductor manufacturing techniques. The sensor enables robust differential 3D force sensing within a compact footprint (5 mm × 4.4 mm × 4.6 mm). The measurement repeatability of these sensors was characterized over multiple samples and 300,000 loading cycles. This paper also showcases how the 3D high-speed sensing capabilities of these sensors can enable slip detection in industrial grippers.

| S-EPMC10054322 | biostudies-literature

Flexible Piezoelectric Sensor-Based Gait Recognition.

Project description:Most motion recognition research has required tight-fitting suits for precise sensing. However, tight-suit systems have difficulty adapting to real applications, because people normally wear loose clothes. In this paper, we propose a gait recognition system with flexible piezoelectric sensors in loose clothing. The gait recognition system does not directly sense lower-body angles. It does, however, detect the transition between standing and walking. Specifically, we use the signals from the flexible sensors attached to the knee and hip parts on loose pants. We detect the periodic motion component using the discrete time Fourier series from the signal during walking. We adapt the gait detection method to a real-time patient motion and posture monitoring system. In the monitoring system, the gait recognition operates well. Finally, we test the gait recognition system with 10 subjects, for which the proposed system successfully detects walking with a success rate over 93 %.

| S-EPMC5855108 | biostudies-literature

Scenario-Based Programming of Voice-Controlled Medical Robotic Systems.

Project description:An important issue in medical robotics is communication between physicians and robots. Speech-based communication is of particular advantage in robot-assisted surgery. It frees the surgeon's hands; hence, he can focus on the principal tasks. Man-machine voice communication is the subject of research in various domains (industry, social robotics), but medical robots are very specific. They must precisely synchronize their activities with operators. Voice commands must be possibly short. They must be executed without significant delays. An important factor is the use of a vision system that provides visual information in direct synchronization with surgeon actions. Its functions could be also controlled using speech. The aim of the research presented in this paper was to develop a method facilitating creation of voice-controlled medical robotic systems, fulfilling the mentioned requirements and taking into account possible scenarios of man-machine collaboration in such systems. A robot skill description (RSD) format was proposed in order to facilitate programming of voice control applications. A sample application was developed, and experiments were conducted in order to draw conclusions regarding the usefulness of speech-based interfaces in medical robotics. The results show that a reasonable selection of system functions controlled by voice may lead to significant improvement of man-machine collaboration.

| S-EPMC9738457 | biostudies-literature

The Actuation Mechanism of 3D Printed Flexure-Based Robotic Microtweezers.

Project description:We report on the design and the modeling of a three-dimensional (3D) printed flexure-based actuation mechanism for robotic microtweezers, the main body of which is a single piece of nylon. Our design aims to fill a void in sample manipulation between two classes of widely used instruments: nano-scale and macro-scale robotic manipulators. The key component is a uniquely designed cam flexure system, which linearly translates the bending of a piezoelectric bimorph actuator into angular displacement. The 3D printing made it possible to realize the fabrication of the cam with a specifically calculated curve, which would otherwise be costly using conventional milling techniques. We first characterized 3D printed nylon by studying sets of simple cantilevers, which provided fundamental characteristics that could be used for further designs. The finite element method analysis based on the obtained material data matched well with the experimental data. The tweezers showed angular displacement from 0° to 10° linearly to the deflection of the piezo actuator (0-1.74 mm) with the linearity error of 0.1°. Resonant frequency of the system with/without working tweezer tips was discovered as 101 Hz and 127 Hz, respectively. Our design provides simple and low-cost construction of a versatile manipulator system for samples in the micro/meso-scale (0.1-1 mm).

| S-EPMC6681016 | biostudies-literature

A 3D-Printable Robotic Gripper Based on Thick Panel Origami.

Project description:Origami has been a source of inspiration for the design of robots because it can be easily produced using 2D materials and its motions can be well quantified. However, most applications to date have utilised origami patterns for thin sheet materials with a negligible thickness. If the thickness of the material cannot be neglected, commonly known as the thick panel origami, the creases need to be redesigned. One approach is to place creases either on top or bottom surfaces of a sheet of finite thickness. As a result, spherical linkages in the zero-thickness origami are replaced by spatial linkages in the thick panel one, leading to a reduction in the overall degrees of freedom (DOFs). For instance, a waterbomb pattern for a zero-thickness sheet shows multiple DOFs while its thick panel counterpart has only one DOF, which significantly reduces the complexity of motion control. In this article, we present a robotic gripper derived from a unit that is based on the thick panel six-crease waterbomb origami. Four such units complete the gripper. Kinematically, each unit is a plane-symmetric Bricard linkage, and the gripper can be modelled as an assembly of Bricard linkages, giving it single mobility. A gripper prototype was made using 3D printing technology, and its motion was controlled by a set of tendons tied to a single motor. Detailed kinematic modelling was done, and experiments were carried out to characterise the gripper's behaviours. The positions of the tips on the gripper, the actuation force on tendons, and the grasping force generated on objects were analysed and measured. The experimental results matched well with the analytical ones, and the repeated tests demonstrate that the concept is viable. Furthermore, we observed that the gripper was also capable of grasping non-symmetrical objects, and such performance is discussed in detail in the paper.

| S-EPMC8455838 | biostudies-literature

New Modalities of 3D Pluripotent Stem Cell-Based Assays in Cardiovascular Toxicity.

Project description:The substantial progress of the human induced pluripotent stem cell (hiPSC) technologies over the last decade has provided us with new opportunities for cardiovascular drug discovery, regenerative medicine, and disease modeling. The combination of hiPSC with 3D culture techniques offers numerous advantages for generating and studying physiological and pathophysiological cardiac models. Cells grown in 3D can overcome many limitations of 2D cell cultures and animal models. Furthermore, it enables the investigation in an architecturally appropriate, complex cellular environment in vitro. Yet, generation and study of cardiac organoids-which may contain versatile cardiovascular cell types differentiated from hiPSC-remain a challenge. The large-scale and high-throughput applications require accurate and standardised models with highly automated processes in culturing, imaging and data collection. Besides the compound spatial structure of organoids, their biological processes also possess different temporal dynamics which require other methods and technologies to detect them. In this review, we summarise the possibilities and challenges of acquiring relevant information from 3D cardiovascular models. We focus on the opportunities during different time-scale processes in dynamic pharmacological experiments and discuss the putative steps toward one-size-fits-all assays.

| S-EPMC8039822 | biostudies-literature

3D printed protein-based robotic structures actuated by molecular motor assemblies.

Project description:Upscaling motor protein activity to perform work in man-made devices has long been an ambitious goal in bionanotechnology. The use of hierarchical motor assemblies, as realized in sarcomeres, has so far been complicated by the challenges of arranging sufficiently high numbers of motor proteins with nanoscopic precision. Here, we describe an alternative approach based on actomyosin cortex-like force production, allowing low complexity motor arrangements in a contractile meshwork that can be coated onto soft objects and locally activated by ATP. The design is reminiscent of a motorized exoskeleton actuating protein-based robotic structures from the outside. It readily supports the connection and assembly of micro-three-dimensional printed modules into larger structures, thereby scaling up mechanical work. We provide an analytical model of force production in these systems and demonstrate the design flexibility by three-dimensional printed units performing complex mechanical tasks, such as microhands and microarms that can grasp and wave following light activation.

| S-EPMC9156402 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data