A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments.
Ontology highlight
ABSTRACT:
SUBMITTER: Liu M
PROVIDER: S-EPMC8748716 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Grasping force control is important for multi-fingered robotic hands to stabilize the grasped object. Humans are able to adjust their grasping force and react quickly to instabilities through tactile sensing. However, grasping force control through tactile sensing with robotic hands is still relatively unexplored. In this paper, we make use of tactile sensing for multi-fingered robot hands to adjust the grasping force to stabilize unknown objects without prior knowledge of their shape or physical properties. In particular, an online detection module based on Deep Neural Network (DNN) is designed to detect contact events and object material simultaneously from tactile data. In addition, a force estimation method based on Gaussian Mixture Model (GMM) is proposed to compute the contact information (i.e., contact force and contact location) from tactile data. According to the results of tactile sensing, an object stabilization controller is then employed for a robotic hand to adjust the contact configuration for object stabilization. The spatio-temporal property of tactile data is exploited during tactile sensing. Finally, the effectiveness of the proposed framework is evaluated in a real-world experiment with a five-fingered Shadow Dexterous Hand equipped with BioTac sensors.
| S-EPMC7070334 | biostudies-literature
Project description:The human tactile system is composed of multi-functional mechanoreceptors distributed in an optimized manner. Having the ability to design and optimize multi-modal soft sensory systems can further enhance the capabilities of current soft robotic systems. This work presents a complete framework for the fabrication of soft sensory fiber networks for contact localization, using pellet-based 3D printing of piezoresistive elastomers to manufacture flexible sensory networks with precise and repeatable performances. Given a desirable soft sensor property, our methodology can design and fabricate optimized sensor morphologies without human intervention. Extensive simulation and experimental studies are performed on two printed networks, comparing a baseline network to one optimized via an existing information theory based approach. Machine learning is used for contact localization based on the sensor responses. The sensor responses match simulations with tunable performances and good localization accuracy, even in the presence of damage and nonlinear material properties. The potential of the networks to function as capacitive sensors is also demonstrated.
| S-EPMC9502117 | biostudies-literature
Project description:Advances in flexible and multifunctional electronic devices have enabled the realization of sophisticated skin for robotics applications. In this paper, a large-scale, flexible and self-powered tactile sensing array (TSA) for sensitive robot skin is demonstrated based on the triboelectric effect. The device, with 4 × 4 sensing units, was composed of a top triboelectric polyethylene terephthalate (PET) layer, a bottom triboelectric copper (Cu) layer and a bottom PET substrate. A low-cost roll-to-roll ultraviolet embossing fabrication process was induced to pattern the large-scale top PET film with microstructures for high-output performance. The working mechanism and output performance of the triboelectric TSA were demonstrated and characterized, exhibiting good stability and high sensitivity. By integrating a tactile feedback system, the large-scale TSA, acting as intelligent skin for an industrial robot, was able to realize emergency avoidance and safety stop for various unknown obstacles under various working conditions. The system also has good real-time performance. By using a large-scale roll-to-roll fabrication method, this work pushes forward a significant step to self-powered triboelectric TSA and its potential applications in intelligent robot skin.
| S-EPMC6418621 | biostudies-literature
Project description:Earth-observing remote sensing data, including aerial photography and satellite imagery, offer a snapshot of the world from which we can learn about the state of natural resources and the built environment. The components of energy systems that are visible from above can be automatically assessed with these remote sensing data when processed with machine learning methods. Here, we focus on the information gap in distributed solar photovoltaic (PV) arrays, of which there is limited public data on solar PV deployments at small geographic scales. We created a dataset of solar PV arrays to initiate and develop the process of automatically identifying solar PV locations using remote sensing imagery. This dataset contains the geospatial coordinates and border vertices for over 19,000 solar panels across 601 high-resolution images from four cities in California. Dataset applications include training object detection and other machine learning algorithms that use remote sensing imagery, developing specific algorithms for predictive detection of distributed PV systems, estimating installed PV capacity, and analysis of the socioeconomic correlates of PV deployment.
| S-EPMC5148580 | biostudies-literature
Project description:When grasping objects, we rely on our sense of touch to adjust our grip and react against external perturbations. Less than 200 ms after an unexpected event, the sensorimotor system is able to process tactile information to deduce the frictional strength of the contact and to react accordingly. Given that roughly 1,300 afferents innervate the fingertips, it is unclear how the nervous system can process such a large influx of data in a sufficiently short time span. In this study, we measured the deformation of the skin during the initial stages of incipient sliding for a wide range of frictional conditions. We show that the dominant patterns of deformation are sufficient to estimate the distance between the frictional force and the frictional strength of the contact. From these stereotypical patterns, a classifier can predict if an object is about to slide during the initial stages of incipient slip. The prediction is robust to the actual value of the interfacial friction, showing sensory invariance. These results suggest the existence of a possible compact set of bases that we call Eigenstrains. These Eigenstrains are a potential mechanism to rapidly decode the margin from full slip from the tactile information contained in the deformation of the skin. Our findings suggest that only 6 of these Eigenstrains are necessary to classify whether the object is firmly stuck to the fingers or is close to slipping away. These findings give clues about the tactile regulation of grasp and the insights are directly applicable to the design of robotic grippers and prosthetics that rapidly react to external perturbations.
| S-EPMC9343352 | biostudies-literature
Project description:As a surrogate for human tactile cognition, an artificial tactile perception and cognition system are proposed to produce smooth/soft and rough tactile sensations by its user's tactile feeling; and named this system as "tactile avatar". A piezoelectric tactile sensor is developed to record dynamically various physical information such as pressure, temperature, hardness, sliding velocity, and surface topography. For artificial tactile cognition, the tactile feeling of humans to various tactile materials ranging from smooth/soft to rough are assessed and found variation among participants. Because tactile responses vary among humans, a deep learning structure is designed to allow personalization through training based on individualized histograms of human tactile cognition and recording physical tactile information. The decision error in each avatar system is less than 2% when 42 materials are used to measure the tactile data with 100 trials for each material under 1.2N of contact force with 4cm s-1 of sliding velocity. As a tactile avatar, the machine categorizes newly experienced materials based on the tactile knowledge obtained from training data. The tactile sensation showed a high correlation with the specific user's tendency. This approach can be applied to electronic devices with tactile emotional exchange capabilities, as well as advanced digital experiences.
| S-EPMC8024994 | biostudies-literature
Project description:Many neurological diseases impair the motor and somatosensory systems. While several different technologies are used in clinical practice to assess and improve motor functions, somatosensation is evaluated subjectively with qualitative clinical scales. Treatment of somatosensory deficits has received limited attention. To bridge the gap between the assessment and training of motor vs. somatosensory abilities, we designed, developed, and tested a novel, low-cost, two-component (bimanual) mechatronic system targeting tactile somatosensation: the Tactile-STAR-a tactile stimulator and recorder. The stimulator is an actuated pantograph structure driven by two servomotors, with an end-effector covered by a rubber material that can apply two different types of skin stimulation: brush and stretch. The stimulator has a modular design, and can be used to test the tactile perception in different parts of the body such as the hand, arm, leg, big toe, etc. The recorder is a passive pantograph that can measure hand motion using two potentiometers. The recorder can serve multiple purposes: participants can move its handle to match the direction and amplitude of the tactile stimulator, or they can use it as a master manipulator to control the tactile stimulator as a slave. Our ultimate goal is to assess and affect tactile acuity and somatosensory deficits. To demonstrate the feasibility of our novel system, we tested the Tactile-STAR with 16 healthy individuals and with three stroke survivors using the skin-brush stimulation. We verified that the system enables the mapping of tactile perception on the hand in both populations. We also tested the extent to which 30 min of training in healthy individuals led to an improvement of tactile perception. The results provide a first demonstration of the ability of this new system to characterize tactile perception in healthy individuals, as well as a quantification of the magnitude and pattern of tactile impairment in a small cohort of stroke survivors. The finding that short-term training with Tactile-STAR can improve the acuity of tactile perception in healthy individuals suggests that Tactile-STAR may have utility as a therapeutic intervention for somatosensory deficits.
| S-EPMC5897626 | biostudies-literature
Project description:The dramatic advances in flexible/wearable electronics have garnered great attention for touch sensors for practical applications in human health monitoring and human-machine interfaces. Self-powered triboelectric tactile sensors with high sensitivity, reduced crosstalk, and simple processing routes are highly desirable. Herein, we introduce a facile and low-cost fabrication approach for a metal-electrode free, fully integrated, flexible, and self-powered triboelectric tactile sensor array with 8-by-8 sensor units. Through the height difference between the sensor units and interconnect electrodes, the crosstalk derived from the electrodes has been successfully suppressed with no additional shielding layers. The tactile sensor array shows a remarkable sensitivity of 0.063 V kPa-1 with a linear range from 5 to 50 kPa, which covers a broad range of testing objects. Furthermore, due to the advanced mechanical design, the flexible sensor array exhibits great capability of pressure sensing even under a curved state. The voltage responses from the pattern mapping by finger touching demonstrate the uniformity of the sensor array. Finally, real-time tactile sensing associated with light-emitting diode (LED) array lighting demonstrates the potential application of the sensor array in position tracking, self-powered touch screens, human-machine interfaces and many others.
| S-EPMC8433331 | biostudies-literature
Project description:Chirality is essential in nature and often pivotal for biological information transfer, for example, via odor messenger molecules. While the human nose can distinguish the enantiomers of many chiral odors, the technical realization by an artificial sensor or an electronic nose, e-nose, remains a challenge. Herein, we present an array of six sensors coated with nanoporous metal-organic framework (MOF) films of different homochiral and achiral structures, working as an enantioselective e-nose. While the achiral-MOF-film sensors show identical responses for both isomers of one chiral odor molecule, the responses of the homochiral MOF films differ for different enantiomers. By machine learning algorithms, the combined array data allow the stereoselective identification of all compounds, here tested for five pairs of chiral odor molecules. We foresee the chiral-MOF-e-nose, able to enantioselectively detect and discriminate chiral odors, to be a powerful approach towards advanced odor sensing.
| S-EPMC7898876 | biostudies-literature
Project description:BackgroundMotor hand skill and associated dexterity is important for meeting the challenges of daily activity and an important resource post-stroke. In this context, the present study investigated the finger movements of right-handed subjects during tactile manipulation of a cuboid, a prototypical task underlying tactile exploration. During one motor act, the thumb and fingers of one hand surround the cuboid in a continuous and regular manner. While the object is moved by the guiding thumb, the opposed supporting fingers are replaced once they reach their joint limits by free fingers, a mechanism termed finger gaiting.MethodsFor both hands of 22 subjects, we acquired the time series of consecutive manipulations of a cuboid at a frequency of 1 Hz, using a digital data glove consisting of 29 sensors. Using principle component analysis, we decomposed the short action into motor patterns related to successive manipulations of the cuboid. The components purport to represent changing grasp configurations involving the stabilizing fingers and guiding thumb. The temporal features of the components permits testing whether the distinct configurations occur at the frequency of 1 Hz, i.e. within the time window of 1 s, and, thus, taxonomic classification of the manipulation as finger gaiting.ResultsThe fraction of variance described by the principal components indicated that three components described the salient features of the single motor acts for each hand. Striking in the finger patterns was the prominent and varying roles of the MCP and PIP joints of the fingers, and the CMC joint of the thumb. An important aspect of the three components was their representation of distinct finger configurations within the same motor act. Principal component and graph theory analysis confirmed modular, functionally synchronous action of the involved joints. The computation of finger trajectories in one subject illustrated the workspace of the task, which differed for the right and left hands.ConclusionIn this task one complex motor act of 1 s duration could be described by three elementary and hierarchically ordered grasp configurations occurring at the prescribed frequency of 1 Hz. Therefore, these configurations represent finger gaiting, described until now only in artificial systems, as the principal mechanism underlying this prototypical task.Trial registrationclinicaltrials.gov, NCT02865642 , registered 12 August 2016.
| S-EPMC7542978 | biostudies-literature