A star-nose-like tactile-olfactory bionic sensing array for robust object recognition in non-visual environments.
Ontology highlight
ABSTRACT:
SUBMITTER: Liu M
PROVIDER: S-EPMC8748716 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Grasping force control is important for multi-fingered robotic hands to stabilize the grasped object. Humans are able to adjust their grasping force and react quickly to instabilities through tactile sensing. However, grasping force control through tactile sensing with robotic hands is still relatively unexplored. In this paper, we make use of tactile sensing for multi-fingered robot hands to adjust the grasping force to stabilize unknown objects without prior knowledge of their shape or physical properties. In particular, an online detection module based on Deep Neural Network (DNN) is designed to detect contact events and object material simultaneously from tactile data. In addition, a force estimation method based on Gaussian Mixture Model (GMM) is proposed to compute the contact information (i.e., contact force and contact location) from tactile data. According to the results of tactile sensing, an object stabilization controller is then employed for a robotic hand to adjust the contact configuration for object stabilization. The spatio-temporal property of tactile data is exploited during tactile sensing. Finally, the effectiveness of the proposed framework is evaluated in a real-world experiment with a five-fingered Shadow Dexterous Hand equipped with BioTac sensors.
| S-EPMC7070334 | biostudies-literature
Project description:Advances in flexible and multifunctional electronic devices have enabled the realization of sophisticated skin for robotics applications. In this paper, a large-scale, flexible and self-powered tactile sensing array (TSA) for sensitive robot skin is demonstrated based on the triboelectric effect. The device, with 4 × 4 sensing units, was composed of a top triboelectric polyethylene terephthalate (PET) layer, a bottom triboelectric copper (Cu) layer and a bottom PET substrate. A low-cost roll-to-roll ultraviolet embossing fabrication process was induced to pattern the large-scale top PET film with microstructures for high-output performance. The working mechanism and output performance of the triboelectric TSA were demonstrated and characterized, exhibiting good stability and high sensitivity. By integrating a tactile feedback system, the large-scale TSA, acting as intelligent skin for an industrial robot, was able to realize emergency avoidance and safety stop for various unknown obstacles under various working conditions. The system also has good real-time performance. By using a large-scale roll-to-roll fabrication method, this work pushes forward a significant step to self-powered triboelectric TSA and its potential applications in intelligent robot skin.
| S-EPMC6418621 | biostudies-literature
Project description:Earth-observing remote sensing data, including aerial photography and satellite imagery, offer a snapshot of the world from which we can learn about the state of natural resources and the built environment. The components of energy systems that are visible from above can be automatically assessed with these remote sensing data when processed with machine learning methods. Here, we focus on the information gap in distributed solar photovoltaic (PV) arrays, of which there is limited public data on solar PV deployments at small geographic scales. We created a dataset of solar PV arrays to initiate and develop the process of automatically identifying solar PV locations using remote sensing imagery. This dataset contains the geospatial coordinates and border vertices for over 19,000 solar panels across 601 high-resolution images from four cities in California. Dataset applications include training object detection and other machine learning algorithms that use remote sensing imagery, developing specific algorithms for predictive detection of distributed PV systems, estimating installed PV capacity, and analysis of the socioeconomic correlates of PV deployment.
| S-EPMC5148580 | biostudies-literature
Project description:As a surrogate for human tactile cognition, an artificial tactile perception and cognition system are proposed to produce smooth/soft and rough tactile sensations by its user's tactile feeling; and named this system as "tactile avatar". A piezoelectric tactile sensor is developed to record dynamically various physical information such as pressure, temperature, hardness, sliding velocity, and surface topography. For artificial tactile cognition, the tactile feeling of humans to various tactile materials ranging from smooth/soft to rough are assessed and found variation among participants. Because tactile responses vary among humans, a deep learning structure is designed to allow personalization through training based on individualized histograms of human tactile cognition and recording physical tactile information. The decision error in each avatar system is less than 2% when 42 materials are used to measure the tactile data with 100 trials for each material under 1.2N of contact force with 4cm s-1 of sliding velocity. As a tactile avatar, the machine categorizes newly experienced materials based on the tactile knowledge obtained from training data. The tactile sensation showed a high correlation with the specific user's tendency. This approach can be applied to electronic devices with tactile emotional exchange capabilities, as well as advanced digital experiences.
| S-EPMC8024994 | biostudies-literature
Project description:Many neurological diseases impair the motor and somatosensory systems. While several different technologies are used in clinical practice to assess and improve motor functions, somatosensation is evaluated subjectively with qualitative clinical scales. Treatment of somatosensory deficits has received limited attention. To bridge the gap between the assessment and training of motor vs. somatosensory abilities, we designed, developed, and tested a novel, low-cost, two-component (bimanual) mechatronic system targeting tactile somatosensation: the Tactile-STAR-a tactile stimulator and recorder. The stimulator is an actuated pantograph structure driven by two servomotors, with an end-effector covered by a rubber material that can apply two different types of skin stimulation: brush and stretch. The stimulator has a modular design, and can be used to test the tactile perception in different parts of the body such as the hand, arm, leg, big toe, etc. The recorder is a passive pantograph that can measure hand motion using two potentiometers. The recorder can serve multiple purposes: participants can move its handle to match the direction and amplitude of the tactile stimulator, or they can use it as a master manipulator to control the tactile stimulator as a slave. Our ultimate goal is to assess and affect tactile acuity and somatosensory deficits. To demonstrate the feasibility of our novel system, we tested the Tactile-STAR with 16 healthy individuals and with three stroke survivors using the skin-brush stimulation. We verified that the system enables the mapping of tactile perception on the hand in both populations. We also tested the extent to which 30 min of training in healthy individuals led to an improvement of tactile perception. The results provide a first demonstration of the ability of this new system to characterize tactile perception in healthy individuals, as well as a quantification of the magnitude and pattern of tactile impairment in a small cohort of stroke survivors. The finding that short-term training with Tactile-STAR can improve the acuity of tactile perception in healthy individuals suggests that Tactile-STAR may have utility as a therapeutic intervention for somatosensory deficits.
| S-EPMC5897626 | biostudies-literature
Project description:The dramatic advances in flexible/wearable electronics have garnered great attention for touch sensors for practical applications in human health monitoring and human-machine interfaces. Self-powered triboelectric tactile sensors with high sensitivity, reduced crosstalk, and simple processing routes are highly desirable. Herein, we introduce a facile and low-cost fabrication approach for a metal-electrode free, fully integrated, flexible, and self-powered triboelectric tactile sensor array with 8-by-8 sensor units. Through the height difference between the sensor units and interconnect electrodes, the crosstalk derived from the electrodes has been successfully suppressed with no additional shielding layers. The tactile sensor array shows a remarkable sensitivity of 0.063 V kPa-1 with a linear range from 5 to 50 kPa, which covers a broad range of testing objects. Furthermore, due to the advanced mechanical design, the flexible sensor array exhibits great capability of pressure sensing even under a curved state. The voltage responses from the pattern mapping by finger touching demonstrate the uniformity of the sensor array. Finally, real-time tactile sensing associated with light-emitting diode (LED) array lighting demonstrates the potential application of the sensor array in position tracking, self-powered touch screens, human-machine interfaces and many others.
| S-EPMC8433331 | biostudies-literature
Project description:Chirality is essential in nature and often pivotal for biological information transfer, for example, via odor messenger molecules. While the human nose can distinguish the enantiomers of many chiral odors, the technical realization by an artificial sensor or an electronic nose, e-nose, remains a challenge. Herein, we present an array of six sensors coated with nanoporous metal-organic framework (MOF) films of different homochiral and achiral structures, working as an enantioselective e-nose. While the achiral-MOF-film sensors show identical responses for both isomers of one chiral odor molecule, the responses of the homochiral MOF films differ for different enantiomers. By machine learning algorithms, the combined array data allow the stereoselective identification of all compounds, here tested for five pairs of chiral odor molecules. We foresee the chiral-MOF-e-nose, able to enantioselectively detect and discriminate chiral odors, to be a powerful approach towards advanced odor sensing.
| S-EPMC7898876 | biostudies-literature
Project description:BACKGROUND:Motor hand skill and associated dexterity is important for meeting the challenges of daily activity and an important resource post-stroke. In this context, the present study investigated the finger movements of right-handed subjects during tactile manipulation of a cuboid, a prototypical task underlying tactile exploration. During one motor act, the thumb and fingers of one hand surround the cuboid in a continuous and regular manner. While the object is moved by the guiding thumb, the opposed supporting fingers are replaced once they reach their joint limits by free fingers, a mechanism termed finger gaiting. METHODS:For both hands of 22 subjects, we acquired the time series of consecutive manipulations of a cuboid at a frequency of 1?Hz, using a digital data glove consisting of 29 sensors. Using principle component analysis, we decomposed the short action into motor patterns related to successive manipulations of the cuboid. The components purport to represent changing grasp configurations involving the stabilizing fingers and guiding thumb. The temporal features of the components permits testing whether the distinct configurations occur at the frequency of 1?Hz, i.e. within the time window of 1?s, and, thus, taxonomic classification of the manipulation as finger gaiting. RESULTS:The fraction of variance described by the principal components indicated that three components described the salient features of the single motor acts for each hand. Striking in the finger patterns was the prominent and varying roles of the MCP and PIP joints of the fingers, and the CMC joint of the thumb. An important aspect of the three components was their representation of distinct finger configurations within the same motor act. Principal component and graph theory analysis confirmed modular, functionally synchronous action of the involved joints. The computation of finger trajectories in one subject illustrated the workspace of the task, which differed for the right and left hands. CONCLUSION:In this task one complex motor act of 1?s duration could be described by three elementary and hierarchically ordered grasp configurations occurring at the prescribed frequency of 1?Hz. Therefore, these configurations represent finger gaiting, described until now only in artificial systems, as the principal mechanism underlying this prototypical task. TRIAL REGISTRATION:clinicaltrials.gov, NCT02865642 , registered 12 August 2016.
| S-EPMC7542978 | biostudies-literature
Project description:Soft wearable electronics for underwater applications are of interest, but depend on the development of a waterproof, long-term sustainable power source. In this work, we report a bionic stretchable nanogenerator for underwater energy harvesting that mimics the structure of ion channels on the cytomembrane of electrocyte in an electric eel. Combining the effects of triboelectrification caused by flowing liquid and principles of electrostatic induction, the bionic stretchable nanogenerator can harvest mechanical energy from human motion underwater and output an open-circuit voltage over 10 V. Underwater applications of a bionic stretchable nanogenerator have also been demonstrated, such as human body multi-position motion monitoring and an undersea rescue system. The advantages of excellent flexibility, stretchability, outstanding tensile fatigue resistance (over 50,000 times) and underwater performance make the bionic stretchable nanogenerator a promising sustainable power source for the soft wearable electronics used underwater.
| S-EPMC6584498 | biostudies-literature
Project description:A neuromorphic module of an electronic nose (E-nose) is demonstrated by hybridizing a chemoresistive gas sensor made of a semiconductor metal oxide (SMO) and a single transistor neuron (1T-neuron) made of a metal-oxide-semiconductor field-effect transistor (MOSFET). By mimicking a biological olfactory neuron, it simultaneously detects a gas and encoded spike signals for in-sensor neuromorphic functioning. It identifies an odor source by analyzing the complicated mixed signals using a spiking neural network (SNN). The proposed E-nose does not require conversion circuits, which are essential for processing the sensory signals between the sensor array and processors in the conventional bulky E-nose. In addition, they do not have to include a central processing unit (CPU) and memory, which are required for von Neumann computing. The spike transmission of the biological olfactory system, which is known to be the main factor for reducing power consumption, is realized with the SNN for power savings compared to the conventional E-nose with a deep neural network (DNN). Therefore, the proposed neuromorphic E-nose is promising for application to Internet of Things (IoT), which demands a highly scalable and energy-efficient system. As a practical example, it is employed as an electronic sommelier by classifying different types of wines.
| S-EPMC9218653 | biostudies-literature