AI enabled sign language recognition and VR space bidirectional communication using triboelectric smart glove.
Ontology highlight
ABSTRACT:
SUBMITTER: Wen F
PROVIDER: S-EPMC8433305 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Flexible electronics with great functional characteristics have proved to be a stepping stone in the field of wearable devices. Amongst all, gesture-sensing techniques have been widely studied for human-machine interfaces. In this paper, we propose a self-powered gesture-sensing system attached to the back of the hands, which has the capability of distinguishing hand gestures by measuring the triboelectric nanogenerator output signal. By attaching the sensor on the back of the hand, we can sense the displacement of tendons to detect the gestures. In addition, humidity resistance and durability of the device were tested and validated. Furthermore, we have established a set of rules to define the relationship between gestures and corresponding English letters. Therefore, the proposed sensor can further serve as an electronic sign language translator by converting gestures into words. Finally, we can integrate this system into gloves to enhance the applicability and utility. Overall, we have developed a real-time self-powered back-of-hand sensing system which can recognize various hand gestures.
| S-EPMC6781458 | biostudies-literature
Project description:The rapid progress of Internet of things (IoT) technology raises an imperative demand on human machine interfaces (HMIs) which provide a critical linkage between human and machines. Using a glove as an intuitive and low-cost HMI can expediently track the motions of human fingers, resulting in a straightforward communication media of human-machine interactions. When combining several triboelectric textile sensors and proper machine learning technique, it has great potential to realize complex gesture recognition with the minimalist-designed glove for the comprehensive control in both real and virtual space. However, humidity or sweat may negatively affect the triboelectric output as well as the textile itself. Hence, in this work, a facile carbon nanotubes/thermoplastic elastomer (CNTs/TPE) coating approach is investigated in detail to achieve superhydrophobicity of the triboelectric textile for performance improvement. With great energy harvesting and human motion sensing capabilities, the glove using the superhydrophobic textile realizes a low-cost and self-powered interface for gesture recognition. By leveraging machine learning technology, various gesture recognition tasks are done in real time by using gestures to achieve highly accurate virtual reality/augmented reality (VR/AR) controls including gun shooting, baseball pitching, and flower arrangement, with minimized effect from sweat during operation.
| S-EPMC7375248 | biostudies-literature
Project description:Yarn sensors have shown promising application prospects in wearable electronics owing to their shape adaptability, good flexibility, and weavability. However, it is still a critical challenge to develop simultaneously structure stable, fast response, body conformal, mechanical robust yarn sensor using full microfibers in an industrial-scalable manner. Herein, a full-fiber auxetic-interlaced yarn sensor (AIYS) with negative Poisson's ratio is designed and fabricated using a continuous, mass-producible, structure-programmable, and low-cost spinning technology. Based on the unique microfiber interlaced architecture, AIYS simultaneously achieves a Poisson's ratio of-1.5, a robust mechanical property (0.6 cN/dtex), and a fast train-resistance responsiveness (0.025 s), which enhances conformality with the human body and quickly transduce human joint bending and/or stretching into electrical signals. Moreover, AIYS shows good flexibility, washability, weavability, and high repeatability. Furtherly, with the AIYS array, an ultrafast full-letter sign-language translation glove is developed using artificial neural network. The sign-language translation glove achieves an accuracy of 99.8% for all letters of the English alphabet within a short time of 0.25 s. Furthermore, owing to excellent full letter-recognition ability, real-time translation of daily dialogues and complex sentences is also demonstrated. The smart glove exhibits a remarkable potential in eliminating the communication barriers between signers and non-signers.
| S-EPMC9249965 | biostudies-literature
Project description:Gait and waist motions always contain massive personnel information and it is feasible to extract these data via wearable electronics for identification and healthcare based on the Internet of Things (IoT). There also remains a demand to develop a cost-effective human-machine interface to enhance the immersion during the long-term rehabilitation. Meanwhile, triboelectric nanogenerator (TENG) revealing its merits in both wearable electronics and IoT tends to be a possible solution. Herein, the authors present wearable TENG-based devices for gait analysis and waist motion capture to enhance the intelligence and performance of the lower-limb and waist rehabilitation. Four triboelectric sensors are equidistantly sewed onto a fabric belt to recognize the waist motion, enabling the real-time robotic manipulation and virtual game for immersion-enhanced waist training. The insole equipped with two TENG sensors is designed for walking status detection and a 98.4% identification accuracy for five different humans aiming at rehabilitation plan selection is achieved by leveraging machine learning technology to further analyze the signals. Through a lower-limb rehabilitation robot, the authors demonstrate that the sensory system performs well in user recognition, motion monitoring, as well as robot and gaming-aided training, showing its potential in IoT-based smart healthcare applications.
| S-EPMC8811828 | biostudies-literature
Project description:Regular exercise paves the way to a healthy life. However, conventional sports events are susceptible to weather conditions. Current motion sensors for home-based sports are mainly limited by operation power consumption, single-direction sensitivity, or inferior data analysis. Herein, by leveraging the 3-dimensional printing technique and triboelectric effect, a wearable self-powered multidimensional motion sensor has been developed to detect both the vertical and planar movement trajectory. By integrating with a belt, this sensor could be used to identify some low degree of freedom motions, e.g., waist or gait motion, with a high accuracy of 93.8%. Furthermore, when wearing the sensor at the ankle position, signals generated from shank motions that contain more abundant information could also be effectively collected. By means of a deep learning algorithm, the kicking direction and force could be precisely differentiated with an accuracy of 97.5%. Toward practical application, a virtual reality-enabled fitness game and a shooting game were successfully demonstrated. This work is believed to open up new insights for the development of future household sports or rehabilitation.
| S-EPMC10211429 | biostudies-literature
Project description:The agricultural sector is still lagging behind from all other sectors in terms of using the newest technologies. For production, the latest machines are being introduced and adopted. However, pre-harvest and post-harvest processing are still done by following traditional methodologies while tracing, storing, and publishing agricultural data. As a result, farmers are not getting deserved payment, consumers are not getting enough information before buying their product, and intermediate person/processors are increasing retail prices. Using blockchain, smart contracts, and IoT devices, we can fully automate the process while establishing absolute trust among all these parties. In this research, we explored the different aspects of using blockchain and smart contracts with the integration of IoT devices in pre-harvesting and post-harvesting segments of agriculture. We proposed a system that uses blockchain as the backbone while IoT devices collect data from the field level, and smart contracts regulate the interaction among all these contributing parties. The system implementation has been shown in diagrams and with proper explanations. Gas costs of every operation have also been attached for a better understanding of the costs. We also analyzed the system in terms of challenges and advantages. The overall impact of this research was to show the immutable, available, transparent, and robustly secure characteristics of blockchain in the field of agriculture while also emphasizing the vigorous mechanism that the collaboration of blockchain, smart contract, and IoT presents.
| S-EPMC8022535 | biostudies-literature
Project description:The ever-increasing demand for self-powered systems such as glucose biosensors and mixed reality devices has sparked significant interest in triboelectric generators, which hold large potential as renewable energy solutions. Our study explores new methods for integrating energy-harvesting capabilities into smart textiles by developing strong and efficient yarns that can convert mechanical energy into electrical energy through a triboelectric effect. Specifically, we focused on Nylon-11 (PA11), a material known for its crystalline structure well-suited for generating a powerful triboelectric response. To achieve this, we created triboelectric yarns by electrospinning PA11 fibers onto conductive carbon yarns, enabling energy-harvesting applications. Extensive testing demonstrated that these yarns possess exceptional durability, surpassing real-life usage requirements while experiencing minimal degradation. Additionally, we developed a prototype haptic device by interweaving tribopositive PA11 and tribonegative poly(vinylidene fluoride) (PVDF) triboelectric yarns. Our research has successfully yielded durable and efficient yarns with strong energy-harvesting capabilities, opening up possibilities for integrating smart textiles into practical scenarios. These technologies are promising steps to achieve greener and more reliable self-powered systems.
| S-EPMC10711711 | biostudies-literature
Project description:Preservice teachers' preparedness, perception, and affect toward certain technology systems influence the student acquisition of science knowledge, process skills, teaching innovation, and willingness to use technology in their classroom. The purpose of this study was to explore teachers' affective responses to a virtual reality-enabled scientific experiment (VaSE) system. Fifty-one preservice teachers majoring in educational technology participated in the study. They were divided into two groups, and their reactions were measured separately on two occasions. The first occasion used a standard system following the principle of Donald Norman's affective design model (ADM). The VaSE system was then revised with a strict version of ADM before the participants' reactions were measured for a second time. The positive and negative affect scale (PANAS) was utilized for affective state evaluation. Semi-structured interviews that focused on affective experiences were organized using an ADM framework and conducted immediately after the participants used VaSE. The results indicated that the positive affect experienced by the preservice teachers was significantly enhanced, and the negative affect was significantly weakened. Academic level, gender, and prior experience were important random effect factors that impacted the affective experience. It was also revealed that participants were more likely to be affected by immersion and interactivity in terms of enhancing positive affect and were more likely to be affected by behavioral layer elements in terms of weakening negative affect. A conclusion has been drawn to provide theoretical and practical suggestions for training preservice teachers in ways that improve their ability to integrate technology into the classroom.
| S-EPMC9389293 | biostudies-literature
Project description:Despite immense variability across languages, people can learn to understand any human language, spoken or signed. What neural mechanisms allow people to comprehend language across sensory modalities? When people listen to speech, electrophysiological oscillations in auditory cortex entrain to slow ([Formula: see text]8 Hz) fluctuations in the acoustic envelope. Entrainment to the speech envelope may reflect mechanisms specialized for auditory perception. Alternatively, flexible entrainment may be a general-purpose cortical mechanism that optimizes sensitivity to rhythmic information regardless of modality. Here, we test these proposals by examining cortical coherence to visual information in sign language. First, we develop a metric to quantify visual change over time. We find quasiperiodic fluctuations in sign language, characterized by lower frequencies than fluctuations in speech. Next, we test for entrainment of neural oscillations to visual change in sign language, using electroencephalography (EEG) in fluent speakers of American Sign Language (ASL) as they watch videos in ASL. We find significant cortical entrainment to visual oscillations in sign language <5 Hz, peaking at [Formula: see text]1 Hz. Coherence to sign is strongest over occipital and parietal cortex, in contrast to speech, where coherence is strongest over the auditory cortex. Nonsigners also show coherence to sign language, but entrainment at frontal sites is reduced relative to fluent signers. These results demonstrate that flexible cortical entrainment to language does not depend on neural processes that are specific to auditory speech perception. Low-frequency oscillatory entrainment may reflect a general cortical mechanism that maximizes sensitivity to informational peaks in time-varying signals.
| S-EPMC5474824 | biostudies-other
Project description:In this study, we used a simple and cost-effective method to fabricate triboelectric nanogenerators (TENGs) based on biowaste eggshell membranes (EMs). We prepared stretchable electrodes with various types of EMs (hen, duck, goose, and ostrich) and employed them as positive friction materials for bio-TENGs. A comparison of the electrical properties of the hen, duck, goose, and ostrich EMs revealed that the output voltage of the ostrich EM could reach up to 300 V, due to its abundant functional groups, natural fiber structure, high surface roughness, high surface charge, and high dielectric constant. The output power of the resulting device reached 0.18 mW, sufficient to power 250 red light-emitting diodes simultaneously, as well as a digital watch. This device also displayed good durability when subjected to 9000 cycles at 30 N at a frequency of 3 Hz. Furthermore, we designed an ostrich EM-TENG as a smart sensor for the detection of body motion, including leg movement and the pressing of different numbers of fingers.
| S-EPMC9948195 | biostudies-literature