Browse
Submit Data
Databases
API
Help

Dataset Information

35 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Highly Robust and Wearable Facial Expression Recognition via Deep-Learning-Assisted, Soft Epidermal Electronics.

ABSTRACT: The facial expressions are a mirror of the elusive emotion hidden in the mind, and thus, capturing expressions is a crucial way of merging the inward world and virtual world. However, typical facial expression recognition (FER) systems are restricted by environments where faces must be clearly seen for computer vision, or rigid devices that are not suitable for the time-dynamic, curvilinear faces. Here, we present a robust, highly wearable FER system that is based on deep-learning-assisted, soft epidermal electronics. The epidermal electronics that can fully conform on faces enable high-fidelity biosignal acquisition without hindering spontaneous facial expressions, releasing the constraint of movement, space, and light. The deep learning method can significantly enhance the recognition accuracy of facial expression types and intensities based on a small sample. The proposed wearable FER system is superior for wide applicability and high accuracy. The FER system is suitable for the individual and shows essential robustness to different light, occlusion, and various face poses. It is totally different from but complementary to the computer vision technology that is merely suitable for simultaneous FER of multiple individuals in a specific place. This wearable FER system is successfully applied to human-avatar emotion interaction and verbal communication disambiguation in a real-life environment, enabling promising human-computer interaction applications.

SUBMITTER: Zhuang M

PROVIDER: S-EPMC8302843 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Soft fibers with magnetoelasticity for wearable electronics.

Project description:Magnetoelastic effect characterizes the change of materials' magnetic properties under mechanical deformation, which is conventionally observed in some rigid metals or metal alloys. Here we show magnetoelastic effect can also exist in 1D soft fibers with stronger magnetomechanical coupling than that in traditional rigid counterparts. This effect is explained by a wavy chain model based on the magnetic dipole-dipole interaction and demagnetizing factor. To facilitate practical applications, we further invented a textile magnetoelastic generator (MEG), weaving the 1D soft fibers with conductive yarns to couple the observed magnetoelastic effect with magnetic induction, which paves a new way for biomechanical-to-electrical energy conversion with short-circuit current density of 0.63 mA cm-2, internal impedance of 180 Ω, and intrinsic waterproofness. Textile MEG was demonstrated to convert the arterial pulse into electrical signals with a low detection limit of 0.05 kPa, even with heavy perspiration or in underwater situations without encapsulations.

| S-EPMC8604991 | biostudies-literature

Whole Fabric-Assisted Thermoelectric Devices for Wearable Electronics.

Project description:Flexible thermoelectric generators (f-TEGs) have demonstrated great potential in wearable self-powered health monitoring devices. However, the existing wearable f-TEGs are neither flexible enough to bend and stretch while maintaining the device's integrity with a good TE performance nor directly compatible with clothes materials. Here, ultraflexible fabric-based thermoelectric generators (uf-TEGs) are proposed with conductive cloth electrodes and elastic fabric substrate. The patterned elastic fabric substrate fits the rigid cuboids well, together with serpentine structured cloth electrodes, rendering uf-TEG with excellent integrity and flexibility, thereby achieving a highly functional TE performance when strain reaches 30% or on arbitrarily shaped heat sources. The uf-TEGs show a large peak power of 64.10 μW for a temperature difference of 33.24 K with a high voltage output of 111.49 mV, which is superior compared to previously reported fabric-based TEG devices, and it is still functional after the water immersion test. Besides the energy harvesting function, with both the temperature sensing ability and the touch perception, this uf-TEG is demonstrated as the electrical skin when mounted on a robot. Moreover, due to the wind-sensitive performance and self-power ability, the uf-TEGs are assembled on cloth as wearable health and motion monitoring devices.

| S-EPMC8728843 | biostudies-literature

Stretchable Materials for Robust Soft Actuators towards Assistive Wearable Devices.

Project description:Soft actuators made from elastomeric active materials can find widespread potential implementation in a variety of applications ranging from assistive wearable technologies targeted at biomedical rehabilitation or assistance with activities of daily living, bioinspired and biomimetic systems, to gripping and manipulating fragile objects, and adaptable locomotion. In this manuscript, we propose a novel two-component soft actuator design and design tool that produces actuators targeted towards these applications with enhanced mechanical performance and manufacturability. Our numerical models developed using the finite element method can predict the actuator behavior at large mechanical strains to allow efficient design iterations for system optimization. Based on two distinctive actuator prototypes' (linear and bending actuators) experimental results that include free displacement and blocked-forces, we have validated the efficacy of the numerical models. The presented extensive investigation of mechanical performance for soft actuators with varying geometric parameters demonstrates the practical application of the design tool, and the robustness of the actuator hardware design, towards diverse soft robotic systems for a wide set of assistive wearable technologies, including replicating the motion of several parts of the human body.

| S-EPMC5037455 | biostudies-literature

Soft Elastomers with Ionic Liquid-Filled Cavities as Strain Isolating Substrates for Wearable Electronics.

Project description:Managing the mechanical mismatch between hard semiconductor components and soft biological tissues represents a key challenge in the development of advanced forms of wearable electronic devices. An ultralow modulus material or a liquid that surrounds the electronics and resides in a thin elastomeric shell provides a strain-isolation effect that enhances not only the wearability but also the range of stretchability in suitably designed devices. The results presented here build on these concepts by (1) replacing traditional liquids explored in the past, which have some nonnegligible vapor pressure and finite permeability through the encapsulating elastomers, with ionic liquids to eliminate any possibility for leakage or evaporation, and (2) positioning the liquid between the electronics and the skin, within an enclosed, elastomeric microfluidic space, but not in direct contact with the active elements of the system, to avoid any negative consequences on electronic performance. Combined experimental and theoretical results establish the strain-isolating effects of this system, and the considerations that dictate mechanical collapse of the fluid-filled cavity. Examples in skin-mounted wearable include wireless sensors for measuring temperature and wired systems for recording mechano-acoustic responses.

| S-EPMC5332287 | biostudies-literature

Metal oxide semiconductor nanomembrane-based soft unnoticeable multifunctional electronics for wearable human-machine interfaces.

Project description:Wearable human-machine interfaces (HMIs) are an important class of devices that enable human and machine interaction and teaming. Recent advances in electronics, materials, and mechanical designs have offered avenues toward wearable HMI devices. However, existing wearable HMI devices are uncomfortable to use and restrict the human body's motion, show slow response times, or are challenging to realize with multiple functions. Here, we report sol-gel-on-polymer-processed indium zinc oxide semiconductor nanomembrane-based ultrathin stretchable electronics with advantages of multifunctionality, simple manufacturing, imperceptible wearing, and robust interfacing. Multifunctional wearable HMI devices range from resistive random-access memory for data storage to field-effect transistors for interfacing and switching circuits, to various sensors for health and body motion sensing, and to microheaters for temperature delivery. The HMI devices can be not only seamlessly worn by humans but also implemented as prosthetic skin for robotics, which offer intelligent feedback, resulting in a closed-loop HMI system.

| S-EPMC6677552 | biostudies-literature

Super Tough and Spontaneous Water-Assisted Autonomous Self-Healing Elastomer for Underwater Wearable Electronics.

Project description:Self-healing soft electronic material composition is crucial to sustain the device long-term durability. The fabrication of self-healing soft electronics exposed to high moisture environment is a significant challenge that has yet to be fully achieved. This paper presents the novel concept of a water-assisted room-temperature autonomous self-healing mechanism based on synergistically dynamic covalent Schiff-based imine bonds with hydrogen bonds. The supramolecular water-assisted self-healing polymer (WASHP) films possess rapid self-healing kinetic behavior and high stretchability due to a reversible dissociation-association process. In comparison with the pristine room-temperature self-healing polymer, the WASHP demonstrates favorable mechanical performance at room temperature and a short self-healing time of 1 h; furthermore, it achieves a tensile strain of 9050%, self-healing efficiency of 95%, and toughness of 144.2 MJ m-3 . As a proof of concept, a versatile WASHP-based light-emitting touch-responsive device (WASHP-LETD) and perovskite quantum dot (PeQD)-based white LED backlight are designed. The WASHP-LETD has favorable mechanical deformation performance under pressure, bending, and strain, whereas the WASHP-PeQDs exhibit outstanding long-term stability even over a period exceeding one year in a boiling water environment. This paper provides a mechanically robust approach for producing eco-friendly, economical, and waterproof e-skin device components.

| S-EPMC8564429 | biostudies-literature

Soft, stretchable, epidermal sensor with integrated electronics and photochemistry for measuring personal UV exposures.

Project description:Excessive ultraviolet (UV) radiation induces acute and chronic effects on the skin, eye and immune system. Personalized monitoring of UV radiation is thus paramount to measure the extent of personal sun exposure, which could vary with environment, lifestyle, and sunscreen use. Here, we demonstrate an ultralow modulus, stretchable, skin-mounted UV patch that measures personal UV doses. The patch contains functional layers of ultrathin stretchable electronics and a photosensitive patterned dye that reacts to UV radiation. Color changes in the photosensitive dyes correspond to UV radiation intensity and are analyzed with a smartphone camera. A software application has feature recognition, lighting condition correction, and quantification algorithms that detect and quantify changes in color. These color changes are then correlated with corresponding shifts in UV dose, and compared to existing UV dose risk levels. The soft mechanics of the UV patch allow for multi-day wear in the presence of sunscreen and water. Two evaluation studies serve to demonstrate the utility of the UV patch during daily activities with and without sunscreen application.

| S-EPMC5749742 | biostudies-literature

Heterogeneous integration of rigid, soft, and liquid materials for self-healable, recyclable, and reconfigurable wearable electronics.

Project description:Wearable electronics can be integrated with the human body for monitoring physical activities and health conditions, for human-computer interfaces, and for virtual/augmented reality. We here report a multifunctional wearable electronic system that combines advances in materials, chemistry, and mechanics to enable superior stretchability, self-healability, recyclability, and reconfigurability. This electronic system heterogeneously integrates rigid, soft, and liquid materials through a low-cost fabrication method. The properties reported in this wearable electronic system can find applications in many areas, including health care, robotics, and prosthetics, and can benefit the well-being, economy, and sustainability of our society.

| S-EPMC7673720 | biostudies-literature

High-performance compliant thermoelectric generators with magnetically self-assembled soft heat conductors for self-powered wearable electronics.

Project description:Softening of thermoelectric generators facilitates conformal contact with arbitrary-shaped heat sources, which offers an opportunity to realize self-powered wearable applications. However, existing wearable thermoelectric devices inevitably exhibit reduced thermoelectric conversion efficiency due to the parasitic heat loss in high-thermal-impedance polymer substrates and poor thermal contact arising from rigid interconnects. Here, we propose compliant thermoelectric generators with intrinsically stretchable interconnects and soft heat conductors that achieve high thermoelectric performance and unprecedented conformability simultaneously. The silver-nanowire-based soft electrodes interconnect bismuth-telluride-based thermoelectric legs, effectively absorbing strain energy, which allows our thermoelectric generators to conform perfectly to curved surfaces. Metal particles magnetically self-assembled in elastomeric substrates form soft heat conductors that significantly enhance the heat transfer to the thermoelectric legs, thereby maximizing energy conversion efficiency on three-dimensional heat sources. Moreover, automated additive manufacturing paves the way for realizing self-powered wearable applications comprising hundreds of thermoelectric legs with high customizability under ambient conditions.

| S-EPMC7684283 | biostudies-literature

Assessing facial weakness in myasthenia gravis with facial recognition software and deep learning.

Project description:ObjectiveMyasthenia gravis (MG) is an autoimmune disease leading to fatigable muscle weakness. Extra-ocular and bulbar muscles are most commonly affected. We aimed to investigate whether facial weakness can be quantified automatically and used for diagnosis and disease monitoring.MethodsIn this cross-sectional study, we analyzed video recordings of 70 MG patients and 69 healthy controls (HC) with two different methods. Facial weakness was first quantified with facial expression recognition software. Subsequently, a deep learning (DL) computer model was trained for the classification of diagnosis and disease severity using multiple cross-validations on videos of 50 patients and 50 controls. Results were validated using unseen videos of 20 MG patients and 19 HC.ResultsExpression of anger (p = 0.026), fear (p = 0.003), and happiness (p < 0.001) was significantly decreased in MG compared to HC. Specific patterns of decreased facial movement were detectable in each emotion. Results of the DL model for diagnosis were as follows: area under the curve (AUC) of the receiver operator curve 0.75 (95% CI 0.65-0.85), sensitivity 0.76, specificity 0.76, and accuracy 76%. For disease severity: AUC 0.75 (95% CI 0.60-0.90), sensitivity 0.93, specificity 0.63, and accuracy 80%. Results of validation, diagnosis: AUC 0.82 (95% CI: 0.67-0.97), sensitivity 1.0, specificity 0.74, and accuracy 87%. For disease severity: AUC 0.88 (95% CI: 0.67-1.0), sensitivity 1.0, specificity 0.86, and accuracy 94%.InterpretationPatterns of facial weakness can be detected with facial recognition software. Second, this study delivers a 'proof of concept' for a DL model that can distinguish MG from HC and classifies disease severity.

| S-EPMC10424649 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data