A False Trail to Follow: Differential Effects of the Facial Feedback Signals From the Upper and Lower Face on the Recognition of Micro-Expressions.
Ontology highlight
ABSTRACT:
SUBMITTER: Zeng X
PROVIDER: S-EPMC6208096 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:PurposeFunctional inoperability in advanced oral cancer is difficult to assess preoperatively. To assess functions of lips and tongue, biomechanical models are required. Apart from adjusting generic models to individual anatomy, muscle activation patterns (MAPs) driving patient-specific functional movements are necessary to predict remaining functional outcome. We aim to evaluate how volunteer-specific MAPs derived from surface electromyographic (sEMG) signals control a biomechanical face model.MethodsMuscle activity of seven facial muscles in six volunteers was measured bilaterally with sEMG. A triple camera set-up recorded 3D lip movement. The generic face model in ArtiSynth was adapted to our needs. We controlled the model using the volunteer-specific MAPs. Three activation strategies were tested: activating all muscles [Formula: see text], selecting the three muscles showing highest muscle activity bilaterally [Formula: see text]-this was calculated by taking the mean of left and right muscles and then selecting the three with highest variance-and activating the muscles considered most relevant per instruction [Formula: see text], bilaterally. The model's lip movement was compared to the actual lip movement performed by the volunteers, using 3D correlation coefficients [Formula: see text].ResultsThe correlation coefficient between simulations and measurements with [Formula: see text] resulted in a median [Formula: see text] of 0.77. [Formula: see text] had a median [Formula: see text] of 0.78, whereas with [Formula: see text] the median [Formula: see text] decreased to 0.45.ConclusionWe demonstrated that MAPs derived from noninvasive sEMG measurements can control movement of the lips in a generic finite element face model with a median [Formula: see text] of 0.78. Ultimately, this is important to show the patient-specific residual movement using the patient's own MAPs. When the required treatment tools and personalisation techniques for geometry and anatomy become available, this may enable surgeons to test the functional results of wedge excisions for lip cancer in a virtual environment and to weigh surgery versus organ-sparing radiotherapy or photodynamic therapy.
| S-EPMC5754395 | biostudies-literature
Project description:The decoding of social signals from nonverbal cues plays a vital role in the social interactions of socially gregarious animals such as humans. Because nonverbal emotional signals from the face and body are normally seen together, it is important to investigate the mechanism underlying the integration of emotional signals from these two sources. We conducted a study in which the time course of the integration of facial and bodily expressions was examined via analysis of event-related potentials (ERPs) while the focus of attention was manipulated. Distinctive integrating features were found during multiple stages of processing. In the first stage, threatening information from the body was extracted automatically and rapidly, as evidenced by enhanced P1 amplitudes when the subjects viewed compound face-body images with fearful bodies compared with happy bodies. In the second stage, incongruency between emotional information from the face and the body was detected and captured by N2. Incongruent compound images elicited larger N2s than did congruent compound images. The focus of attention modulated the third stage of integration. When the subjects' attention was focused on the face, images with congruent emotional signals elicited larger P3s than did images with incongruent signals, suggesting more sustained attention and elaboration of congruent emotional information extracted from the face and body. On the other hand, when the subjects' attention was focused on the body, images with fearful bodies elicited larger P3s than did images with happy bodies, indicating more sustained attention and elaboration of threatening information from the body during evaluative processes.
| S-EPMC3720771 | biostudies-literature
Project description:Distinct shaping of the upper versus lower facial skeleton is essential for function of the vertebrate jaw and middle ear, yet the cellular mechanisms by which this occurs have remained unclear. Here, we show that Endothelin1 (Edn1) signaling accelerates mesenchymal condensation and subsequent cartilage formation in the lower face through antagonism of Jagged-Notch signaling and Prrx1 transcription factors. A genomic analysis of facial skeletal precursors in mutants and overexpression embryos reveals that Jagged-Notch signaling represses genes that are strongly induced as pharyngeal arch neural crest-derived cells begin skeletal differentiation. In wild types, initial Jagged-Notch repression dorsally ensures that barx1+ condensations and cartilage differentiation occur first in ventral-intermediate zones of the pharyngeal arches. Reduced Jagged-Notch signaling results in an expansion of pre-cartilage condensations in the upper face, with loss of barx1 partially restoring dorsal cartilage shapes in jag1b mutants. Further, by studying new mutants for zebrafish prrx1a and prrx1b, we find that Prrx1 genes function in parallel to Jagged-Notch signaling to restrict the formation of dorsal barx1+ pre-cartilage condensations. Consistently, combined losses of jag1b and prrx1a/b robustly rescue ventral barx1+ condensations and lower facial cartilage development in edn1 mutants. Together, our work suggests that Edn1 works through parallel inhibition of Jagged-Notch and Prrx1 pathways to promote an earlier and more extensive establishment of cartilage condensations in the lower face. We performed RNAseq on FACS-sorted neural crest-derived pharyngeal arch cells (fli1a:GFP; sox10:DsRed double positive) from wild-type embryos at 3 different stages (20, 28, and 36 hours post fertilization) and embryos with altered levels of Edn1 and Notch signaling (edn1 mutants and hsp70I:Gal4; UAS:Edn1 transgenics; jag1b mutants, dibenzazepine-treated embryos, and hsp70I:Gal4; UAS:NICD transgenics. We also sequenced RNA from heat-shocked UAS:Edn1+ and hsp70I:Gal4+ transgenics and jag1b+/+ controls.
2016-03-23 | E-GEOD-72985 | biostudies-arrayexpress
Project description:Nonverbal emotion recognition accuracy (ERA) is a central feature of successful communication and interaction, and is of importance for many professions. We developed and evaluated two ERA training programs-one focusing on dynamic multimodal expressions (audio, video, audio-video) and one focusing on facial micro expressions. Sixty-seven subjects were randomized to one of two experimental groups (multimodal, micro expression) or an active control group (emotional working memory task). Participants trained once weekly with a brief computerized training program for three consecutive weeks. Pre-post outcome measures consisted of a multimodal ERA task, a micro expression recognition task, and a task about patients' emotional cues. Post measurement took place approximately a week after the last training session. Non-parametric mixed analyses of variance using the Aligned Rank Transform were used to evaluate the effectiveness of the training programs. Results showed that multimodal training was significantly more effective in improving multimodal ERA compared to micro expression training or the control training; and the micro expression training was significantly more effective in improving micro expression ERA compared to the other two training conditions. Both pre-post effects can be interpreted as large. No group differences were found for the outcome measure about recognizing patients' emotion cues. There were no transfer effects of the training programs, meaning that participants only improved significantly for the specific facet of ERA that they had trained on. Further, low baseline ERA was associated with larger ERA improvements. Results are discussed with regard to methodological and conceptual aspects, and practical implications and future directions are explored.
| S-EPMC8406528 | biostudies-literature
Project description:Facial expressions of emotion are thought to have evolved from the development of facial muscles used in sensory regulation and later adapted to express moral judgment. Negative moral judgment includes the expressions of anger, disgust and contempt. Here, we study the hypothesis that these facial expressions of negative moral judgment have further evolved into a facial expression of negation regularly used as a grammatical marker in human language. Specifically, we show that people from different cultures expressing negation use the same facial muscles as those employed to express negative moral judgment. We then show that this nonverbal signal is used as a co-articulator in speech and that, in American Sign Language, it has been grammaticalized as a non-manual marker. Furthermore, this facial expression of negation exhibits the theta oscillation (3-8 Hz) universally seen in syllable and mouthing production in speech and signing. These results provide evidence for the hypothesis that some components of human language have evolved from facial expressions of emotion, and suggest an evolutionary route for the emergence of grammatical markers.
| S-EPMC4832078 | biostudies-literature
Project description:Distinct shaping of the upper versus lower facial skeleton is essential for function of the vertebrate jaw and middle ear, yet the cellular mechanisms by which this occurs have remained unclear. Here, we show that Endothelin1 (Edn1) signaling accelerates mesenchymal condensation and subsequent cartilage formation in the lower face through antagonism of Jagged-Notch signaling and Prrx1 transcription factors. A genomic analysis of facial skeletal precursors in mutants and overexpression embryos reveals that Jagged-Notch signaling represses genes that are strongly induced as pharyngeal arch neural crest-derived cells begin skeletal differentiation. In wild types, initial Jagged-Notch repression dorsally ensures that barx1+ condensations and cartilage differentiation occur first in ventral-intermediate zones of the pharyngeal arches. Reduced Jagged-Notch signaling results in an expansion of pre-cartilage condensations in the upper face, with loss of barx1 partially restoring dorsal cartilage shapes in jag1b mutants. Further, by studying new mutants for zebrafish prrx1a and prrx1b, we find that Prrx1 genes function in parallel to Jagged-Notch signaling to restrict the formation of dorsal barx1+ pre-cartilage condensations. Consistently, combined losses of jag1b and prrx1a/b robustly rescue ventral barx1+ condensations and lower facial cartilage development in edn1 mutants. Together, our work suggests that Edn1 works through parallel inhibition of Jagged-Notch and Prrx1 pathways to promote an earlier and more extensive establishment of cartilage condensations in the lower face.
2016-03-23 | GSE72985 | GEO
Project description:Recognition of facial expressions is crucial for effective social interactions. Yet, the extent to which the various face-selective regions in the human brain classify different facial expressions remains unclear. We used functional magnetic resonance imaging (fMRI) and support vector machine pattern classification analysis to determine how well face-selective brain regions are able to decode different categories of facial expression. Subjects participated in a slow event-related fMRI experiment in which they were shown 32 face pictures, portraying four different expressions: neutral, fearful, angry, and happy and belonging to eight different identities. Our results showed that only the amygdala and the posterior superior temporal sulcus (STS) were able to accurately discriminate between these expressions, albeit in different ways: the amygdala discriminated fearful faces from non-fearful faces, whereas STS discriminated neutral from emotional (fearful, angry and happy) faces. In contrast to these findings on the classification of emotional expression, only the fusiform face area (FFA) and anterior inferior temporal cortex (aIT) could discriminate among the various facial identities. Further, the amygdala and STS were better than FFA and aIT at classifying expression, while FFA and aIT were better than the amygdala and STS at classifying identity. Taken together, our findings indicate that the decoding of facial emotion and facial identity occurs in different neural substrates: the amygdala and STS for the former and FFA and aIT for the latter.
| S-EPMC4808360 | biostudies-literature
Project description:The ability to judge others' emotions is required for the establishment and maintenance of smooth interactions in a community. Several lines of evidence suggest that the attribution of meaning to a face is influenced by the facial actions produced by an observer during the observation of a face. However, empirical studies testing causal relationships between observers' facial actions and emotion judgments have reported mixed findings. This issue was investigated by measuring emotion judgments in terms of valence and arousal dimensions while comparing dynamic vs. static presentations of facial expressions. We presented pictures and videos of facial expressions of anger and happiness. Participants (N = 36) were asked to differentiate between the gender of faces by activating the corrugator supercilii muscle (brow lowering) and zygomaticus major muscle (cheek raising). They were also asked to evaluate the internal states of the stimuli using the affect grid while maintaining the facial action until they finished responding. The cheek raising condition increased the attributed valence scores compared with the brow-lowering condition. This effect of facial actions was observed for static as well as for dynamic facial expressions. These data suggest that facial feedback mechanisms contribute to the judgment of the valence of emotional facial expressions.
| S-EPMC4362049 | biostudies-literature
Project description:Face masks impact social interactions because emotion recognition is difficult due to face occlusion. However, is this enough to conclude that face masks negatively impact social interactions? We investigated the impact of face masks on invariant characteristics (sex, age), trait-like characteristics (trustworthiness, attractiveness, and approachability), and emotional expressions (happiness and excitability). Participants completed an online survey and rated masked and no-masked faces. The same face remained masked or no-masked throughout the survey. Results revealed that, when compared to no-masked faces, masked happy faces appeared less happy. Face masks did not negatively impact the ratings of other characteristics. Participants were better at judging the sex of masked faces. Masked faces also appeared younger, more trustworthy, more attractive, and more approachable. Therefore, face masks did not always result in unfavorable ratings. An additional post hoc modeling revealed that trustworthiness and attractiveness ratings for masked faces predicted the same trait ratings for no-masked faces. However, approachability ratings for no-masked faces predicted the same trait ratings for masked faces. This hinted that information from masked/no-masked faces, such as from the eye and eye region, could aid in the understanding of others during social interaction. Future directions were proposed to expand the research.
| S-EPMC8702500 | biostudies-literature
Project description:We assessed the recovery of 2 face transplantation patients with measures of complexity during neuromuscular rehabilitation. Cognitive rehabilitation methods and functional electrical stimulation were used to improve facial emotional expressions of full-face transplantation patients for 5 months. Rehabilitation and analyses were conducted at approximately 3 years after full facial transplantation in the patient group. We report complexity analysis of surface electromyography signals of these two patients in comparison to the results of 10 healthy individuals.Facial surface electromyography data were collected during 6 basic emotional expressions and 4 primary facial movements from 2 full-face transplantation patients and 10 healthy individuals to determine a strategy of functional electrical stimulation and understand the mechanisms of rehabilitation. A new personalized rehabilitation technique was developed using the wavelet packet method. Rehabilitation sessions were applied twice a month for 5 months. Subsequently, motor and functional progress was assessed by comparing the fuzzy entropy of surface electromyography data against the results obtained from patients before rehabilitation and the mean results obtained from 10 healthy subjects.At the end of personalized rehabilitation, the patient group showed improvements in their facial symmetry and their ability to perform basic facial expressions and primary facial movements. Similarity in the pattern of fuzzy entropy for facial expressions between the patient group and healthy individuals increased. Synkinesis was detected during primary facial movements in the patient group, and one patient showed synkinesis during the happiness expression. Synkinesis in the lower face region of one of the patients was eliminated for the lid tightening movement.The recovery of emotional expressions after personalized rehabilitation was satisfactory to the patients. The assessment with complexity analysis of sEMG data can be used for developing new neurorehabilitation techniques and detecting synkinesis after full-face transplantation.
| S-EPMC5840782 | biostudies-other