Laughter and smiling facial expression modelling for the generation of virtual affective behavior.
Ontology highlight
ABSTRACT:
SUBMITTER: Mascaro M
PROVIDER: S-EPMC8115814 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Facial expression classification requires large amounts of data to reflect the diversity of conditions in the real world. Public databases support research tasks providing researchers an appropriate work framework. However, often these databases do not focus on artistic creation. We developed an innovative facial expression dataset that can help both artists and researchers in the field of affective computing. This dataset can be managed interactively by an intuitive and easy to use software application. The dataset is composed of 640 facial images from 20 virtual characters each creating 32 facial expressions. The avatars represent 10 men and 10 women, aged between 20 and 80, from different ethnicities. Expressions are classified by the six universal expressions according to Gary Faigin classification.
| S-EPMC7135287 | biostudies-literature
Project description:The perception and storage of facial emotional expressions constitutes an important human skill that is essential for our daily social interactions. While previous research revealed that facial feedback can influence the perception of facial emotional expressions, it is unclear whether facial feedback also plays a role in memory processes of facial emotional expressions. In the present study we investigated the impact of facial feedback on the performance in emotional visual working memory (WM). For this purpose, 37 participants underwent a classical facial feedback manipulation (FFM) (holding a pen with the teeth-inducing a smiling expression vs. holding a pen with the non-dominant hand-as a control condition) while they performed a WM task on varying intensities of happy or sad facial expressions. Results show that the smiling manipulation improved memory performance selectively for happy faces, especially for highly ambiguous facial expressions. Furthermore, we found that in addition to an overall negative bias specifically for happy faces (i.e. happy faces are remembered as more negative than they initially were), FFM induced a positivity bias when memorizing emotional facial information (i.e. faces were remembered as being more positive than they actually were). Finally, our data demonstrate that men were affected more by FFM: during induced smiling men showed a larger positive bias than women did. These data demonstrate that facial feedback not only influences our perception but also systematically alters our memory of facial emotional expressions.
| S-EPMC8131584 | biostudies-literature
Project description:Evidence that affective factors (e.g. anxiety, depression, affect) are significantly related to individual differences in emotion recognition is mixed. Palermo et al. (Palermo et al. 2018 J. Exp. Psychol. Hum. Percept. Perform. 44, 503-517) reported that individuals who scored lower in anxiety performed significantly better on two measures of facial-expression recognition (emotion-matching and emotion-labelling tasks), but not a third measure (the multimodal emotion recognition test). By contrast, facial-expression recognition was not significantly correlated with measures of depression, positive or negative affect, empathy, or autistic-like traits. Because the range of affective factors considered in this study and its use of multiple expression-recognition tasks mean that it is a relatively comprehensive investigation of the role of affective factors in facial expression recognition, we carried out a direct replication. In common with Palermo et al. (Palermo et al. 2018 J. Exp. Psychol. Hum. Percept. Perform. 44, 503-517), scores on the DASS anxiety subscale negatively predicted performance on the emotion recognition tasks across multiple analyses, although these correlations were only consistently significant for performance on the emotion-labelling task. However, and by contrast with Palermo et al. (Palermo et al. 2018 J. Exp. Psychol. Hum. Percept. Perform. 44, 503-517), other affective factors (e.g. those related to empathy) often also significantly predicted emotion-recognition performance. Collectively, these results support the proposal that affective factors predict individual differences in emotion recognition, but that these correlations are not necessarily specific to measures of general anxiety, such as the DASS anxiety subscale.
| S-EPMC7540805 | biostudies-literature
Project description:This study investigated which features of AVATAR laughter are perceived threatening for individuals with a fear of being laughed at (gelotophobia), and individuals with no gelotophobia. Laughter samples were systematically varied (e.g., intensity, laughter pitch, and energy for the voice, intensity of facial actions of the face) in three modalities: animated facial expressions, synthesized auditory laughter vocalizations, and motion capture generated puppets displaying laughter body movements. In the online study 123 adults completed, the GELOPH <15 > (Ruch and Proyer, 2008a,b) and rated randomly presented videos of the three modalities for how malicious, how friendly, how real the laughter was (0 not at all to 8 extremely). Additionally, an open question asked which markers led to the perception of friendliness/maliciousness. The current study identified features in all modalities of laughter stimuli that were perceived as malicious in general, and some that were gelotophobia specific. For facial expressions of AVATARS, medium intensity laughs triggered highest maliciousness in the gelotophobes. In the auditory stimuli, the fundamental frequency modulations and the variation in intensity were indicative of maliciousness. In the body, backwards and forward movements and rocking vs. jerking movements distinguished the most malicious from the least malicious laugh. From the open answers, the shape and appearance of the lips curling induced feelings that the expression was malicious for non-gelotophobes and that the movement round the eyes, elicited the face to appear as friendly. This was opposite for gelotophobes. Gelotophobia savvy AVATARS should be of high intensity, containing lip and eye movements and be fast, non-repetitive voiced vocalization, variable and of short duration. It should not contain any features that indicate a down-regulation in the voice or body, or indicate voluntary/cognitive modulation.
| S-EPMC4235412 | biostudies-literature
Project description:If robots are to successfully interact with humans, they need to measure, quantify and respond to the emotions we produce. Similar to humans, the perceptual cue inputs to any modelling that allows this will be based on behavioural expression and body activity features that are prototypical of each emotion. However, the likely employment of such robots in different cultures necessitates the tuning of the emotion feature recognition system to the specific feature profiles present in these cultures. The amount of tuning depends on the relative convergence of the cross-cultural mappings between the emotion feature profiles of the cultures where the robots will be used. The GRID instrument and the cognitive corpus linguistics methodology were used in a contrastive study analysing a selection of behavioural expression and body activity features to compare the feature profiles of joy, sadness, fear and anger within and between Polish and British English. The intra-linguistic differences that were found in the profile of emotion features suggest that weightings based on this profile can be used in robotic modelling to create emotion-sensitive socially interacting robots. Our cross-cultural results further indicate that this profile of features needs to be tuned in robots to make them emotionally competent in different cultures.
| S-EPMC4255092 | biostudies-other
Project description:Recent studies have indicated that facial electromyogram (fEMG)-based facial-expression recognition (FER) systems are promising alternatives to the conventional camera-based FER systems for virtual reality (VR) environments because they are economical, do not depend on the ambient lighting, and can be readily incorporated into existing VR headsets. In our previous study, we applied a Riemannian manifold-based feature extraction approach to fEMG signals recorded around the eyes and demonstrated that 11 facial expressions could be classified with a high accuracy of 85.01%, with only a single training session. However, the performance of the conventional fEMG-based FER system was not high enough to be applied in practical scenarios. In this study, we developed a new method for improving the FER performance by employing linear discriminant analysis (LDA) adaptation with labeled datasets of other users. Our results indicated that the mean classification accuracy could be increased to 89.40% by using the LDA adaptation method (p < .001, Wilcoxon signed-rank test). Additionally, we demonstrated the potential of a user-independent FER system that could classify 11 facial expressions with a classification accuracy of 82.02% without any training sessions. To the best of our knowledge, this was the first study in which the LDA adaptation approach was employed in a cross-subject manner. It is expected that the proposed LDA adaptation approach would be used as an important method to increase the usability of fEMG-based FER systems for social VR applications.
| S-EPMC8414465 | biostudies-literature
Project description:Person identification at airports requires the comparison of a passport photograph with its bearer. In psychology, this process is typically studied with static pairs of face photographs that require identity-match (same person shown) versus mismatch (two different people) decisions, but this approach provides a limited proxy for studying how environment and social interaction factors affect this task. In this study, we explore the feasibility of virtual reality (VR) as a solution to this problem, by examining the identity matching of avatars in a VR airport. We show that facial photographs of real people can be rendered into VR avatars in a manner that preserves image and identity information (Experiments 1 to 3). We then show that identity matching of avatar pairs reflects similar cognitive processes to the matching of face photographs (Experiments 4 and 5). This pattern holds when avatar matching is assessed in a VR airport (Experiments 6 and 7). These findings demonstrate the feasibility of VR as a new method for investigating face matching in complex environments.
| S-EPMC6628534 | biostudies-literature
Project description:Facial emotion perception impairment in schizophrenia is currently viewed as abnormal affective processing. Facial emotion perception also relies on visual processing. Yet, visual cortical processing of facial emotion is not well understood in this disorder. We measured perceptual thresholds for detecting facial fear and happiness in patients (n=23) and controls (n=23), and adjusted emotion intensity of facial stimuli (via morphing between images of neutral and emotive expressions) for each subject. We then evaluated activations of the visual cortex and amygdala during the performance of perceptually-equated facial emotion detection tasks. Patients had significantly lower fear- and happiness-induced activations in the visual cortex and amygdala. Activations between the visual cortex and amygdala were largely correlated, but the correlations in patients occurred abnormally early in response time course during fear perception. In schizophrenia, visual processing of facial emotion is deficient and visual and affective processing of negative facial emotion may be prematurely associated.
| S-EPMC5098551 | biostudies-literature
Project description:The changes of mRNA expression levels were analyzed in peripheral leukocytes after laughing with or without "Effective laugh maker" training. Keywords: stress response
2013-08-02 | GSE16641 | GEO
Project description:In human interactions, the facial expression of a bargaining partner may contain relevant information that affects prosocial decisions. We were interested in whether facial expressions of the recipient in the dictator game influence dictators' behavior. To test this, we conducted an online study (n = 106) based on a modified version of a dictator game. The dictators allocated money between themselves and another person (recipient), who had no possibility to respond to the dictator. Importantly, before the allocation decision, the dictator was presented with the facial expression of the recipient (angry, disgusted, sad, smiling, or neutral). The results showed that dictators sent more money to recipients with sad or smiling facial expressions and less to recipients with angry or disgusted facial expressions compared with a neutral facial expression. Moreover, based on the sequential analysis of the decision and the interaction partner in the preceding trial, we found that decision-making depends upon previous interactions.
| S-EPMC8201160 | biostudies-literature