Dataset Information

Identifying Features of Bodily Expression As Indicators of Emotional Experience during Multimedia Learning.

ABSTRACT: The importance of emotions experienced by learners during their interaction with multimedia learning systems, such as serious games, underscores the need to identify sources of information that allow the recognition of learners' emotional experience without interrupting the learning process. Bodily expression is gaining in attention as one of these sources of information. However, to date, the question of how bodily expression can convey different emotions has largely been addressed in research relying on acted emotion displays. Following a more contextualized approach, the present study aims to identify features of bodily expression (i.e., posture and activity of the upper body and the head) that relate to genuine emotional experience during interaction with a serious game. In a multimethod approach, 70 undergraduates played a serious game relating to financial education while their bodily expression was captured using an off-the-shelf depth-image sensor (Microsoft Kinect). In addition, self-reports of experienced enjoyment, boredom, and frustration were collected repeatedly during gameplay, to address the dynamic changes in emotions occurring in educational tasks. Results showed that, firstly, the intensities of all emotions indeed changed significantly over the course of the game. Secondly, by using generalized estimating equations, distinct features of bodily expression could be identified as significant indicators for each emotion under investigation. A participant keeping their head more turned to the right was positively related to frustration being experienced, whereas keeping their head more turned to the left was positively related to enjoyment. Furthermore, having their upper body positioned more closely to the gaming screen was also positively related to frustration. Finally, increased activity of a participant's head emerged as a significant indicator of boredom being experienced. These results confirm the value of bodily expression as an indicator of emotional experience in multimedia learning systems. Furthermore, the findings may guide developers of emotion recognition procedures by focusing on the identified features of bodily expression.

SUBMITTER: Riemer V

PROVIDER: S-EPMC5529426 | biostudies-other | 2017

REPOSITORIES: biostudies-other

ACCESS DATA

Similar Datasets

Project description:In a society where mobility, globalization and contact with people from other cultures have become its distinctive traits, the enhancement of plurilingualism and intercultural understanding should be of the utmost concern. From a positive psychology perspective, agency is the human capacity to affect other people positively or negatively through one's actions. This agentic vision can be related to mediation, a concept rooted in socio-cultural learning theory, where social interaction is considered a fundamental cornerstone in the development of cognition. These social interactions in the language learning setting may be facilitated through musical activities due to their social bonding effect. This paper tries to offer insights into how a music-mediated experience in language learning may develop students' interpersonal and collaborative competences to become active members of a more inclusive society. Mediation, considered to be a paradigm shift in the foreign language classroom and for different out-of-class language learning possibilities, could also provide an environment where learners maximize their emotional intelligence. Our paper focuses on this paradigm shift spearheaded by the Common European Framework for Languages Companion Volume (CEFR/CV) and the considerable repercussions it is bound to have for foreign language didactics, as cooperative tasks become central to foreign language learning. We hypothesize that mediated language learning experiences (MeLLEs) imply a socio-emotional change in learners, focusing on the others, on their needs and interests, by trying to help them understand texts, concepts or facilitating communication with their peers. An intervention with a music-MeLLE was designed and implemented in an L2 classroom of adult learners with divergent backgrounds. A self-assessment scale with mediation descriptors and the socio-emotional expertise scale (SEE) were administered. Results show that students become more mindful of their strengths, and of their capacity for collaboration and teamwork. This leads to more awareness of their mediation skills. Students' mediation skills correlate significantly with their socio-emotional skills - specifically with their expressivity. The implementation of a music-mediated experience also promoted tolerance and enhanced learners' intrinsic motivations for language learning at the same time as acknowledging their diversity.

Project description:According to embodiment theories, language and emotion affect each other. In line with this, several previous studies investigated changes in bodily responses including facial expressions, heart rate or skin conductance during affective evaluation of emotional words and sentences. This study investigates the embodiment of emotional word processing from a social perspective by experimentally manipulating the emotional valence of a word and its personal reference. Stimuli consisted of pronoun-noun pairs, i.e., positive, negative, and neutral nouns paired with possessive pronouns of the first or the third person ("my," "his") or the non-referential negation term ("no") as controls. Participants had to quickly evaluate the word pairs by key presses as either positive, negative, or neutral, depending on the subjective feelings they elicit. Hereafter, they elaborated the intensity of the feeling on a non-verbal scale from 1 (very unpleasant) to 9 (very pleasant). Facial expressions (M. Zygomaticus, M. Corrugator), heart rate, and, for exploratory purposes, skin conductance were recorded continuously during the spontaneous and elaborate evaluation tasks. Positive pronoun-noun phrases were responded to the quickest and judged more often as positive when they were self-related, i.e., related to the reader's self (e.g., "my happiness," "my joy") than when related to the self of a virtual other (e.g., "his happiness," "his joy"), suggesting a self-positivity bias in the emotional evaluation of word stimuli. Physiologically, evaluation of emotional, unlike neutral pronoun-noun pairs initially elicited an increase in mean heart rate irrespective of stimulus reference. Changes in facial muscle activity, M. Zygomaticus in particular, were most pronounced during spontaneous evaluation of positive other-related pronoun-noun phrases in line with theoretical assumptions that facial expressions are socially embedded even in situation where no real communication partner is present. Taken together, the present results confirm and extend the embodiment hypothesis of language by showing that bodily signals can be differently pronounced during emotional evaluation of self- and other-related emotional words.

Dataset Information

Identifying Features of Bodily Expression As Indicators of Emotional Experience during Multimedia Learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets