Decoding subjective emotional arousal from EEG during an immersive virtual reality experience.
Ontology highlight
ABSTRACT:
SUBMITTER: Hofmann SM
PROVIDER: S-EPMC8673835 | biostudies-literature |
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:Many affective computing studies have developed automatic emotion recognition models, mostly using emotional images, audio and videos. In recent years, virtual reality (VR) has been also used as a method to elicit emotions in laboratory environments. However, there is still a need to analyse the validity of VR in order to extrapolate the results it produces and to assess the similarities and differences in physiological responses provoked by real and virtual environments. We investigated the cardiovascular oscillations of 60 participants during a free exploration of a real museum and its virtualisation viewed through a head-mounted display. The differences between the heart rate variability features in the high and low arousal stimuli conditions were analysed through statistical hypothesis testing; and automatic arousal recognition models were developed across the real and the virtual conditions using a support vector machine algorithm with recursive feature selection. The subjects' self-assessments suggested that both museums elicited low and high arousal levels. In addition, the real museum showed differences in terms of cardiovascular responses, differences in vagal activity, while arousal recognition reached 72.92% accuracy. However, we did not find the same arousal-based autonomic nervous system change pattern during the virtual museum exploration. The results showed that, while the direct virtualisation of a real environment might be self-reported as evoking psychological arousal, it does not necessarily evoke the same cardiovascular changes as a real arousing elicitation. These contribute to the understanding of the use of VR in emotion recognition research; future research is needed to study arousal and emotion elicitation in immersive VR.
| S-EPMC8248697 | biostudies-literature
Project description:Previous studies have suggested that virtual reality (VR) can elicit emotions in different visual modes using 2D or 3D headsets. However, the effects on emotional arousal by using these two visual modes have not been comprehensively investigated, and the underlying neural mechanisms are not yet clear. This paper presents a cognitive psychological experiment that was conducted to analyze how these two visual modes impact emotional arousal. Forty volunteers were recruited and were randomly assigned to two groups. They were asked to watch a series of positive, neutral and negative short VR videos in 2D and 3D. Multichannel electroencephalograms (EEG) and skin conductance responses (SCR) were recorded simultaneously during their participation. The results indicated that emotional stimulation was more intense in the 3D environment due to the improved perception of the environment; greater emotional arousal was generated; and higher beta (21-30 Hz) EEG power was identified in 3D than in 2D. We also found that both hemispheres were involved in stereo vision processing and that brain lateralization existed in the processing.
| S-EPMC8428725 | biostudies-literature
Project description:Synaesthesia is a condition where people experience unusual sensory or cognitive sensations in response to apparently unrelated stimuli. This paper presents two experiments which aimed to examine whether Virtual Reality (VR) technology can be used to recreate the synaesthetic experience. There is a lack of research in this area, with most studies focussing primarily on synaesthetic colors. Experiment 1 aimed to build on previous research by using not only a traditional color-picker but also VR to capture a more nuanced picture of synaesthetic perception. A multiple case study design was used to examine the experiences of six participants in detail. Data gathering took place via Zoom. During the initial data-gathering session, participants used a color-picker to provide grapheme-color associations. After this session, some of the participants' synaesthetic experiences were recreated using a VR-by-proxy approach. Results indicated that VR is capable of capturing elements of synaesthetic perception that other methods have been unable to, such as texture, small degrees of movement, and 3D structure. Experiment 2 expanded upon these findings by moving beyond the VR-by-proxy approach and asking three participants to recreate their own audiovisual synaesthetic associations in the VR environment. Inductive Thematic Analysis was used to analyze the results of this experiment. The potential of expanding this technique to other forms of perceptual diversity is discussed.
| S-EPMC10478570 | biostudies-literature
Project description:Children must often endure painful procedures as part of their treatment for various medical conditions. Those with chronic pain endure frequent or constant discomfort in their daily lives, sometimes severely limiting their physical capacities. With the advent of affordable consumer-grade equipment, clinicians have access to a promising and engaging intervention for pediatric pain, both acute and chronic. In addition to providing relief from acute and procedural pain, virtual reality (VR) may also help to provide a corrective psychological and physiological environment to facilitate rehabilitation for pediatric patients suffering from chronic pain. The special qualities of VR such as presence, interactivity, customization, social interaction, and embodiment allow it to be accepted by children and adolescents and incorporated successfully into their existing medical therapies. However, the powerful and transformative nature of many VR experiences may also pose some risks and should be utilized with caution. In this paper, we review recent literature in pediatric virtual reality for procedural pain and anxiety, acute and chronic pain, and some rehabilitation applications. We also discuss the practical considerations of using VR in pediatric care, and offer specific suggestions and information for clinicians wishing to adopt these engaging therapies into their daily clinical practice.
| S-EPMC5532544 | biostudies-other
Project description:We conducted an experiment to examine how virtual reality (VR) and active navigation interact to improve audience experience in virtual concerts. To manipulate the medium, the participants were presented with concert-related audiovisual stimuli via a head-mounted VR device or a computer. To manipulate the participants' access to different perspectives (navigation mode), they were allowed to actively switch, or were passively guided, between the audience's perspective and the performer's perspective. According to the results, VR and active navigation induced a higher sense of presence (feeling of being somewhere else) than did computer and passive navigation, and thus, they increased the audience's state of flow and gave them higher degrees of satisfaction and concert-attending intention. VR and active navigation also increased the participants' role identification (feeling of being someone else), which again gave them higher degrees of satisfaction and concert-attending intention. This research contributes to the literature supporting VR's enhancement of concert experiences and further highlights the important relationship between action, perception, and experience satisfaction.
| S-EPMC10211280 | biostudies-literature
Project description:Research on morality has focused on differences in moral judgment and action. In this study, we investigated self-reported moral reasoning after a hypothetical moral dilemma was presented on paper, and moral reasoning after that very same dilemma was experienced in immersive virtual reality (IVR). We asked open-ended questions and used content analysis to determine moral reasoning in a sample of 107 participants. We found that participants referred significantly more often to abstract principles and consequences for themselves (i.e., it is against the law) after the paper-based moral dilemma compared to the IVR dilemma. In IVR participants significantly more often referred to the consequences for the people involved in the dilemma (i.e., not wanting to hurt that particular person). This supports the separate process theory, suggesting that decision and action might be different moral concepts with different foci regarding moral reasoning. Using simulated moral scenarios thus seems essential as it illustrates possible mechanisms of empathy and altruism being more relevant for moral actions especially given the physical presence of virtual humans in IVR.
| S-EPMC8345728 | biostudies-literature
Project description:BackgroundImmersive Virtual Reality (iVR) storytelling is a concept that merges ground-breaking virtual reality technology with the traditional art of storytelling. Virtual reality storytelling offers a rare opportunity to present abstract experiences that challenge boundaries, heighten emotions, and convey previously intangible concepts. Scientific research into immersive virtual reality storytelling is still in its infancy, particularly regarding the field of education in Nursing and Midwifery. Therefore, this study set out to investigate the subjective experience of using an immersive virtual reality storytelling experience as an active pedagogy.MethodsThis was an evaluative study incorporating a multimodal approach encompassing a cross-sectional survey and observational study conducted in a large University in Ireland, offering major undergraduate and graduate degree programmes in the fields of Nursing and Midwifery. Students were invited to view the innovative virtual reality storytelling experience "Wonderful You" (BHD Immersive) that tells the story of the first 9 months of a baby's life inside the woman's womb. On completion, students were asked to complete an anonymous survey about their experience. Observational studies were also carried out, examining the student's engagement and interaction with the iVR experience. A combination of statistical and thematic qualitative analysis was employed to interpret the respective summative rating scale and open-ended response questions in the evaluation survey. Data captured from the observations were grouped into categories and analysed capturing key themes.ResultsA response rate of 71.2% (n = 94) identified iVR storytelling as a memorable learning experience that triggered students' engagement and motivation to learn. IVR storytelling enabled students to visualise and better understand abstract concepts. Qualitative analysis of narrative responses revealed the positive evaluations of the iVR storytelling experience. Observational studies further revealed students were highly engaged and interacted positively with the iVR storytelling experience.ConclusionsThe full potential of this new medium of iVR storytelling has yet to be seen. However, this study provides an encouraging insight into the positive attributes of iVR storytelling that engages students and creates authentic active learning experiences.
| S-EPMC7433077 | biostudies-literature
Project description:The use of digital devices provides a wide range of possibilities for measuring and improving visual function, including concepts such as perceptual learning and dichoptic therapy. Different technologies can be used to apply these concepts, including, in recent years, the introduction of virtual reality (VR) systems. A preliminary experience in treating anisometropic amblyopia through an immersive VR device and using prototype software is described. A total of 4 children were treated by performing 18 office-based sessions. Results showed that distance VA in amblyopic eyes remained constant in two subjects, whereas the younger subjects improved after the training. Near VA improved in three subjects. All subjects showed an increase in the stereopsis of at least one step, with three subjects showing a final stereopsis of a 60 s arc. A total of three subjects showed an increase of approximately 0.5 CS units for the spatial frequency of 3 cpd after the training. Results from this pilot study suggest that visual training based on perceptual learning through an immersive VR environment could be a viable treatment for improving CS, VA, and stereopsis in some children with anisometropic amblyopia. Future studies should support these preliminary results.
| S-EPMC10204412 | biostudies-literature
Project description:Sensorimotor learning refers to improvements that occur through practice in the performance of sensory-guided motor behaviors. Leveraging novel technical capabilities of an immersive virtual environment, we probed the component kinematic processes that mediate sensorimotor learning. Twenty naïve subjects performed a simulated marksmanship task modeled after Olympic Trap Shooting standards. We measured movement kinematics and shooting performance as participants practiced 350 trials while receiving trial-by-trial feedback about shooting success. Spatiotemporal analysis of motion tracking elucidated the ballistic and refinement phases of hand movements. We found systematic changes in movement kinematics that accompanied improvements in shot accuracy during training, though reaction and response times did not change over blocks. In particular, we observed longer, slower, and more precise ballistic movements that replaced effort spent on corrections and refinement. Collectively, these results leverage developments in immersive virtual reality technology to quantify and compare the kinematics of movement during early learning of full-body sensorimotor orienting.
| S-EPMC5808129 | biostudies-literature
Project description:Post-stroke depression (PSD) is a serious complication of stroke that significantly restricts rehabilitation. The use of immersive virtual reality for stroke survivors is promising. Herein, we investigated the effects of a novel immersive virtual reality training system on PSD and explored induced effective connectivity alterations in emotional networks using multivariate Granger causality analysis (GCA). Forty-four patients with PSD were equally allocated into an immersive-virtual reality group and a control group. In addition to their usual rehabilitation treatments, the participants in the immersive-virtual reality group participated in an immersive-virtual reality rehabilitation program, while the patients in the control group received 2D virtual reality rehabilitation training. The Hamilton Depression Rating Scale, modified Barthel Index (MBI), and resting-state functional magnetic resonance imaging (rsfMRI) data were collected before and after a 4-week intervention. rsfMRI data were analyzed using multivariate GCA. We found that the immersive virtual reality training was more effective in improving depression in patients with PSD but had no statistically significant improvement in MBI scores compared to the control group. The GCA showed that the following causal connectivities were strengthened after immersive virtual reality training: from the amygdala, insula, middle temporal gyrus, and caudate nucleus to the dorsolateral prefrontal cortex; from the insula to the medial prefrontal cortex; and from the thalamus to the posterior superior temporal sulcus. These causal connectivities were weakened after treatment in the control group. Our results indicated the neurotherapeutic use of immersive virtual reality rehabilitation as an effective non-pharmacological intervention for PSD; the alteration of causal connectivity in emotional networks might constitute the neural mechanisms underlying immersive-virtual reality rehabilitation in PSD.
| S-EPMC9378829 | biostudies-literature