Dataset Information

Evaluating participant responses to a virtual reality experience using reinforcement learning.

ABSTRACT: Virtual reality applications depend on multiple factors, for example, quality of rendering, responsiveness, and interfaces. In order to evaluate the relative contributions of different factors to quality of experience, post-exposure questionnaires are typically used. Questionnaires are problematic as the questions can frame how participants think about their experience and cannot easily take account of non-additivity among the various factors. Traditional experimental design can incorporate non-additivity but with a large factorial design table beyond two factors. Here, we extend a previous method by introducing a reinforcement learning (RL) agent that proposes possible changes to factor levels during the exposure and requires the participant to either accept these or not. Eventually, the RL converges on a policy where no further proposed changes are accepted. An experiment was carried out with 20 participants where four binary factors were considered. A consistent configuration of factors emerged where participants preferred to use a teleportation technique for navigation (compared to walking-in-place), a full-body representation (rather than hands only), the responsiveness of virtual human characters (compared to being ignored) and realistic compared to cartoon rendering. We propose this new method to evaluate participant choices and discuss various extensions.

SUBMITTER: Llobera J

PROVIDER: S-EPMC8441123 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundAltering the normal association between touch and its visual correlate can result in the illusory perception of a fake limb as part of our own body. Thus, when touch is seen to be applied to a rubber hand while felt synchronously on the corresponding hidden real hand, an illusion of ownership of the rubber hand usually occurs. The illusion has also been demonstrated using visuomotor correlation between the movements of the hidden real hand and the seen fake hand. This type of paradigm has been used with respect to the whole body generating out-of-the-body and body substitution illusions. However, such studies have only ever manipulated a single factor and although they used a form of virtual reality have not exploited the power of immersive virtual reality (IVR) to produce radical transformations in body ownership.Principal findingsHere we show that a first person perspective of a life-sized virtual human female body that appears to substitute the male subjects' own bodies was sufficient to generate a body transfer illusion. This was demonstrated subjectively by questionnaire and physiologically through heart-rate deceleration in response to a threat to the virtual body. This finding is in contrast to earlier experimental studies that assume visuotactile synchrony to be the critical contributory factor in ownership illusions. Our finding was possible because IVR allowed us to use a novel experimental design for this type of problem with three independent binary factors: (i) perspective position (first or third), (ii) synchronous or asynchronous mirror reflections and (iii) synchrony or asynchrony between felt and seen touch.ConclusionsThe results support the notion that bottom-up perceptual mechanisms can temporarily override top down knowledge resulting in a radical illusion of transfer of body ownership. The research also illustrates immersive virtual reality as a powerful tool in the study of body representation and experience, since it supports experimental manipulations that would otherwise be infeasible, with the technology being mature enough to represent human bodies and their motion.

Project description:BackgroundVirtual reality (VR) has been used successfully and effectively in psychotherapy for a variety of disorders. In the field of depression, there are only a few VR interventions and approaches. Although simple social interactions have been successfully modeled in VR for several mental disorders, there has been no transfer to the field of depression therapy. VR may be employed for psychodynamic psychotherapy to work on interpersonal conflict patterns. In this study, we developed and evaluated a VR intervention for the simulation of roleplay situations in the context of supportive-expressive therapy.MethodsWe conducted a clinical user experience (UX) study at a psychotherapeutic clinic in Düsseldorf, Germany. Eight inpatients with depression and four therapists were included. Semi-structured interviews and qualitative content analysis were used to identify UX issues of the developed VR intervention. Usability questionnaires and technical usage data were also considered. The VR intervention consisted of two therapist-controlled roleplay scenarios designed to support work on the core conflictual relationship theme by allowing patients to interact in typical problematic social situations. Recorded VR roleplays allow for therapeutic debriefing with a change of perspective. Therapists were given the option of using the roleplay in multiple sessions.ResultsAll therapists conducted one session per patient with the VR intervention. From the patient interviews, 26 UX issues were extracted, of which one technical malfunction and two unclarities in the interaction with the VR agent were rated as major problems. From the therapist interviews, 14 UX issues were extracted, of which five were rated as major problems related to the interface in the dialog control or the complex system setup.ConclusionThe main problem was designing a dialog structure that allows both complex conversational flows and a clear control interface. In principle, VR roleplays could be integrated well and safely into therapy. The VR intervention shows promise for providing an emotional experience of interpersonal conflict patterns in the context of psychotherapy. Additionally, other roleplay situations involving various social problem areas must be created and evaluated in terms of the fit to the patients' core conflictual relationship themes.

Dataset Information

Evaluating participant responses to a virtual reality experience using reinforcement learning.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets