Dataset Information

A Brief Measure of Interpersonal Interaction for 2-Player Serious Games: Questionnaire Validation.

ABSTRACT:

Background

Competitive and cooperative serious games have become increasingly popular in areas such as rehabilitation and education and have several potential advantages over single-player games. However, they are not suitable for everyone, and the user experience in competitive and cooperative serious games depends on many factors. One important factor is the verbal interaction between players, but the effect of this factor has not been extensively studied because of the lack of a validated measurement tool.

Objective

This paper aimed to validate a brief questionnaire that measures the verbal interaction between 2 players of a serious game. The questionnaire consists of 8 questions pertaining to the amount of conversation, its valence (positive or negative emotion), and its game relatedness.

Methods

The questionnaire was validated with 30 pairs of participants who played a competitive serious game for 10 min while being recorded with cameras. The questionnaire was filled out by both participants, an in-person observer, and 2 members of our research group who watched the videos. Results from these raters were used to develop questionnaire instructions, and the finalized questionnaire was given to 2 additional raters who were trained on 5 videos and then rated the other 25 videos independently.

Results

The questionnaire's interrater reliability is excellent for the amount of conversation and its game relatedness (intraclass correlation coefficients [ICCs] above 0.9). Interrater reliability is fair to good for conversation valence (ICCs between 0.4 and 0.7). We believe that the lower interrater reliability for valence is primarily because of a limited spread of valence values in our sample. Furthermore, questionnaire ratings were significantly correlated with players' personality characteristics (eg, amount of conversation was correlated with extraversion) and pressure/tension experienced in the competitive game.

Conclusions

The validated questionnaire has the potential to be a useful tool for studying user experience in competitive and cooperative serious games. Furthermore, it could be adapted for other applications such as entertainment games. However, it has only been validated with unimpaired university students in a 2-player competitive serious game and should next be validated with different target populations (eg, stroke survivors) and different game designs (eg, cooperative games).

SUBMITTER: Gorsic M

PROVIDER: S-EPMC6683649 | biostudies-literature | 2019 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Brief Measure of Interpersonal Interaction for 2-Player Serious Games: Questionnaire Validation.

Gorsic Maja M Clapp Joshua D JD Darzi Ali A Novak Domen D

JMIR serious games 20190723 3

<h4>Background</h4>Competitive and cooperative serious games have become increasingly popular in areas such as rehabilitation and education and have several potential advantages over single-player games. However, they are not suitable for everyone, and the user experience in competitive and cooperative serious games depends on many factors. One important factor is the verbal interaction between players, but the effect of this factor has not been extensively studied because of the lack of a valid ...[more]

PMID: 31339107

Similar Datasets

Project description:Today globally, more people die from chronic diseases than from war and terrorism. This is not due to aging alone but also because we lead unhealthy lifestyles with little or no exercise and typically consume food with poor nutritional content. This paper proffers the design science research method to create an artefact that can help people study the diffusion of serious games. The ultimate goal of the study is to create a serious game that can help people to improve their balance in physical exercise, nutrition and well-being. To do this, first we conducted 97 interviews to study if wearables can be used for gathering health data. Analysis indicates that designers, manufacturers, and developers of wearables and associated software and apps should make their devices reliable, relevant, and user friendly. To increase the diffusion, adoption, and habitual usage of wearables key issues such as privacy and security need to be addressed as well. Then, we created a paper prototype and conducted a further 32 interviews to validate the first prototype of the game, especially with respect to the diffusion possibilities of the game. Results are positive from a formal technology acceptance point of view showing relevance and usefulness. But informally in the open questions some limitations also became visible. In particular, ease of use is extremely important for acceptance and calling it a game can in fact be an obstruction. Moreover, the artefact should not be patronizing and age differences can also pose problems, hence the title not to make the serious game too serious. Future research plans to address these problems in the next iteration while the future implementation plan seeks for big platforms or companies to diffuse the serious game. A key theoretical contribution of this research is the identification of habit as a potential dependent variable for the intention to use wearables and the development of a diffusion model for serious games. The hedonic perspective is added to the model as well as trust and perceived risks. This model ends the cycle of critical design with an improvement of theory as result contributing to the societal goal of decreasing Obesities and Diabetes.

Project description:BackgroundMultidisciplinary collaboration is essential to the successful development of serious games, albeit difficult to achieve. In a previous study, the co.LAB serious game design framework was created to support collaboration within serious game multidisciplinary design teams. Its use has not yet been validated in a real usage context.ObjectiveThe objective of this study was to perform a first assessment of the impact of the co.LAB framework on collaboration within multidisciplinary teams during serious game design and development.MethodsA mixed methods study was conducted, based on 2 serious game design projects in which the co.LAB framework was used. The first phase was qualitative and carried out using a general inductive approach. To this end, all members of the first serious game project team who used the co.LAB framework were invited to take part in a focus group session (n=6). In a second phase, results inferred from qualitative data were used to define a quantitative instrument (questionnaire) that was designed according to the Checklist for Reporting Results of Internet E-Surveys. Members of both project teams (n=11) were then asked to answer the questionnaire. Quantitative results were reported as median (Q1, Q3), and appropriate nonparametric tests were used to assess between-group differences. Finally, results gathered through the qualitative and quantitative phases were integrated.ResultsIn both phases, the participation rate was 100% (6/6 and 11/11). Verbatim transcripts were classified into 4 high level themes: (1) influence on collaborative dimensions; (2) impact on project course, monitoring, and efficiency; (3) qualitative perceptions of the framework; and (4) influence of team composition on the use of the framework. The web-based questionnaire was then developed according to the 7 dimensions of collaboration by Burkhardt et al. In both projects, the co.LAB framework had a positive impact on most dimensions of collaboration during the multidisciplinary design and development of serious games. When all collaborative dimensions were aggregated, the overall impact of the framework was rated on a scale from -42 to 42 (very negative to very positive). The overall median score was 23 (Q1, Q3: 20, 27), with no significant difference between groups (P=.58). Most respondents also believed that all serious game design teams should include a member possessing significant expertise in serious game design to guide the development process.ConclusionsThe co.LAB framework had a positive impact on collaboration within serious game design and development teams. However, expert guidance seems necessary to maximize development efficiency. Whether such guidance can be provided by means of a collaborative web platform remains to be determined.

Dataset Information

A Brief Measure of Interpersonal Interaction for 2-Player Serious Games: Questionnaire Validation.

Background

Objective

Methods

Results

Conclusions

Publications

A Brief Measure of Interpersonal Interaction for 2-Player Serious Games: Questionnaire Validation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets