Dataset Information

Application of Eye Tracking in Puzzle Games for Adjunct Cognitive Markers: Pilot Observational Study in Older Adults.

ABSTRACT:

Background

Recent studies suggest that computerized puzzle games are enjoyable, easy to play, and engage attentional, visuospatial, and executive functions. They may help mediate impairments seen in cognitive decline in addition to being an assessment tool. Eye tracking provides a quantitative and qualitative analysis of gaze, which is highly useful in understanding visual search behavior.

Objective

The goal of the research was to test the feasibility of eye tracking during a puzzle game and develop adjunct markers for cognitive performance using eye-tracking metrics.

Methods

A desktop version of the Match-3 puzzle game with 15 difficulty levels was developed using Unity 3D (Unity Technologies). The goal of the Match-3 puzzle was to find configurations (target patterns) that could be turned into a row of 3 identical game objects (tiles) by swapping 2 adjacent tiles. Difficulty levels were created by manipulating the puzzle board size (all combinations of width and height from 4 to 8) and the number of unique tiles on the puzzle board (from 4 to 8). Each level consisted of 4 boards (ie, target patterns to match) with one target pattern each. In this study, the desktop version was presented on a laptop computer setup with eye tracking. Healthy older subjects were recruited to play a full set of 15 puzzle levels. A paper-pencil-based assessment battery was administered prior to the Match-3 game. The gaze behavior of all participants was recorded during the game. Correlation analyses were performed on eye-tracking data correcting for age to examine if gaze behavior pertains to target patterns and distractor patterns and changes with puzzle board size (set size). Additionally, correlations between cognitive performance and eye movement metrics were calculated.

Results

A total of 13 healthy older subjects (mean age 70.67 [SD 4.75] years; range 63 to 80 years) participated in this study. In total, 3 training and 12 test levels were played by the participants. Eye tracking recorded 672 fixations in total, 525 fixations on distractor patterns and 99 fixations on target patterns. Significant correlations were found between executive functions (Trail Making Test B) and number of fixations on distractor patterns (P=.01) and average fixations (P=.005).

Conclusions

Overall, this study shows that eye tracking in puzzle games can act as a supplemental source of data for cognitive performance. The relationship between a paper-pencil test for executive functions and fixations confirms that both are related to the same cognitive processes. Therefore, eye movement metrics might be used as an adjunct marker for cognitive abilities like executive functions. However, further research is needed to evaluate the potential of the various eye movement metrics in combination with puzzle games as visual search and attentional marker.

SUBMITTER: Krebs C

PROVIDER: S-EPMC8078028 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe society is aging in China, and the cognitive level of elderly post-stroke patients gradually declines. Face-to-face cognitive functional training is no longer sufficient. Immersive virtual reality (IVR) is a promising rehabilitation training device. In this study, we developed an IVR-based puzzle game to explore its effectiveness, feasibility, and safety in elderly stroke patients with cognitive dysfunction.MethodsA total of 30 patients with mild post-stroke cognitive impairment after stroke were randomly assigned to a control or IVR group. Patients in both groups received routine rehabilitation therapy. Patients in the control group received traditional cognitive training, and those in the IVR group received IVR-based puzzle game therapy. Before and after treatment, Montreal cognitive assessment (MOCA), trail-making test-A (TMT-A), digit symbol substitution test (DSST), digital span test (DST), verbal fluency test (VFT), and modified Barthel index (MBI) were evaluated in both groups. In addition, the IVR group was administered a self-report questionnaire to obtain feedback on user experience.ResultsThere was no significant difference in the baseline data between the two groups. After six weeks of treatment, the cognitive assessment scores were improved in both groups. Moreover, the IVR group showed more improvements than the control group in the DSST (Z = 2.203, p = 0.028 < 0.05, η2 = 0.16); MOCA (T = 1.186, p = 0.246 > 0.05, d = 0.44), TMT-A (T = 1.791, p = 0.084 > 0.05, d = 0.65), MBI (T = 0.783, p = 0.44 > 0.05, d = 0.28), FDST (Z = 0.78, p = 0.435 > 0.05, η2 = 0.02), BDST (Z = 0.347, p = 0.728 > 0.05, η2 = 0.004), and VFT(Z = 1.087, p = 0.277 > 0.05, η2 = 0.039) did not significantly improve. The significant difference in DSST represents an improvement in executive function and visual-spatial cognitive characteristics. The other assessment scores did not show such features. Therefore, we did not observe significant differences through this measure. According to the results of the self-report questionnaire, most of the patients were satisfied with the equipment stability and training content. Several individuals reported mild adverse reactions.ConclusionsThis pilot study suggests that IVR-based puzzle games are a promising approach to improve post-stroke cognitive function, especially executive cognitive function, and visual-spatial attention in older adults.

Project description:BackgroundAvoidance to look others in the eye is a characteristic symptom of Autism Spectrum Disorders (ASD), and it has been hypothesised that quantitative monitoring of gaze patterns could be useful to objectively evaluate treatments. However, tools to measure gaze behaviour on a regular basis at a manageable cost are missing. In this paper, we investigated whether a smartphone-based tool could address this problem. Specifically, we assessed the accuracy with which the phone-based, state-of-the-art eye-tracking algorithm iTracker can distinguish between gaze towards the eyes and the mouth of a face displayed on the smartphone screen. This might allow mobile, longitudinal monitoring of gaze aversion behaviour in ASD patients in the future.ResultsWe simulated a smartphone application in which subjects were shown an image on the screen and their gaze was analysed using iTracker. We evaluated the accuracy of our set-up across three tasks in a cohort of 17 healthy volunteers. In the first two tasks, subjects were shown different-sized images of a face and asked to alternate their gaze focus between the eyes and the mouth. In the last task, participants were asked to trace out a circle on the screen with their eyes. We confirm that iTracker can recapitulate the true gaze patterns, and capture relative position of gaze correctly, even on a different phone system to what it was trained on. Subject-specific bias can be corrected using an error model informed from the calibration data. We compare two calibration methods and observe that a linear model performs better than a previously proposed support vector regression-based method.ConclusionsUnder controlled conditions it is possible to reliably distinguish between gaze towards the eyes and the mouth with a smartphone-based set-up. However, future research will be required to improve the robustness of the system to roll angle of the phone and distance between the user and the screen to allow deployment in a home setting. We conclude that a smartphone-based gaze-monitoring tool provides promising opportunities for more quantitative monitoring of ASD.