Dataset Information

The Making and Evaluation of Digital Games Used for the Assessment of Attention: Systematic Review.

ABSTRACT:

Background

Serious games are now widely used in many contexts, including psychological research and clinical use. One area of growing interest is that of cognitive assessment, which seeks to measure different cognitive functions such as memory, attention, and perception. Measuring these functions at both the population and individual levels can inform research and indicate health issues. Attention is an important function to assess, as an accurate measure of attention can help diagnose many common disorders, such as attention-deficit/hyperactivity disorder and dementia. However, using games to assess attention poses unique problems, as games inherently manipulate attention through elements such as sound effects, graphics, and rewards, and research on adding game elements to assessments (ie, gamification) has shown mixed results. The process for developing cognitive tasks is robust, with high psychometric standards that must be met before these tasks are used for assessment. Although games offer more diverse approaches for assessment, there is no standard for how they should be developed or evaluated.

Objective

To better understand the field and provide guidance to interdisciplinary researchers, we aim to answer the question: How are digital games used for the cognitive assessment of attention made and measured?

Methods

We searched several databases for papers that described a digital game used to assess attention that could be deployed remotely without specialized hardware. We used Rayyan, a systematic review software, to screen the records before conducting a systematic review.

Results

The initial database search returned 49,365 papers. Our screening process resulted in a total of 74 papers that used a digital game to measure cognitive functions related to attention. Across the studies in our review, we found three approaches to making assessment games: gamifying cognitive tasks, creating custom games based on theories of cognition, and exploring potential assessment properties of commercial games. With regard to measuring the assessment properties of these games (eg, how accurately they assess attention), we found three approaches: comparison to a traditional cognitive task, comparison to a clinical diagnosis, and comparison to knowledge of cognition; however, most studies in our review did not evaluate the game's properties (eg, if participants enjoyed the game).

Conclusions

Our review provides an overview of how games used for the assessment of attention are developed and evaluated. We further identified three barriers to advancing the field: reliance on assumptions, lack of evaluation, and lack of integration and standardization. We then recommend the best practices to address these barriers. Our review can act as a resource to help guide the field toward more standardized approaches and rigorous evaluation required for the widespread adoption of assessment games.

SUBMITTER: Wiley K

PROVIDER: S-EPMC8386381 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:Attention is a basic and main mental task and can play an important role in the functioning of other brain abilities such as intelligence, memory, learning, and perception, and its deficit occurs in 80% of patients with traumatic brain injury. The use of game-based tools for rehabilitation is rapidly expanding. Cognitive rehabilitation via video games is an emerging hot topic in cognitive science. Serious games serve a specific purpose in addition to entertainment. They can be more engaging than exercises since they replace reward and motivation systems with real-world motivations as a complement for rehabilitation activities. This study was aimed at identifying and categorizing serious computer games used for attention rehabilitation and evaluating their effects. Six electronic databases (Scopus, PubMed, ISI, Embase, IEEE, and Cochrane) were searched in August 2021. The search strategy consisted of three main concepts of "serious game", "cognitive deficits", and "cognitive rehabilitation". The inclusion criteria were (1) journal articles, (2) English language, (3) being published in the last 10 years, (4) human participants, and (5) game-based intervention. In the 30 included studies, 22 unique games were utilized for attention rehabilitation. Lumosity (20%), Brain Age (Dr. Kawashima's Brain Training) (10%), and MoHRS (6.66%) were the most common games among the studies. There were (57%) casual, (23%) action, (10%) simulation, and (10%) multiple genres. Of the 47 tools used in the studies, 5 utilized cross-modal oddball attention tasks, 4 utilized game performance, 3 utilized the paced auditory serial additional test (PASAT), and the rest employed other tools. A total of 73 outcome measures were related to attention, 42 measures did not have significant results, 30 were significantly improved, 1 was significantly deteriorated, and 4 articles did not have any specific measures for attention evaluation. Thus, the results revealed the positive effect of serious games on attention. However, issues such as absence of scientific teams, the variety of the disorders that cause defects, the variety of criteria, differences in measurements, lack of long-term follow-up, insufficient RCT studies, and small sample sizes should be considered when designing, developing, and using game-based systems to prevent bias.

Project description:BackgroundMass media campaigns for public health are increasingly using digital media platforms, such as web-based advertising and social media; however, there is a lack of evidence on how to best use these digital platforms for public health campaigns. To generate this evidence, appropriate campaign evaluations are needed, but with the proliferation of digital media-related metrics, there is no clear consensus on which evaluation metrics should be used. Public health campaigns are diverse in nature, so to facilitate analysis, this review has selected tobacco control campaigns as the scope of the study.ObjectiveThis literature review aimed to examine how tobacco control campaigns that use traditional and digital media platforms have been evaluated.MethodsMedicine and science databases (Medical Literature Analysis and Retrieval System Online [MEDLINE], EMBASE, PsycINFO, Cumulative Index to Nursing and Allied Health Literature [CINAHL], and Scopus), and a marketing case study database (World Advertising Research Center) were searched for articles published between 2013 and 2018. Two authors established the eligibility criteria and reviewed articles for inclusion. Individual campaigns were identified from the articles, and information on campaigns and their evaluations were supplemented with searches on Google, Google Scholar, and social media platforms. Data about campaign evaluations were tabulated and mapped to a conceptual framework.ResultsIn total, 17 campaigns were included in this review, with evaluations reported on by 51 articles, 17 marketing reports, and 4 grey literature reports. Most campaigns were from English-speaking countries, with behavioral change as the primary objective. In the process evaluations, a wide range of metrics were used to assess the reach of digital campaign activities, making comparison between campaigns difficult. Every campaign in the review, except one, reported some type of engagement impact measure, with website visits being the most commonly reported metric (11 of the 17 campaigns). Other commonly reported evaluation measures identified in this review include engagement on social media, changes in attitudes, and number of people contacting smoking cessation services. Of note, only 7 of the 17 campaigns attempted to measure media platform attribution, for example, by asking participants where they recalled seeing the campaign or using unique website tracking codes for ads on different media platforms.ConclusionsOne of the key findings of this review is the numerous and diverse range of measures and metrics used in tobacco control campaign evaluations. To address this issue, we propose principles to guide the selection of digital media-related metrics for campaign evaluations, and also outline a conceptual framework to provide a coherent organization to the diverse range of metrics. Future research is needed to specifically investigate whether engagement metrics are associated with desired campaign outcomes, to determine whether reporting of engagement metrics is meaningful in campaign evaluations.

Project description:Background: Neuropsychological assessment is central to identifying and determining the extent of Alcohol-Related Cognitive Impairment (ARCI). The present systematic review aimed to synthesize and discuss the evidence appraising the neuropsychological tests used to assess ARCI in order to support clinicians and researchers in selecting appropriate tests for use with this population. Methods: We searched for studies investigating the psychometric, diagnostic and practical values of tools used in the screening, diagnosis, and assessment of Korsakoff's Syndrome (KS), Alcohol-Related Dementia (ARD), and those with a specific diagnosis of Alcohol-Related Brain Damage (ARBD). The following databases were searched in March 2016 and again in August 2018: MEDLINE, EMBASE, Psych-INFO, ProQuest Psychology, and Science Direct. Study quality was assessed using a checklist designed by the authors to evaluate the specific factors contributing to robust and clearly reported studies in this area. A total of 43 studies were included following the screening of 3646 studies by title and abstract and 360 at full-text. Meta-analysis was not appropriate due to heterogeneity in the tests and ARCI samples investigated in the studies reviewed. Instead, review findings were narratively synthesized and divided according to five domains of assessment: cognitive screening, memory, executive function, intelligence and test batteries, and premorbid ability. Effect sizes (d) were calculated to supplement findings. Results: Overall, several measures demonstrated sensitivity to the cognitive deficits associated with chronic alcoholism and an ability to differentiate between gradations of impairment. However, findings relating to the other psychometric qualities of the tests, including those important for the accurate assessment and monitoring of ARCI (e.g., test-retest reliability), were entirely absent or limited. Additionally, the synthesis of neuropsychological outcomes presented here supports the recent impetus for a move away from discrete diagnoses (e.g., KS, ARD) and the distinctions between them toward more broad and inclusive diagnostic conceptualizations of ARCI, thereby recognizing the heterogeneity in presentation. Conclusions: Based on the evidence reviewed, provisional recommendations for appropriate tests in each domain of assessment are presented, though further validation of most tests is warranted. Review findings can support efficient and evidenced-based test-selection and guide future research in this area.

Project description:BackgroundAttention-deficit/hyperactivity disorder (ADHD) has a considerable impact on an individual's daily life. Some difficulties with timing deficits may be associated with deficiencies in attention, reading, language skills, or executive function. Music therapy, either active (playing an instrument) or passive (listening to music) has demonstrated its efficacy in reducing symptomatology in many disorders. Video games may prove to be a useful assessment and treatment tool in compensating for the difficulties with multimodal treatment in ADHD.ObjectiveThe aim of the study is to (1) analyze the evidence that music is beneficial in reducing the symptomatology of ADHD using systematic review and (2) propose the application of music in video games following music therapy strategies.MethodsSearches were conducted in PubMed, Embase, PsycINFO, Cochrane, and gray literature (Google Scholar and WorldCat). We used the following search syntax: ((music[Title/Abstract]) or (music therapy[Title/Abstract])) and (attention deficit disorder[MeSH or thesaurus term]).ResultsOf the 70 records identified, 17 provided findings that music can be beneficial in various domains of ADHD. Active music therapy improves hemispheric synchrony, social skills, aggressivity, and impulsivity. Passive music therapy improves academic skills like arithmetic, drawing, and reading comprehension, as well as attention and disruptive behaviors. The effects depend on the music genre, tempo, or task difficulty. Music in video games was generally found to be beneficial for people with ADHD. Music improves immersion and flow while playing video games. Using rhythm may also improve timing skills and immersion in patients with ADHD. Regarding the proposed application of aspects of music to therapeutic video games for ADHD, some paradigms in timing and music therapy were considered in the proposed design of video games.ConclusionsImproving ADHD treatment through the application of music in video games is proposed.Trial registrationPROSPERO CRD42021288226; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=288226.

Project description:Background: Shared decision-making (SDM) in mental healthcare has received increased attention as a process to reinforce person-centered care. With the rapid development of digital health technology, researchers investigate how digital interventions may be utilized to support SDM. Despite the promise of digital interventions to support SDM, the effect of these in mental healthcare has not been evaluated before. Thus, this paper aims to assess the effect of SDM interventions complimented by digital technology in mental healthcare. Objective: The objective of this review was to systematically examine the effectiveness of digital SDM interventions on patient outcomes as investigated in randomized trials. Methods: We performed a systematic review and meta-analysis of randomized controlled trials on digital SDM interventions for people with a mental health condition. We searched for relevant studies in MEDLINE, PsycINFO, EMBASE, CINAHL, and the Cochrane Central Register of Controlled Trials. The search strategy included terms relating to SDM, digital systems, mental health conditions, and study type. The primary outcome was patient activation or indices of the same (e.g., empowerment and self-efficacy), adherence to treatment, hospital admissions, severity of symptoms, and level of functioning. Secondary outcomes were satisfaction, decisional conflict, working alliance, usage, and adherence of medicine; and adverse events were defined as harms or side effects. Results: Sixteen studies met the inclusion criteria with outcome data from 2,400 participants. Digital SDM interventions had a moderate positive effect as compared with a control condition on patient activation [standardized mean difference (SMD) = 0.56, CI: 0.10, 1.01, p = 0.02], a small effect on general symptoms (SMD = -0.17, CI: -0.31, -0.03, p = 0.02), and working alliance (SMD = 0.21, CI: 0.02, 0.41, p = 0.03) and for improving decisional conflict (SMD = -0.37, CI: -0.70, -0.05, p = 0.02). No effect was found on self-efficacy, other types of mental health symptoms, adverse events, or patient satisfaction. A total of 39 outcomes were narratively synthesized with results either favoring the intervention group or showing no significant differences between groups. Studies were generally assessed to have unclear or high risk of bias, and outcomes had a Grading of Recommendations Assessment, Development and Evaluation (GRADE) rating of low- or very low-quality evidence. Conclusions: Digital interventions to support SDM may be a promising tool in mental healthcare; but with the limited quality of research, we have little confidence in the estimates of effect. More quality research is needed to further assess the effectiveness of digital means to support SDM but also to determine which digital intervention features are most effective to support SDM. Systematic Review Registration: PROSPERO, identifier CRD42020148132.