Dataset Information

Testing a Novel Web-Based Neurocognitive Battery in the General Community: Validation and Usability Study.

ABSTRACT:

Background

In recent years, there has been increased interest in the development of remote psychological assessments. These platforms increase accessibility and allow clinicians to monitor important health metrics, thereby informing patient-centered treatment.

Objective

In this study, we report the properties and usability of a new web-based neurocognitive assessment battery and present a normative data set for future use.

Methods

A total of 781 participants completed a portion of 8 tasks that captured performance in auditory processing, visual-spatial working memory, visual-spatial learning, cognitive flexibility, and emotional processing. A subset of individuals (n=195) completed a 5-question survey measuring the acceptability of the tasks.

Results

Between 252 and 426 participants completed each task. Younger individuals outperformed their older counterparts in 6 of the 8 tasks. Therefore, central tendency data metrics were presented using 7 different age bins. The broad majority of participants found the tasks interesting and enjoyable and endorsed some interest in playing them at home. Only 1 of 195 individuals endorsed not at all for the statement, "I understood the instructions." Older individuals were less likely to understand the instructions; however, 72% (49/68) of individuals over the age of 60 years still felt that they mostly or very much understood the instructions.

Conclusions

Overall, the tasks were found to be widely acceptable to the participants. The use of web-based neurocognitive tasks such as these may increase the ability to deploy precise data-informed interventions to a wider population.

SUBMITTER: Capizzi R

PROVIDER: S-EPMC8138705 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:BackgroundThe prepandemic period saw a rise in web-based teaching. However, web-based tools for teaching the essential clinical skill of cognitive empathy (also known as perspective taking) remain limited. More of these tools are needed and require testing for ease of use and understanding by students.ObjectiveThis study aimed to evaluate the usability of the In Your Shoes web-based empathy training portal application for students using quantitative and qualitative methods.MethodsThis 3-phase formative usability study used a mixed methods design. In mid-2021, we conducted a remote observation of student participants interacting with our portal application. Their qualitative reflections were captured, followed by data analysis and iterative design refinements of the application. Overall, 8 third- and fourth-year nursing students from an undergraduate baccalaureate program at a Canadian university, in the western province of Manitoba, were included in this study. Participants in phases 1 and 2 were remotely observed by 3 research personnel while engaged in predefined tasks. In phase 3, two student participants were asked to use the application as they liked in their own environments, after which a video-recorded exit interview with a think-aloud process was conducted as participants responded to the System Usability Scale. We calculated descriptive statistics and performed content analysis to analyze the results.ResultsThis small study included 8 students with a range of technology skills. Usability themes were based on participants' comments on the application's appearance, content, navigation, and functionality. The biggest issues that participants experienced were with navigating the application's "tagging" features during video analysis and the length of educational material. We also observed variations in 2 participants' system usability scores in phase 3. This may be because of their different comfort levels with technology; however, additional research is required. We made iterative refinements to our prototype application (eg, added pop-up messages and provided a narrated video on the application's "tagging" function) based on participant feedback.ConclusionsWith increasing engagement in web-based teaching, technology has become an essential medium for receiving health care education. We developed a novel prototype application as a supplemental classroom tool to foster students' self-directed learning of empathy. This study provided direction for refinements to optimize the usability of and satisfaction with this innovative application. Qualitative feedback revealed favorable input toward learning perspective taking place on the web and helpful recommendations for improving user experiences with the application. We could not fully assess the application's key functions owing to the COVID-19 protocols. Thus, our next step is to obtain feedback from a larger sample of student users, whose experiences performing "live" video capture, annotation, and analysis will be more authentic and wholesome with the refined application. We discuss our findings in relation to research on nursing education, perspective taking, and adaptive e-learning.

Project description:BackgroundAssistive technology (AT) can contribute to how individuals participate and engage in everyday activities, such as communication and mobility, and facilitates access to the services they require. Navigating Canada's AT system has been described as fragmented and complex, presenting barriers for individuals who require AT, caregivers, and health service providers. AccessATCanada was developed as a centralized web-based resource to help support access to AT by providing information about the existing jurisdictional funding programs and services.ObjectiveThis study aimed to evaluate the usability of AccessATCanada by gathering feedback about its features, functionality, and areas of strength and opportunity from potential end users.MethodsA usability testing study using a think-aloud approach and semistructured interviews was conducted to measure the effectiveness and efficiency of and user satisfaction with AccessATCanada and to identify issues with the interface during end-user interaction. A qualitative thematic analysis was used to generate insights into and core themes about user experiences. User feedback was used to inform subsequent updates of the database with the goal of enhancing website friendliness and functionality before its official launch.ResultsA total of 10 participants (6 consumers, 1 caregiver, and 3 providers) participated in the usability testing study. The usability performance and scores tended to improve between the 2 testing cycles. Most participants were able to successfully complete all the tasks independently. The efficiency scores tended to improve as the users continued to engage with the interface. The website received an overall System Usability Score of 62.22, which was ranked as "OK/fair to good." The users provided an overall positive evaluation of the beta version of the web-based resource tested over 2 cycles and helped to identify areas for improvement. They commented on the functionality and added value of the website, discovery of new programs and resources, and design aesthetics. Most usability issues were reported as minor challenges related to presentation, functionality, and language, and feedback was adopted into later iterations of the website.ConclusionsThis study provides reflections on the value of usability testing and elements that are key to the creation of user-centered resources, such as the inclusion of participants with various abilities and considerations regarding website design and accessibility in an increasingly web-based world. AccessATCanada is now part of a growing global response to expand the reach of AT programs and services, improve the equity of access to AT, and reduce the complexity of navigating AT systems.

Project description:BackgroundChildhood obesity is a serious public health issue among minority youth in the United States. Technology-enhanced approaches can be effective for promoting healthy behavior change.ObjectiveThe purpose of this study was to test the usability of prototypes of a Web-based interactive tool promoting healthy dietary behaviors to reduce childhood obesity risk in urban minority youth. The Web-based tool comprised a manga-style comic with interactive features (eg, sound effects, clickable pop-ups), tailored messaging, and goal setting, and was optimized for use on tablet devices.MethodsLatino and black/African American children ages 9 to 13 years were recruited to participate in two rounds of usability testing. A modified think-aloud method was utilized. Self-reported surveys and field notes were collected. Audio recordings and field notes from usability testing sessions were systematically reviewed by extracting and coding user feedback as either positive comments or usability or negative issues. The quantitative data from self-reported questionnaires were analyzed using descriptive statistics.ResultsTwelve children (four female; eight black/African American) with a mean age of 10.92 (SD 1.16) years participated. Testing highlighted overall positive experiences with the Web-based interactive tool, especially related to storyline, sound effects, and color schemes. Specific usability issues were classified into six themes: appearance, content, special effects, storyline, terminology, and navigation. Changes to the Web-based tool after round 1 included adding a navigation guide, making clickable icons more visible, improving graphic designs, and fixing programming errors. In round 2 of testing (after modifications to the Web-based tool were incorporated), many of the usability issues that were identified in round 1 did not emerge.ConclusionsResults of testing will inform further development and finalization of the tool, which will be tested using a two-group pilot randomized study, with the goal of reducing childhood obesity risk in minority, low-income youth.

Project description:BackgroundWeb-based decision aids are increasingly important in medical research and clinical care. However, few have been studied in an intensive care unit setting. The objectives of this study were to develop a Web-based decision aid for family members of patients receiving prolonged mechanical ventilation and to evaluate its usability and acceptability.MethodsUsing an iterative process involving 48 critical illness survivors, family surrogate decision makers, and intensivists, we developed a Web-based decision aid addressing goals of care preferences for surrogate decision makers of patients with prolonged mechanical ventilation that could be either administered by study staff or completed independently by family members (Development Phase). After piloting the decision aid among 13 surrogate decision makers and seven intensivists, we assessed the decision aid's usability in the Evaluation Phase among a cohort of 30 surrogate decision makers using the Systems Usability Scale (SUS). Acceptability was assessed using measures of satisfaction and preference for electronic Collaborative Decision Support (eCODES) versus the original printed decision aid.ResultsThe final decision aid, termed 'electronic Collaborative Decision Support', provides a framework for shared decision making, elicits relevant values and preferences, incorporates clinical data to personalize prognostic estimates generated from the ProVent prediction model, generates a printable document summarizing the user's interaction with the decision aid, and can digitally archive each user session. Usability was excellent (mean SUS, 80 ± 10) overall, but lower among those 56 years and older (73 ± 7) versus those who were younger (84 ± 9); p = 0.03. A total of 93% of users reported a preference for electronic versus printed versions.ConclusionsThe Web-based decision aid for ICU surrogate decision makers can facilitate highly individualized information sharing with excellent usability and acceptability. Decision aids that employ an electronic format such as eCODES represent a strategy that could enhance patient-clinician collaboration and decision making quality in intensive care.

Project description:ObjectiveLarge-scale studies have revolutionized biomedical research, and neurocognitive tests can help elucidate the biological basis of neuropsychiatric diseases. However, studies have predominantly been conducted in Western settings. We describe the development and validation of a computerized battery (PennCNB) with the Xhosa population of South Africa.MethodIndividuals with schizophrenia (n = 525) and a normative comparison group (n = 744) were balanced on age, sex, education, and region. Participants provided blood samples, were assessed psychiatrically, and were administered a PennCNB translation to isiXhosa, including measures of executive functions, episodic memory, complex cognition, social cognition, and sensorimotor speed. Feasibility was examined with test completion rates and input from administrators, and psychometric structural validity and associations with clinical and demographic characteristics were examined.ResultsTests were well tolerated by participants, as >87% had one (or fewer) test missing. Results suggested a similar factor structure to prior PennCNB studies in Western contexts, and expected age and sex effects were apparent. Furthermore, a similar profile of schizophrenia was observed, with neurocognitive deficits most pronounced for executive functions, especially attention, as well as memory, social cognition, and motor speed relative to complex cognition and sensorimotor speed.ConclusionsResults support the feasibility of implementing a culturally adapted computerized neurocognitive battery in sub-Saharan African settings and provide evidence supporting the concurrent validity of the translated instrument. Thus, the PennCNB is implementable on a large scale in non-Western contexts, shows expected factor structure, and can detect cognitive deficits associated with neuropsychiatric disorders. Obtaining valid measures of cognition by nonspecialized proctors is especially suitable in resource-limited settings, where traditional testing is prohibitive. Future work should establish normative standards, test-retest reliability, and sensitivity to treatment. (PsycInfo Database Record (c) 2021 APA, all rights reserved).