Dataset Information

Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Validation With Paper-Pencil and Computerized Cognitive Composites.

ABSTRACT: BACKGROUND:As eye tracking-based assessment of cognition becomes more widely used in older adults, particularly those at risk for dementia, reliable and scalable methods to collect high-quality data are required. Eye tracking-based cognitive tests that utilize device-embedded cameras have the potential to reach large numbers of people as a screening tool for preclinical cognitive decline. However, to fully validate this approach, more empirical evidence about the comparability of eyetracking-based paradigms to existing cognitive batteries is needed. OBJECTIVE:Using a population of clinically normal older adults, we examined the relationship between a 30-minute Visual Paired Comparison (VPC) recognition memory task and cognitive composite indices sensitive to a subtle decline in domains associated with Alzheimer disease. Additionally, the scoring accuracy between software used with a commercial grade eye tracking camera at 60 frames per second (FPS) and a manually scored procedure used with a laptop-embedded web camera (3 FPS) on the VPC task was compared, as well as the relationship between VPC task performance and domain-specific cognitive function. METHODS:A group of 49 clinically normal older adults completed a 30-min VPC recognition memory task with simultaneous recording of eye movements by a commercial-grade eye-tracking camera and a laptop-embedded camera. Relationships between webcam VPC performance and the Preclinical Alzheimer Cognitive Composite (PACC) and National Institutes of Health Toolbox Cognitive Battery (NIHTB-CB) were examined. Inter-rater reliability for manually scored tests was analyzed using Krippendorff's kappa formula, and we used Spearman's Rho correlations to investigate the relationship between VPC performance scores with both cameras. We also examined the relationship between VPC performance with the device-embedded camera and domain-specific cognitive performance. RESULTS:Modest relationships were seen between mean VPC novelty preference and the PACC (r=.39, P=.007) and NIHTB-CB (r=.35, P=.03) composite scores, and additional individual neurocognitive task scores including letter fluency (r=.33, P=.02), category fluency (r=.36, P=.01), and Trail Making Test A (-.40, P=.006). Robust relationships were observed between the 60 FPS eye tracker and 3 FPS webcam on both trial-level VPC novelty preference (r=.82, P<.001) and overall mean VPC novelty preference (r=.92 P<.001). Inter-rater agreement of manually scored web camera data was high (kappa=.84). CONCLUSIONS:In a sample of clinically normal older adults, performance on a 30-minute VPC task correlated modestly with computerized and paper-pencil based cognitive composites that serve as preclinical Alzheimer disease cognitive indices. The strength of these relationships did not differ between camera devices. We suggest that using a device-embedded camera is a reliable and valid way to assess performance on VPC tasks accurately and that these tasks correlate with existing cognitive composites.

SUBMITTER: Bott N

PROVIDER: S-EPMC6081607 | biostudies-literature | 2018 Jul

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Validation With Paper-Pencil and Computerized Cognitive Composites.

Bott Nicholas N Madero Erica N EN Glenn Jordan J Lange Alexander A Anderson John J Newton Doug D Brennan Adam A Buffalo Elizabeth A EA Rentz Dorene D Zola Stuart S

Journal of medical Internet research 20180724 7

<h4>Background</h4>As eye tracking-based assessment of cognition becomes more widely used in older adults, particularly those at risk for dementia, reliable and scalable methods to collect high-quality data are required. Eye tracking-based cognitive tests that utilize device-embedded cameras have the potential to reach large numbers of people as a screening tool for preclinical cognitive decline. However, to fully validate this approach, more empirical evidence about the comparability of eyetrac ...[more]

PMID: 30042093

Similar Datasets

Project description:ObjectiveThis study assessed classification accuracy of paper-and-pencil and computerized cognitive batteries at subacute (SA; 1-11 days) and early chronic (EC; ∼4 months) phases of pediatric mild traumatic brain injury (pmTBI). Two statistical approaches focused on single-subject performance (individual task scores, total impairments) were used to maximize clinical utility.MethodTwo hundred thirty-five pmTBI and 169 healthy controls (HC) participants aged 8-18 were enrolled, with a subset (190 pmTBI; 160 HC) returning for the EC visit. The paper-and-pencil battery included several neuropsychological tests selected from recommended common data elements, whereas computerized testing was performed with the Cogstate Brief Battery. Hierarchical logistic regressions (base model: Parental education and premorbid reading abilities; full model: Base model and cognitive testing variables) were used to examine sensitivity/specificity, with diagnosis as the dependent variable.ResultsNumber Sequencing and Cogstate One-Card Learning accuracy significantly predicted SA diagnosis (full model accuracy = 71.6%-71.7%, sensitivity = 80.6%-80.8%, specificity = 59.1%-59.6%), while only immediate recall was significant at EC visit (accuracy = 68.5%, sensitivity = 74.6%, specificity = 61.5%). Other measures (Letter Fluency, Cogstate Detection, and One-Card Learning accuracy) demonstrated higher proportions of impairment for pmTBI subacutely (pmTBI: 11.5%-19.8%; HC: 3.7%-6.1%) but did not improve classification accuracy. Evidence of multiple impairments across the entire testing battery significantly predicted diagnosis at both visits (full model accuracy = 66.2%-68.6%, sensitivity = 71.2%-78.9%, specificity = 54.3%-61.5%).ConclusionsCurrent results suggest similar modest diagnostic accuracy for computerized and paper-and-pencil batteries across multiple pmTBI phases. Moreover, findings suggest the total number of impairments may be more clinically useful than any single test or cognitive domain in terms of diagnostic accuracy at both assessment points. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Project description:ObjectiveDevelopments in digital technology have permitted researchers to study mandibular movements. Here, the accuracy of a real-time, computerized, binocular, three-dimensional (3D) trajectory-tracking device for recording functional mandibular movements was evaluated.MethodsAn occlusal splint without the occlusal region was created based on a plaster cast of the lower dentition. The splint was rigidly connected with a target on its labial side and seated on the cast. The cast was then rigidly attached to the stage of a high-precision triaxial electronic translator, which was used to move the target-cast-stage complex. Half-circular movements (5.00-mm radius) in three planes (XOY, XOZ, YOZ) and linear movements along the x-axis were performed at 5.00 mm/s. All trajectory points were recorded with the binocular 3D trajectory-tracking device and fitted to arcs or lines, respectively, with the Imageware software. To analyze the accuracy of the trajectory-tracking device, the mean distances between the trajectory points and the fitted arcs or lines were measured, and the mean differences between the lengths of the fitted arcs' radii and a set value (5.00 mm) were then calculated. A one-way analysis of variance was used to evaluate the spatial consistency of the recording accuracy in three different planes.ResultsThe mean distances between the trajectory points and fitted arcs or lines were 0.076 ± 0.033 mm or 0.089 ± 0.014 mm. The mean difference between the lengths of the fitted arcs' radii and the set value (5.00 mm) was 0.025 ± 0.071 mm. A one-way ANOVA showed that the recording errors in three different planes were not statistically significant.ConclusionThese results suggest that the device can record certain movements at 5.00 mm/s, which is similar to the speed of functional mandibular movements. In addition, the recordings had an error of <0.1 mm and good spatial consistency. Thus, the device meets some of the requirements necessary for recording human mandibular movements.

Dataset Information

Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Validation With Paper-Pencil and Computerized Cognitive Composites.

Publications

Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Validation With Paper-Pencil and Computerized Cognitive Composites.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets