Dataset Information

Reliability and validity of the NeuroCognitive Performance Test, a web-based neuropsychological assessment.

ABSTRACT: The NeuroCognitive Performance Test (NCPT) is a brief, repeatable, web-based cognitive assessment platform that measures performance across several cognitive domains. The NCPT platform is modular and includes 18 subtests that can be arranged into customized batteries. Here we present normative data from a sample of 130,140 healthy volunteers for an NCPT battery consisting of 8 subtests. Participants took the NCPT remotely and without supervision. Factor structure and effects of age, education, and gender were evaluated with this normative dataset. Test-retest reliability was evaluated in a subset of participants who took the battery again an average of 78.8 days later. The eight NCPT subtests group into 4 putative cognitive domains, have adequate to good test-retest reliability, and are sensitive to expected age- and education-related cognitive effects. Concurrent validity to standard neuropsychological tests was demonstrated in 73 healthy volunteers. In an exploratory analysis the NCPT battery could differentiate those who self-reported Mild Cognitive Impairment or Alzheimer's disease from matched healthy controls. Overall these results demonstrate the reliability and validity of the NCPT battery as a measure of cognitive performance and support the feasibility of web-based, unsupervised testing, with potential utility in clinical and research settings.

SUBMITTER: Morrison GE

PROVIDER: S-EPMC4630791 | biostudies-literature | 2015

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of the NeuroCognitive Performance Test, a web-based neuropsychological assessment.

Morrison Glenn E GE Simone Christa M CM Ng Nicole F NF Hardy Joseph L JL

Frontiers in psychology 20151103

The NeuroCognitive Performance Test (NCPT) is a brief, repeatable, web-based cognitive assessment platform that measures performance across several cognitive domains. The NCPT platform is modular and includes 18 subtests that can be arranged into customized batteries. Here we present normative data from a sample of 130,140 healthy volunteers for an NCPT battery consisting of 8 subtests. Participants took the NCPT remotely and without supervision. Factor structure and effects of age, education, a ...[more]

PMID: 26579035

Similar Datasets

Project description:BACKGROUND:The Cambridge Neuropsychological Test Automated Battery (CANTAB) is a computerized tool used to measure cognitive function in diverse populations and is sensitive for assessing developmental changes in children. Although CANTAB has been used in several countries, its applicability in a Mexican child population is unknown. This study examined developmental trends on CANTAB in a large sample of urban Mexico City youth and tested the hypothesis that their performance would be similar to a large US normative sample. METHOD:As part of a birth cohort, Early Life Exposures in Mexico to Environmental Toxicants, 826 children, ages 5-15 years, completed CANTAB. Subtests measured planning (Stockings of Cambridge; SOC), short-term memory (Delayed Matching to Sample; DMS), sustained attention (Rapid Visual Information Processing; RVP), ability to match visual stimuli (Match to Sample Visual Search; MTS), flexibility (Intra-extra Dimensional Set Shift; IED), and response inhibition (Stop Signal Task; SST). Determinants of performance on the CANTAB, including age, maternal/child IQ, and sex, were analyzed using Spearman correlation and Welch t tests. Equivalence testing compared performance with existing norms. RESULTS:Performance improved with age on all measures. Child IQ was mildly associated with measures of memory and attention but not executive functioning, consistent with US norms. Maternal IQ was not associated with any outcomes, and males performed better on IED. Mexican norms were comparable to US norms on almost all outcomes, with the exception of a short-term visual recognition memory task (DMS). CONCLUSIONS:This study provides the largest normative data for CANTAB performance in a community sample of Mexican youth. Findings demonstrate the expected maturational effects of executive function, specifically in cognitive shifting and inhibition. Levels of executive function performance demonstrated by a Mexican sample were consistent with normative values reported in US youth. These findings, as well as expected associations with child IQ, indicate high applicability of CANTAB for Mexican youth in neurobehavioral studies.

Project description:BACKGROUND:Computerized assessments are already used to derive accurate and reliable measures of cognitive function. Web-based cognitive assessment could improve the accessibility and flexibility of research and clinical assessment, widen participation, and promote research recruitment while simultaneously reducing costs. However, differences in context may influence task performance. OBJECTIVE:This study aims to determine the comparability of an unsupervised, web-based administration of the Cambridge Neuropsychological Test Automated Battery (CANTAB) against a typical in-person lab-based assessment, using a within-subjects counterbalanced design. The study aims to test (1) reliability, quantifying the relationship between measurements across settings using correlational approaches; (2) equivalence, the extent to which test results in different settings produce similar overall results; and (3) agreement, by quantifying acceptable limits to bias and differences between measurement environments. METHODS:A total of 51 healthy adults (32 women and 19 men; mean age 36.8, SD 15.6 years) completed 2 testing sessions, which were completed on average 1 week apart (SD 4.5 days). Assessments included equivalent tests of emotion recognition (emotion recognition task [ERT]), visual recognition (pattern recognition memory [PRM]), episodic memory (paired associate learning [PAL]), working memory and spatial planning (spatial working memory [SWM] and one touch stockings of Cambridge), and sustained attention (rapid visual information processing [RVP]). Participants were randomly allocated to one of the two groups, either assessed in-person in the laboratory first (n=33) or with unsupervised web-based assessments on their personal computing systems first (n=18). Performance indices (errors, correct trials, and response sensitivity) and median reaction times were extracted. Intraclass and bivariate correlations examined intersetting reliability, linear mixed models and Bayesian paired sample t tests tested for equivalence, and Bland-Altman plots examined agreement. RESULTS:Intraclass correlation (ICC) coefficients ranged from ?=0.23-0.67, with high correlations in 3 performance indices (from PAL, SWM, and RVP tasks; ??0.60). High ICC values were also seen for reaction time measures from 2 tasks (PRM and ERT tasks; ??0.60). However, reaction times were slower during web-based assessments, which undermined both equivalence and agreement for reaction time measures. Performance indices did not differ between assessment settings and generally showed satisfactory agreement. CONCLUSIONS:Our findings support the comparability of CANTAB performance indices (errors, correct trials, and response sensitivity) in unsupervised, web-based assessments with in-person and laboratory tests. Reaction times are not as easily translatable from in-person to web-based testing, likely due to variations in computer hardware. The results underline the importance of examining more than one index to ascertain comparability, as high correlations can present in the context of systematic differences, which are a product of differences between measurement environments. Further work is now needed to examine web-based assessments in clinical populations and in larger samples to improve sensitivity for detecting subtler differences between test settings.

Project description:Main aim of this study was examining validity and reliability of using a new specific Parkour repeated sprint ability test (SPRSA) for assessing repeated sprint ability while facing obstacles and establishing between-day reliability and sensitivity of SPRSA related to its physiological and performance responses. Thirteen high-level traceurs (three females) performed in random order and twice eight tests for assessing a total of 23 variables: SPRSA (a typical maximal-speed shuttle run interspersed with four Parkour competition-common fundamentals) and seven established fitness tests, core stability, hand-grip, vertical-jump, long-jump, pull-up, 300-m shuttle run (as a field test for anaerobic capacity), and Leger test. Except for muscular elasticity index of vertical jump test (intra-class Correlation Coefficient model 3,1 [ICC3,1] = 0.54 [fair]), fitness tests' ICC3,1s resulted excellent (ICC3,1: 0.93-1.00). SPRSA total time and time of its fastest sprint (SPRSA peak time) were significantly correlated with the majority of core stability (r: -0.79 to 0.59; P < 0.01-0.05), jumping (r: -0.78 to 0.67; P < 0.01-0.05), pull-up tests (r: -0.86; P < 0.01), 300-m shuttle run test total time (r: 0.77-0.82; P < 0.01), and Leger test-estimated VO2 max (r: -0.78; P < 0.01). Principal component analysis (PCA) of the 23 variables led to extraction of four significant components (each due to different variables' combinations), which explained 90.2% of 23 variables' total variance. SPRSA (i.e., total and peak time) showed high reliability (ICC3,1: 0.991-0.998 and standard-error-of-measurement %: 0.07-0.32). Finally, SPRSA showed high sensitivity (smallest-worthwhile-change %: 0.29-0.68). Considering its excellent logical and strong ecological validity, SPRSA may serve as a valid specific field test for Parkour sport. In addition, thanks to its high reliability and sensitivity, this test is suitable for monitoring, evaluating, and programming training processes for Parkour practitioners in repeated sprint ability involving crossing obstacles.

Project description:With the recent publication of new criteria for the diagnosis of preclinical Alzheimer's disease (AD), there is a need for neuropsychological tools that take premorbid functioning into account in order to detect subtle cognitive decline. Using demographic adjustments is one method for increasing the sensitivity of commonly used measures. We sought to provide a useful online z-score calculator that yields estimates of percentile ranges and adjusts individual performance based on sex, age and/or education for each of the neuropsychological tests of the National Alzheimer's Coordinating Center Uniform Data Set (NACC, UDS). In addition, we aimed to provide an easily accessible method of creating norms for other clinical researchers for their own, unique data sets.Data from 3,268 clinically cognitively-normal older UDS subjects from a cohort reported by Weintraub and colleagues (2009) were included. For all neuropsychological tests, z-scores were estimated by subtracting the raw score from the predicted mean and then dividing this difference score by the root mean squared error term (RMSE) for a given linear regression model.For each neuropsychological test, an estimated z-score was calculated for any raw score based on five different models that adjust for the demographic predictors of SEX, AGE and EDUCATION, either concurrently, individually or without covariates. The interactive online calculator allows the entry of a raw score and provides five corresponding estimated z-scores based on predictions from each corresponding linear regression model. The calculator produces percentile ranks and graphical output.An interactive, regression-based, normative score online calculator was created to serve as an additional resource for UDS clinical researchers, especially in guiding interpretation of individual performances that appear to fall in borderline realms and may be of particular utility for operationalizing subtle cognitive impairment present according to the newly proposed criteria for Stage 3 preclinical Alzheimer's disease.

Dataset Information

Reliability and validity of the NeuroCognitive Performance Test, a web-based neuropsychological assessment.

Publications

Reliability and validity of the NeuroCognitive Performance Test, a web-based neuropsychological assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets