Evidence of Validity for a Newly Developed Digital Cognitive Test Battery.
Ontology highlight
ABSTRACT:
SUBMITTER: Vermeent S
PROVIDER: S-EPMC7194127 | biostudies-literature | 2020
REPOSITORIES: biostudies-literature
Publications
Evidence of Validity for a Newly Developed Digital Cognitive Test Battery.
Vermeent Stefan S Dotsch Ron R Schmand Ben B Klaming Laura L Miller Justin B JB van Elswijk Gijs G
Frontiers in psychology 20200424
Clinical practice still relies heavily on traditional paper-and-pencil testing to assess a patient's cognitive functions. Digital technology has the potential to be an efficient and powerful alternative, but for many of the existing digital tests and test batteries the psychometric properties have not been properly established. We validated a newly developed digital test battery consisting of digitized versions of conventional neuropsychological tests. Two confirmatory factor analysis models wer ...[more]
Similar Datasets
Project description:BACKGROUND: The NeuroTrax Mindstreams computerized cognitive assessment system was designed for widespread clinical and research use in detecting mild cognitive impairment (MCI). However, the capability of Mindstreams tests to discriminate elderly with MCI from those who are cognitively healthy has yet to be evaluated. Moreover, the comparability between these tests and traditional neuropsychological tests in detecting MCI has not been examined. METHODS: A 2-center study was designed to assess discriminant validity of tests in the Mindstreams Mild Impairment Battery. Participants were 30 individuals diagnosed with MCI, 29 with mild Alzheimer's disease (AD), and 39 healthy elderly. Testing was with the Mindstreams battery and traditional neuropsychological tests. Receiver operating characteristic (ROC) analysis was used to examine the ability of Mindstreams and traditional measures to discriminate those with MCI from cognitively healthy elderly. Between-group comparisons were made (Mann-Whitney U test) between MCI and healthy elderly and between MCI and mild AD groups. RESULTS: Mindstreams outcome parameters across multiple cognitive domains significantly discriminated among MCI and healthy elderly with considerable effect sizes (p < 0.05). Measures of memory, executive function, visual spatial skills, and verbal fluency discriminated best, and discriminability was at least comparable to that of traditional neuropsychological tests in these domains. CONCLUSIONS: Mindstreams tests are effective in detecting MCI, providing a comprehensive profile of cognitive function. Further, the enhanced precision and ease of use of these computerized tests make the NeuroTrax system a valuable clinical tool in the identification of elderly at high risk for dementia.
| S-EPMC270050 | biostudies-literature
Project description:BackgroundDown syndrome is associated with specific cognitive deficits. Alongside this, older adults with Down syndrome are a high risk group for dementia. The Arizona Cognitive Test Battery (ACTB), a cognitive assessment battery specifically developed for use with individuals with Down syndrome, has been proposed for use as outcome measures for clinical trials in this population. It has not been validated in older adults with Down syndrome. This study aims to assess the use and validity of the ACTB in older adults with Down syndrome.MethodsParticipants with Down syndrome aged 45 and over were assessed using the ACTB, standard tabletop tests and informant ratings.ResultsAssessment outcomes of 49 participants were analysed. Of these, 19 (39%) had a diagnosis of dementia or possible dementia. Most participants were able to attempt most of the tasks, although some tasks had high floor effects (including CANTAB Intra-Extra Dimensional shift stages completed and Modified Dots Task). Of the ACTB tasks, statistically significant differences were observed between the dementia and no dementia groups on CANTAB Simple Reaction Time median latency, NEPSY Visuomotor Precision-Car and Motorbike and CANTAB Paired Associates Learning stages completed. No significant differences were observed for CANTAB Intra-Extra Dimensional Shift, Modified Dots Task, Finger Sequencing, NEPSY Visuomotor precision-Train and Car and CANTAB Paired Associates Learning first trial memory score. Several of the tasks in the ACTB can be used in older adults with Down syndrome and have mild to moderate concurrent validity when compared to tabletop tests and informant ratings, although this varies on a test by test basis.ConclusionsOverall, scores for a number of tests in the ACTB were similar when comparing dementia and no dementia groups of older adults with Down syndrome, suggesting that it would not be an appropriate outcome measure of cognitive function for clinical trials of dementia treatments without further modification and validation.
| S-EPMC4865091 | biostudies-literature
Project description:The sensorimotor system (SMS) plays an important role in sports and in every day movement. Several tools for assessment and training have been designed. Many of them are directed to specific populations, and have major shortcomings due to the training effect or safety. The aim of the present study was to design and assess a dynamic sensorimotor test and training device that can be adjusted for all levels of performance. The novel pneumatic-driven mechatronic device can guide the trainee, allow independent movements or disrupt the individual with unpredicted perturbations while standing on a platform. The test-reliability was evaluated using intraclass correlation coefficient (ICC). Subjects were required to balance their center of pressure (COP) in a target circle (TITC). The time in TITC and the COP error (COPe) were recorded for analysis. The results of 22 males and 14 females (23.7 ± 2.6 years) showed good to excellent test-retest reliability. The newly designed Active Balance System (ABS) was then compared with the Biodex Balance System SD® (BBS). The results of 15 females, 14 males (23.4 ± 1.6 years) showed modest correlation in static and acceptable correlation in dynamic conditions, suggesting that ABS could be a reliable and comparable tool for dynamic balance assessments.
| S-EPMC4299105 | biostudies-literature
Project description:The main objective of this study is to assess the construct validity and reliability of the Grading Reflective Essays-9 (GRE-9). This study took place in a major tertiary academic medical center in Beirut, Lebanon. 104 reflective essays written by years 1-3 residents in the department of Family Medicine at the American University of Beirut Medical Center (AUBMC) were graded by 2 trained raters who independently scored the essays using GRE-9. GRE-9 scores were then correlated with scores on communication skills OSCE stations and in-training examinations to investigate, respectively, convergent and divergent validity. One of the 2 raters scored the essays twice one month apart to assess the reliability of the GRE-9 using intra rater reliability and internal consistency. There was a weak, non-significant correlation between GRE-9 score and In training examination (ITE) score (r = - .213, p = .395). There was a moderate, non-significant correlation between GRE-9 scores and the Objective structured clinical examination (OSCE) communication station scores (r = - .412 p = .162). The correlation coefficient between trails 1 and 2 was significant (r = .832, p = .000). Intra class correlation coefficient (ICC) analysis demonstrated almost perfect intra-rater agreement (0.819; 95% CI: 0.741-0.875) of the test ratings over time. GRE-9, is a short, concise, easy-to-use reliable grading tool for reflective essays that has demonstrated moderate to substantial intra-rater reliability and evidence of divergent validity. The study found non-significant correlations between reflective writing scores OSCE communication scores demonstrating a lack of relationship between reflective writing and this measure of performance.
| S-EPMC10655370 | biostudies-literature
Project description:Background: Cognitive training in a laboratory improves car driving skills of older car drivers. However, it remains unclear whether other types of cognitive training at home have beneficial effects on driving skills. Using our developed cognitive training games that can be played on a television with a set-top box in a person's home, we investigated the effects of a 6-week cognitive training program on driving skills, which included on-road evaluation (primary outcome), and cognitive functions and emotional states (secondary outcome) in older people. Methods: In this double-blinded randomized control trial (RCT), 60 older licensed drivers were randomly assigned into one of the two groups: a cognitive training game for car driving (CTCD) group and an active control cognitive training game (ACT) group. Participants in the CTCD group played the CTCD (processing speed, dual attention, and speed prediction) for 20 min in five sessions per week for 6 weeks. Participants in the ACT group played the ACT (selecting the larger number; selecting a number from largest to smallest; play a game of rock, article, scissors) for 20 min in five sessions per week for 6 weeks. We measured driving skills, various cognitive functions, and emotional states before and after the 6-week intervention period. Results: Our main results showed that compared to the ACT group, the CTCD group demonstrated improved driving skills (adjusted p = 0.034). Moreover, the CTCD group demonstrated improved inhibition (stroop, adjusted p = 0.042: reverse Stroop, adjusted p = 0.043) and processing speed performance symbol search (SS), adjusted p = 0.049; digit symbol coding (adjusted p = 0.047), compared to the ACT group. The CTCD group scored higher on vigor-activity mood (adjusted p = 0.041) as measured using the Profile of Mood State. Discussion: This randomized controlled trial provides scientific evidence for the benefits of the 6-week CTCD program on driving skills and cognitive functions, such as processing speed, inhibition, and vigor-activity mood, in healthy older people. Our results suggest that cognitive training is useful to improve the driving skills of older adults. Trial registration: This trial was registered at The University Hospital Medical Information Network Clinical Trials Registry (UMIN 000029769). Registered 31 October 2017, https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000034010.
| S-EPMC6513888 | biostudies-literature
Project description:BackgroundThe Ruff Figural Fluency Test (RFFT) is a valid but time-consuming and labour-intensive cognitive paper-and-pencil test. A digital RFFT was developed that can be conducted independently using an iPad and Apple Pencil and RFFT scores are computed automatically. We investigated the validity and reliability of this digital RFFT.MethodsWe randomly allocated participants to the digital or paper-and-pencil RFFT. After the first test, the other test was performed immediately (cross-over). Participants were invited for a second digital RFFT 1 week later. For the digital RFFT, an (automatic) algorithm and two independent raters (criterion standard) assessed the number of unique designs (UD) and perseverative errors (PE). These raters also assessed the paper-and-pencil RFFT. We used Intraclass correlation coefficients (ICC), sensitivity, specificity, %-agreement, Kappa, and Bland-Altman plots.ResultsWe included 94 participants (mean (SD) age 39.9 (14.8), 73.4% follow-up). Mean (SD) UD and median (IQR) PE of the digital RFFT were 84.2 (26.0) and 4 (2-7.3), respectively. Agreement between manual and automatic scoring of the digital RFFT was high for UD (ICC = 0.99, 95% CI 0.98, 0.99, sensitivity = 0.98; specificity = 0.96) and PE (ICC = 0.99, 95% CI 0.98, 0.99; sensitivity = 0.90, specificity = 1.00), indicating excellent criterion validity. Small but significant differences in UD were found between the automatic and manual scoring (mean difference: - 1.12, 95% CI - 1.92, - 0.33). Digital and paper-and-pencil RFFT had moderate agreement for UD (ICC = 0.73, 95% CI 0.34, 0.87) and poor agreement for PE (ICC = 0.47, 95% CI 0.30, 0.62). Participants had fewer UD on the digital than paper-and-pencil RFFT (mean difference: - 7.09, 95% CI - 11.80, - 2.38). The number of UD on the digital RFFT was associated with higher education (Spearman's r = 0.43, p < 0.001), and younger age (Pearson's r = - 0.36, p < 0.001), showing its ability to discriminate between different age categories and levels of education. Test-retest reliability was moderate (ICC = 0.74, 95% CI 0.61, 0.83).ConclusionsThe automatic scoring of the digital RFFT has good criterion and convergent validity. There was low agreement between the digital RFFT and paper-and-pencil RFFT and moderate test-retest reliability, which can be explained by learning effects. The digital RFFT is a valid and reliable instrument to measure executive cognitive function among the general population and is a feasible alternative to the paper-and-pencil RFFT in large-scale studies. However, its scores cannot be used interchangeably with the paper-and-pencil RFFT scores.
| S-EPMC8080381 | biostudies-literature
Project description:ObjectivePersons with schizophrenia exhibit greater neurocognitive test score dispersion. Here, we seek to characterize dispersion on the Neurocognitive Composite subtests of the Measurement of Treatment Research to Improve Cognition in Schizophrena Consensus Cognitive Battery (MCCB) and determine the relative effects of different antipsychotic formulations on dispersion and mean performance.MethodIn this post hoc analysis of the DREaM study (NCT02431702), which compared treatment with paliperidone palmitate (PP) long-acting injectable with oral antipsychotic (OAP) treatment over 18 months, dispersion in MCCB neurocognitive subtest performance was calculated for each participant by visit (test occasion).ResultsOver 18 months, mean neurocognitive performance improved in a manner consistent with the expected effects of practice in both groups (p < 0.05); this improvement was observed during the first 9 months (PP: p < 0.05, OAP: p < 0.001), followed by stable performance over the second 9 months (PP: p = 0.821, OAP: p = 0.375). Rates of change did not differ between groups (treatment-by-visit interaction: p = 0.548). In contrast, analyses of dispersion focusing on contrasts between baselines and end points of the first and second 9 months revealed different patterns. Over the first 9 months, dispersion in both groups lessened to a similar extent. However, over the second 9 months, dispersion remained stable in the PP group, whereas neurocognitive performance became significantly more variable in the OAP group (p < 0.01).ConclusionDispersion of neurocognitive test scores provides a different index of cognitive change than that provided by composite scores. Long-term maintenance of therapeutic levels provided by PP over time may limit (relative to oral AP) the extent to which cognitive performance becomes more variable.
| S-EPMC9468588 | biostudies-literature
Project description:Primary outcome(s): To evaluate sensitivity (positive concordance rate) and specificity (negative concordance rate) between the standard method using both tumor and normal samples and the newly developed MSI test kit using only tumor samples
| 2639395 | ecrin-mdr-crc
Project description:Reactive agility (RAG) and change of direction speed (CODS) are important determinants of success in football (soccer), but there is an evident lack of information on reliable and valid football-specific testing procedures which will be applicable in defining sport-specific RAG and CODS in youth players. This study evaluated reliability and construct validity of newly developed tests of football-specific RAG (FS_RAG) and CODS (FS_CODS), which involved the ball kicking football technique. Additionally, factors associated with FS_RAG and FS_CODS were evaluated. The participants were youth football players (n = 59; age: 13.40 ± 1.25 years) divided according to their age into U13 (11-12 years of age; n = 29), and U15 (13-14 years of age; n = 30) categories. Additionally, performance levels (starters [first-team] vs. non-starters [substitutes]) were observed in each age category. The dependent variables were newly developed FS_RAG and FS_CODS tests. The independent variables were sprinting capacities over 10 and 20 meters (S10M, S20M), countermovement jump (CMJ), the reactive strength index (RSI), and a generic CODS test of 20 yards (20Y). The newly developed FS_CODS and FS_RAG were observed as dependent variables. Results showed appropriate intra-testing and inter-testing reliability of the FS_RAG and FS_CODS, with somewhat better reliability of the FS_CODS (ICC=0.82 and 0.79, respectively). Additionally, better reliability was evidenced in U15 than in U13 (ICC: 0.82-0.85, and 0.78-0.80 for U15 and U13, respectively). Independent samples t-test indicated significant differences between U13 and U15 in S10 (t-test: 3.57, p < 0.001), S20M (t-test: 3.13, p < 0.001), 20Y (t-test: 4.89, p < 0.001), FS_RAG (t-test: 3.96, p < 0.001), and FS_CODS (t-test: 6.42, p < 0.001), with better performance in U15. Starters outperformed non-starters in most capacities among U13, but only in FS_RAG among U15 (t-test: 1.56, p < 0.05). Multiple regression calculations indicated nonsignificant association between independent and dependent variables in U13 (FS_CODS: 19%, FS_RAG: 21% of the explained variance, both p > 0.05), but independent variables explained significant proportion of both dependent variables in U15 (FS_CODS: 35%, FS_RAG: 33% explained variance, both p < 0.05). The study confirmed the applicability of newly developed tests in distinguishing studied age categories of players. Results indicate that superiority in all studied fitness capacities is translated into performance level in U13. Meanwhile, FS_RAG seems to be important determinant of quality in U15.
| S-EPMC6981745 | biostudies-literature
Project description:BackgroundEarly detection of dementia is critical for intervention and care planning but remains difficult. Computerized cognitive testing provides an accessible and promising solution to address these current challenges.ObjectiveThe aim of this study was to evaluate a computerized cognitive testing battery (BrainCheck) for its diagnostic accuracy and ability to distinguish the severity of cognitive impairment.MethodsA total of 99 participants diagnosed with dementia, mild cognitive impairment (MCI), or normal cognition (NC) completed the BrainCheck battery. Statistical analyses compared participant performances on BrainCheck based on their diagnostic group.ResultsBrainCheck battery performance showed significant differences between the NC, MCI, and dementia groups, achieving 88% or higher sensitivity and specificity (ie, true positive and true negative rates) for separating dementia from NC, and 77% or higher sensitivity and specificity in separating the MCI group from the NC and dementia groups. Three-group classification found true positive rates of 80% or higher for the NC and dementia groups and true positive rates of 64% or higher for the MCI group.ConclusionsBrainCheck was able to distinguish between diagnoses of dementia, MCI, and NC, providing a potentially reliable tool for early detection of cognitive impairment.
| S-EPMC9055476 | biostudies-literature