Dataset Information

Test-Retest Reliability of a Computerized Concussion Test: CNS Vital Signs.

ABSTRACT: Neurocognitive testing is an important concussion evaluation tool, but for neurocognitive tests to be useful, their psychometric properties must be well established. Test-retest reliability of computerized neurocognitive tests can influence their clinical utility. The reliability for a commonly used computerized neurocognitive test, CNS Vital Signs, is not well established. The purpose of this study was to examine test-retest reliability and reliable change indices for CNS Vital Signs in a healthy, physically active college population.CNS Vital Signs yields acceptable test-retest reliability, with greater reliability between the second and third test administration compared with between the first and second administration.Cohort study.Level 3.Forty healthy, active volunteers (16 men, 24 women; mean age, 21.05 ± 2.17 years) reported to a clinical laboratory for 3 sessions, 1 week apart. At each session, participants were administered CNS Vital Signs. Outcomes included standard scores for the following CNS Vital Signs domains: verbal memory, visual memory, psychomotor speed, cognitive flexibility, complex attention, processing speed, reaction time, executive functioning, and reasoning.Participants performed significantly better on the second session and/or third session than they did on the first testing session on 6 of 9 neurocognitive domains. Pearson r test-retest correlations between sessions ranged from 0.11 to 0.87. Intraclass correlation coefficients ranged from 0.10 to 0.86.Clinicians should consider using reliable change indices to account for practice effects, identify meaningful score changes due to pathology, and inform clinical decisions.This study highlights the importance of clinicians understanding the psychometric properties of computerized neurocognitive tests when using them in the management of sport-related concussion. If CNS Vital Signs is administered twice within a small time frame (such as 1 week), athletes should be expected to improve between the first and second administration.

SUBMITTER: Littleton AC

PROVIDER: S-EPMC4547115 | biostudies-literature | 2015 Sep-Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Test-Retest Reliability of a Computerized Concussion Test: CNS Vital Signs.

Littleton Ashley C AC Register-Mihalik Johna K JK Guskiewicz Kevin M KM

Sports health 20150515 5

<h4>Background</h4>Neurocognitive testing is an important concussion evaluation tool, but for neurocognitive tests to be useful, their psychometric properties must be well established. Test-retest reliability of computerized neurocognitive tests can influence their clinical utility. The reliability for a commonly used computerized neurocognitive test, CNS Vital Signs, is not well established. The purpose of this study was to examine test-retest reliability and reliable change indices for CNS Vit ...[more]

PMID: 26502421

Similar Datasets

Project description:BACKGROUND:Concussion diagnosis is typically made through clinical examination and supported by performance on clinical assessment tools. Performance on commonly implemented and emerging assessment tools is known to vary between administrations, in the absence of concussion. OBJECTIVE:To evaluate the test-retest reliability of commonly implemented and emerging concussion assessment tools across a large nationally representative sample of student-athletes. METHODS:Participants (n = 4874) from the Concussion Assessment, Research, and Education Consortium completed annual baseline assessments on two or three occasions. Each assessment included measures of self-reported concussion symptoms, motor control, brief and extended neurocognitive function, reaction time, oculomotor/oculovestibular function, and quality of life. Consistency between years 1 and 2 and 1 and 3 were estimated using intraclass correlation coefficients or Kappa and effect sizes (Cohen's d). Clinical interpretation guidelines were also generated using confidence intervals to account for non-normally distributed data. RESULTS:Reliability for the self-reported concussion symptoms, motor control, and brief and extended neurocognitive assessments from year 1 to 2 ranged from 0.30 to 0.72 while effect sizes ranged from 0.01 to 0.28 (i.e., small). The reliability for these same measures ranged from 0.34 to 0.66 for the year 1-3 interval with effect sizes ranging from 0.05 to 0.42 (i.e., small to less than medium). The year 1-2 reliability for the reaction time, oculomotor/oculovestibular function, and quality-of-life measures ranged from 0.28 to 0.74 with effect sizes from 0.01 to 0.38 (i.e., small to less than medium effects). CONCLUSIONS:This investigation noted less than optimal reliability for most common and emerging concussion assessment tools. Despite this finding, their use is still necessitated by the absence of a gold standard diagnostic measure, with the ultimate goal of developing more refined and sound tools for clinical use. Clinical interpretation guidelines are provided for the clinician to apply with a degree of certainty in application.

Project description:BackgroundMobility and cognitive impairments in Parkinson's disease (PD) often coexist and are prognostic of adverse health events. Consequently, assessment and training that simultaneously address both gait function and cognition are important to consider in rehabilitation and promotion of healthy aging. For this purpose, a computer game-based rehabilitation treadmill platform (GRP) was developed for dual-task (DT) assessment and training.ObjectiveThe first objective was to establish the test-retest reliability of the GRP assessment protocol for DT gait, visuomotor and executive cognitive function in PD patients. The second objective was to examine the effect of task condition [single task (ST) vs. DT] and disease severity (stage 2 vs. stage 3) on gait, visuomotor and cognitive function.MethodsThirty individuals aged 55 to 70 years, diagnosed with PD; 15 each at Hoehn and Yahr scale stage 2 (PD-2) and 3 (PD-3) performed a series of computerized visuomotor and cognitive game tasks while sitting (ST) and during treadmill walking (DT). A treadmill instrumented with a pressure mat was used to record center of foot pressure and compute the average and coefficient of variation (COV) of step time, step length, and drift during 1-min, speed-controlled intervals. Visuomotor and cognitive game performance measures were quantified using custom software. Testing was conducted on two occasions, 1 week apart.ResultsWith few exceptions, the assessment protocol showed moderate to high intraclass correlation coefficient (ICC) values under both ST and DT conditions for the spatio-temporal gait measures (average and COV), as well as the visuomotor tracking and cognitive game performance measures. A significant decline in gait, visuomotor, and cognitive game performance measures was observed during DT compared to ST conditions, and in the PD-3 compared to PD-2 groups.ConclusionThe high to moderate ICC values along with the lack of systematic errors in the measures indicate that this tool has the ability to repeatedly record reliable DT interference (DTI) effects over time. The use of interactive digital media provides a flexible method to produce and evaluate DTI for a wide range of executive cognitive activities. This also proves to be a sensitive tool for tracking disease progression.Clinical trial registrationwww.ClinicalTrials.gov, identifier NCT03232996.

Project description:BackgroundLittle is currently known about the tapering practices of strongman athletes. We have developed an Internet-based comprehensive self-report questionnaire examining the training and tapering practices of strongman athletes.ObjectiveThe objective of this study was to document the test-retest reliability of questions associated with the Internet-based comprehensive self-report questionnaire on the tapering practices of strongman athletes. The information will provide insight on the reliability and usefulness of the online questionnaire for use with strongman athletes.MethodsInvitations to complete an Internet questionnaire were sent via Facebook Messenger to identified strongman athletes. The survey consisted of four main areas of inquiry, including demographics and background information, training practices, tapering, and tapering practices. Of the 454 athletes that completed the survey over the 8-week period, 130 athletes responded on Facebook Messenger indicating that they intended to complete, or had completed, the survey. These participants were asked if they could complete the online questionnaire a second time for a test-retest reliability analysis. Sixty-four athletes (mean age 33.3 years, standard deviation [SD] 7.7; mean height 178.2 cm, SD 11.0; mean body mass 103.7 kg, SD 24.8) accepted this invitation and completed the survey for the second time after a minimum 7-day period from the date of their first completion. Agreement between athlete responses was measured using intraclass correlation coefficients (ICCs) and kappa statistics. Confidence intervals (at 95%) were reported for all measures and significance was set at P<.05.ResultsTest-retest reliability for demographic and training practices items were significant (P<.001) and showed excellent (ICC range=.84 to .98) and fair to almost perfect agreement (? range=.37-.85). Moderate to excellent agreements (ICC range=.56-.84; P<.01) were observed for all tapering practice measures except for the number of days athletes started their usual taper before a strongman competition (ICC=.30). When the number of days were categorized with additional analyses, moderate reliability was observed (?=.43; P<.001). Fair to substantial agreement was observed for the majority of tapering practices measures (?range=.38-.73; P<.001) except for how training frequency (?=.26) and the percentage and type of resistance training performed, which changed in the taper (?=.20). Good to excellent agreement (ICC=.62-.93; P<.05) was observed for items relating to strongman events and traditional exercises performed during the taper. Only the time at which the Farmer's Walk was last performed before competition showed poor reliability (ICC=.27).ConclusionsWe have developed a low cost, self-reported, online retrospective questionnaire, which provided stable and reliable answers for most of the demographic, training, and tapering practice questions. The results of this study support the inferences drawn from the Tapering Practices of Strongman Athletes Study.

Dataset Information

Test-Retest Reliability of a Computerized Concussion Test: CNS Vital Signs.

Publications

Test-Retest Reliability of a Computerized Concussion Test: CNS Vital Signs.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure