Dataset Information

Reliability and validity of the UK Biobank cognitive tests.

ABSTRACT: UK Biobank is a health resource with data from over 500,000 adults. The cognitive assessment in UK Biobank is brief and bespoke, and is administered without supervision on a touchscreen computer. Psychometric information on the UK Biobank cognitive tests are limited. Despite the non-standard nature of these tests and the limited psychometric information, the UK Biobank cognitive data have been used in numerous scientific publications. The present study examined the validity and short-term test-retest reliability of the UK Biobank cognitive tests. A sample of 160 participants (mean age = 62.59, SD = 10.24) was recruited who completed the UK Biobank cognitive assessment and a range of well-validated cognitive tests ('reference tests'). Fifty-two participants returned 4 weeks later to repeat the UK Biobank tests. Correlations were calculated between UK Biobank tests and reference tests. Two measures of general cognitive ability were created by entering scores on the UK Biobank cognitive tests, and scores on the reference tests, respectively, into separate principal component analyses and saving scores on the first principal component. Four-week test-retest correlations were calculated for UK Biobank tests. UK Biobank cognitive tests showed a range of correlations with their respective reference tests, i.e. those tests that are thought to assess the same underlying cognitive ability (mean Pearson r = 0.53, range = 0.22 to 0.83, p?.005). The measure of general cognitive ability based on the UK Biobank cognitive tests correlated at r = 0.83 (p < .001) with a measure of general cognitive ability created using the reference tests. Four-week test-retest reliability of the UK Biobank tests were moderate-to-high (mean Pearson r = 0.55, range = 0.40 to 0.89, p?.003). Despite the brief, non-standard nature of the UK Biobank cognitive tests, some tests showed substantial concurrent validity and test-retest reliability. These psychometric results provide currently-lacking information on the validity of the UK Biobank cognitive tests.

SUBMITTER: Fawns-Ritchie C

PROVIDER: S-EPMC7170235 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Reliability and validity of the UK Biobank cognitive tests.

Fawns-Ritchie Chloe C Deary Ian J IJ

PloS one 20200420 4

UK Biobank is a health resource with data from over 500,000 adults. The cognitive assessment in UK Biobank is brief and bespoke, and is administered without supervision on a touchscreen computer. Psychometric information on the UK Biobank cognitive tests are limited. Despite the non-standard nature of these tests and the limited psychometric information, the UK Biobank cognitive data have been used in numerous scientific publications. The present study examined the validity and short-term test-r ...[more]

PMID: 32310977

Similar Datasets

Project description:IntroductionSpeed is an important prerequisite in soccer. Therefore, a large number of tests have been developed aiming to investigate several speed skills relevant to soccer. This systematic review aimed to examine the validity and reliability of speed tests used in adult soccer players.MethodsA systematic search was performed according to the PRISMA guidelines. Studies were included if they investigated speed tests in adult soccer players and reported validity (construct and criterion) or reliability (intraday and interday) data. The tests were categorized into linear-sprint, repeated-sprint, change-of-direction sprint, agility, and tests incorporating combinations of these skills.ResultsIn total, 90 studies covering 167 tests were included. Linear-sprint (n = 67) and change-of-direction sprint (n = 60) were studied most often, followed by combinations of the aforementioned (n = 21) and repeated-sprint tests (n = 15). Agility tests were examined fewest (n = 4). Mainly based on construct validity studies, acceptable validity was reported for the majority of the tests in all categories, except for agility tests, where no validity study was identified. Regarding intraday and interday reliability, ICCs>0.75 and CVs<3.0% were evident for most of the tests in all categories. These results applied for total and average times. In contrast, measures representing fatigue such as percent decrement scores indicated inconsistent validity findings. Regarding reliability, ICCs were 0.11-0.49 and CVs were 16.8-51.0%.ConclusionExcept for agility tests, several tests for all categories with acceptable levels of validity and high levels of reliability for adult soccer players are available. Caution should be given when interpreting fatigue measures, e.g., percent decrement scores. Given the lack of accepted gold-standard tests for each category, researchers and practitioners may base their test selection on the broad database provided in this systematic review. Future research should pay attention to the criterion validity examining the relationship between test results and match parameters as well as to the development and evaluation of soccer-specific agility tests.

Project description:IntroductionClinicians rely on certain physical examination tests to diagnose and potentially grade ankle sprains and ankle instability. Diagnostic error and inaccurate prognosis may have important repercussions for clinical decision-making and patient outcomes. Therefore, it is important to recognize the diagnostic value of orthopaedic tests through understanding the reliability and validity of these tests.ObjectiveTo systematically review and report evidence on the reliability and validity of orthopaedic tests for the diagnosis of ankle sprains and instability.MethodsPubMed, CINAHL, Scopus, and Cochrane databases were searched from inception to December 2021. In addition, the reference list of included studies, located systematic reviews, and orthopaedic textbooks were searched. All articles reporting reliability or validity of physical examination or orthopaedic tests to diagnose ankle instability or sprains were included. Methodological quality of the reliability and the validity studies was assessed with The Quality Appraisal for Reliability studies checklist and the Quality Assessment of Diagnostic Accuracy Studies-2 respectively. We identified the number of times the orthopaedic test was investigated and the validity and/or reliability of each test.ResultsOverall, sixteen studies were included. Three studies assessed reliability, eight assessed validity, and five evaluated both. Overall, fifteen tests were evaluated, none demonstrated robust reliability and validity scores. The anterolateral talar palpation test reported the highest diagnostic accuracy. Further, the anterior drawer test, the anterolateral talar palpation, the reverse anterior lateral drawer test, and palpation of the anterior talofibular ligament reported the highest sensitivity. The highest specificity was attributed to the anterior drawer test, the anterolateral drawer test, the reverse anterior lateral drawer test, tenderness on palpation of the proximal fibular, and the squeeze test.ConclusionOverall, the diagnostic accuracy, reliability, and validity of physical examination tests for the assessment of ankle instability were limited. Physical examination tests should not be used in isolation, but rather in combination with the clinical history to diagnose an ankle sprain. Preliminary evidence suggests that the overall validity of physical examination for the ankle may be better if conducted five days after the injury rather than within 48 h of injury.

Project description:BACKGROUND.:Cognitive impairment associated with lifetime major depressive disorder (MDD) is well-supported by meta-analytic studies, but population-based estimates remain scarce. Previous UK Biobank studies have only shown limited evidence of cognitive differences related to probable MDD. Using updated cognitive and clinical assessments in UK Biobank, this study investigated population-level differences in cognitive functioning associated with lifetime MDD. METHODS.:Associations between lifetime MDD and cognition (performance on six tasks and general cognitive functioning [g-factor]) were investigated in UK Biobank (N-range 7,457-14,836, age 45-81 years, 52% female), adjusting for demographics, education, and lifestyle. Lifetime MDD classifications were based on the Composite International Diagnostic Interview. Within the lifetime MDD group, we additionally investigated relationships between cognition and (a) recurrence, (b) current symptoms, (c) severity of psychosocial impairment (while symptomatic), and (d) concurrent psychotropic medication use. RESULTS.:Lifetime MDD was robustly associated with a lower g-factor (? = -0.10, PFDR = 4.7 × 10-5), with impairments in attention, processing speed, and executive functioning (? ? 0.06). Clinical characteristics revealed differential profiles of cognitive impairment among case individuals; those who reported severe psychosocial impairment and use of psychotropic medication performed worse on cognitive tests. Severe psychosocial impairment and reasoning showed the strongest association (? = -0.18, PFDR = 7.5 × 10-5). CONCLUSIONS.:Findings describe small but robust associations between lifetime MDD and lower cognitive performance within a population-based sample. Overall effects were of modest effect size, suggesting limited clinical relevance. However, deficits within specific cognitive domains were more pronounced in relation to clinical characteristics, particularly severe psychosocial impairment.

Project description:ImportanceFrontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD.ObjectiveTo evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations.Design, setting, and participantsIn this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)-based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes.ExposureParticipants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests.Main outcomes and measuresInternal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy.ResultsIn the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity (r range, 0.38-0.59), criterion-standard neuropsychological tests (r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) (z of comparison, -2.49 [95% CI, -0.19 to -0.02]; P = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32).Conclusions and relevanceThe findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.

Dataset Information

Reliability and validity of the UK Biobank cognitive tests.

Publications

Reliability and validity of the UK Biobank cognitive tests.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets