Dataset Information

Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults.

ABSTRACT: Cognitive workload is increasingly recognized as an important determinant of performance in cognitive tests and daily life activities. Cognitive workload is a measure of physical and mental effort allocation to a task, which can be determined through self-report or physiological measures. However, the reliability and validity of these measures have not been established in older adults with a wide range of cognitive ability. The aim of this study was to establish the test-retest reliability of the National Aeronautics and Space Administration Task Load Index (NASA-TLX) and Index of Cognitive Activity (ICA), extracted from pupillary size. The convergent validity of these measures against event-related potentials (ERPs) was also investigated. A total of 38 individuals with scores on the Montreal Cognitive Assessment ranging between 17 and 30 completed a working memory test (n-back) with three levels of difficulty at baseline and at a two-week follow-up. The intraclass correlation coefficients (ICC) values of the NASA-TLX ranged between 0.71 and 0.81, demonstrating good to excellent reliability. The mean ICA scores showed fair to good reliability, with ICCs ranging between 0.56 and 0.73. The mean ICA and NASA-TLX scores showed significant and moderate correlations (Pearson's r ranging between 0.30 and 0.33) with the third positive peak of the ERP at the midline channels. We conclude that ICA and NASA-TLX are reliable measures of cognitive workload in older adults. Further research is needed in dissecting the subjective and objective constructs of cognitive workload.

SUBMITTER: Devos H

PROVIDER: S-EPMC7766152 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults.

Devos Hannes H Gustafson Kathleen K Ahmadnezhad Pedram P Liao Ke K Mahnken Jonathan D JD Brooks William M WM Burns Jeffrey M JM

Brain sciences 20201216 12

Cognitive workload is increasingly recognized as an important determinant of performance in cognitive tests and daily life activities. Cognitive workload is a measure of physical and mental effort allocation to a task, which can be determined through self-report or physiological measures. However, the reliability and validity of these measures have not been established in older adults with a wide range of cognitive ability. The aim of this study was to establish the test-retest reliability of th ...[more]

PMID: 33339224

Similar Datasets

Project description:BackgroundPatient monitoring is indispensable in any operating room to follow the patient's current health state based on measured physiological parameters. Reducing workload helps to free cognitive resources and thus influences human performance, which ultimately improves the quality of care. Among the many methods available to assess perceived workload, the National Aeronautics and Space Administration Task Load Index (NASA-TLX) provides the most widely accepted tool. However, only few studies have investigated the validity of the NASA-TLX in the health care sector.ObjectiveThis study aimed to validate a modified version of the raw NASA-TLX in patient monitoring tasks by investigating its correspondence with expected lower and higher workload situations and its robustness against nonworkload-related covariates. This defines criterion validity.MethodsIn this pooled analysis, we evaluated raw NASA-TLX scores collected after performing patient monitoring tasks in four different investigator-initiated, computer-based, prospective, multicenter studies. All of them were conducted in three hospitals with a high standard of care in central Europe. In these already published studies, we compared conventional patient monitoring with two newly developed situation awareness-oriented monitoring technologies called Visual Patient and Visual Clot. The participants were resident and staff anesthesia and intensive care physicians, and nurse anesthetists with completed specialization qualification. We analyzed the raw NASA-TLX scores by fitting mixed linear regression models and univariate models with different covariates.ResultsWe assessed a total of 1160 raw NASA-TLX questionnaires after performing specific patient monitoring tasks. Good test performance and higher self-rated diagnostic confidence correlated significantly with lower raw NASA-TLX scores and the subscores (all P<.001). Staff physicians rated significantly lower workload scores than residents (P=.001), whereas nurse anesthetists did not show any difference in the same comparison (P=.83). Standardized distraction resulted in higher rated total raw NASA-TLX scores (P<.001) and subscores. There was no gender difference regarding perceived workload (P=.26). The new visualization technologies Visual Patient and Visual Clot resulted in significantly lower total raw NASA-TLX scores and all subscores, including high self-rated performance, when compared with conventional monitoring (all P<.001).ConclusionsThis study validated a modified raw NASA-TLX questionnaire for patient monitoring tasks. The scores obtained correctly represented the assumed influences of the examined covariates on the perceived workload. We reported high criterion validity. The NASA-TLX questionnaire appears to be a reliable tool for measuring subjective workload. Further research should focus on its applicability in a clinical setting.

Project description:AimsOccupational Burnout (OB) is currently measured through several Patient-Reported Outcome Measures (PROMs) and some of them have become widely used in occupational health research and practice. We, therefore, aimed to review and grade the psychometric validity of the five OB PROMs considered as valid for OB measure in mental health professionals (the Maslach Burnout Inventory (MBI), the Pines' Burnout Measure (BM), the Psychologist Burnout Inventory (PBI), the OLdenburg Burnout Inventory (OLBI) and the Copenhagen Burnout Inventory (CBI)).MethodsWe conducted systematic literature searches in MEDLINE, PsycINFO and EMBASE databases. We reviewed studies published between January 1980 and September 2018 following a methodological framework, in which each step of PROM validation, the reference method, analytical technics and result interpretation criteria were assessed. Using the COnsensus-based Standards for the selection of health Measurement Instruments we evaluated the risk of bias in studies assessing content and criterion validity, structural validity, internal consistency, reliability, measurement error, hypotheses testing and responsiveness of each PROM. Finally, we assessed the level of evidence for the validity of each PROM using the GRADE approach.ResultsWe identified 6541 studies, 19 of which were included for review. Fifteen studies dealt with MBI whereas BM, PBI, OLBI and CBI were each examined in only one study. OLBI had the most complete validation, followed by CBI, MBI, BM and PBI, respectively. When examining the result interpretation correctness, the strongest disagreement was observed for MBI (27% of results), BM (25%) and CBI (17%). There was no disagreement regarding PBI and OLBI. For OLBI and CBI, the quality of evidence for sufficient content validity, the crucial psychometric property, was moderate; for MBI, BM and PBI, it was very low.ConclusionTo be validly and reliably used in medical research and practice, PROM should exhibit robust psychometric properties. Among the five PROMs reviewed, CBI and, to a lesser extent, OLBI meet this prerequisite. The cross-cultural validity of these PROMs was beyond the scope of our work and should be addressed in the future. Moreover, the development of a diagnostic standard for OB would be helpful to assess the sensitivity and specificity of the PROMs and further reexamine their validity.The study protocol was registered in PROSPERO (CRD 42019124621).

Project description:BackgroundThe association between body mass index (BMI) and the risk of cognitive impairment remains uncertain. Relatively few studies have analyzed the dose-response relationship between BMI and cognitive impairment. This article utilized nationally representative longitudinal data to assess the association between BMI and cognitive impairment in Chinese older adults.ObjectiveThe present study aimed to analyze the association between BMI and cognitive impairment in Chinese older people, including an investigation of gender differences and the dose-response relationship.MethodsData were obtained from the China Health and Retirement Longitudinal Study database in 2015 and 2018. The present study used logistic regression to analyze the relationship between baseline BMI and cognitive impairment, and adopted a restricted cubic spline model to plot dose-response curves for baseline BMI and prevalence of risk of cognitive impairment.ResultsThe mean BMI of the survey population was 23.48 ± 3.66 kg/m2, and the detection rate of cognitive impairment was 34.2%. Compared to the normal weight group (18.5 ≤ BMI < 23.9 kg/m2), the odds ratio (OR) for cognitive impairment was 1.473 (95% CI: 1.189-1.823) in the underweight group (BMI < 18.5 kg/m2), whereas the corresponding OR was 0.874 (95% CI: 0.776-0.985) for the overweight or obese group (BMI ≥ 24.0 kg/m2) after adjusting for confounders. Gender subgroup analysis showed that overweight or obese older women were less likely to develop cognitive impairment (OR = 0.843; 95% CI: 0.720-0.987). The results of the restricted cubic spline analysis revealed a curvilinear L-shaped relationship between BMI and the risk of cognitive impairment (P non-linearity <0.05). In particular, the risk of cognitive impairment was higher at a lower baseline BMI. In contrast, BMI in the range of 23.2-27.8 kg/m2 was associated with a decreased risk of cognitive impairment.ConclusionBMI is a dose-dependent related factor for cognitive impairment in Chinese older adults. Being underweight is a risk factor for the development of cognitive impairment, while being overweight or obese is less likely to have cognitive impairment, particularly in female older people. Keeping BMI ranging from 23.2-27.8 kg/m2 in older adults can help maintain cognitive function.

Project description:BackgroundThe management of people living with HIV and AIDS is multidimensional and complex. Using patient-reported outcome measures (PROMs) has been increasingly recognized to be the key factor for providing patient-centered health care to meet the lifelong needs of people living with HIV and AIDS from diagnosis to death. However, there is currently no consensus on a PROM recommended for health care providers and researchers to assess health outcomes in people living with HIV and AIDS.ObjectiveThe purpose of this systematic review was to summarize and categorize the available validated HIV-specific PROMs in adults living with HIV and AIDS and to assess these PROMs using the Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN) methodology.MethodsThis systematic review followed the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. A literature search of 3 recommended databases (PubMed, Embase, and PsychINFO) was conducted on January 15, 2021. Studies were included if they assessed any psychometric property of HIV-specific PROMs in adults living with HIV and AIDS and met the eligibility criteria. The PROMs were assessed for 9 psychometric properties, evaluated in each included study following the COSMIN methodology by assessing the following: the methodological quality assessed using the COSMIN risk of bias checklist; overall rating of results; level of evidence assessed using the modified Grading of Recommendations, Assessment, Development, and Evaluation approach; and level of recommendation.ResultsA total of 88 PROMs classified into 8 categories, assessing the psychometric properties of PROMs for adults living with HIV and AIDS, were identified in 152 studies including 79,213 people living with HIV and AIDS. The psychometric properties of most included PROMs were rated with insufficient evidence. The PROMs that received class A recommendation were the Poz Quality of Life, HIV Symptom Index or Symptoms Distress Module of the Adult AIDS Clinical Trial Group, and People Living with HIV Resilience Scale. In addition, because of a lack of evidence, recommendations regarding use could not be made for most of the remaining assessed PROMs (received class B recommendation).ConclusionsThis systematic review recommends 3 PROMs to assess health outcomes in adults living with HIV and AIDS. However, all these PROMs have some shortcomings. In addition, most of the included PROMs do not have sufficient evidence for assessing their psychometric properties and require a more comprehensive validation of the psychometric properties in the future to provide more scientific evidence. Thus, our findings may provide a reference for the selection of high-quality HIV-specific PROMs by health care providers and researchers for clinical practice and research.

Dataset Information

Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults.

Publications

Psychometric Properties of NASA-TLX and Index of Cognitive Activity as Measures of Cognitive Workload in Older Adults.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets