Dataset Information

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT.

ABSTRACT: Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particularly when comparing correlations in different populations. Second, we demonstrate the importance of variability and reliability for evaluating potential failures to replicate predicted correlations, even within the same population. Third, we demonstrate how researchers can turn to evaluating psychometric properties as a way of evaluating the feasibility of utilizing the task in new settings (e.g., online administration). Lastly, we show how the examination of psychometric properties can help researchers make informed decisions when designing a study, such as determining the appropriate number of trials for a task.

SUBMITTER: Cooper SR

PROVIDER: S-EPMC5591582 | biostudies-literature | 2017

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT.

Cooper Shelly R SR Gonthier Corentin C Barch Deanna M DM Braver Todd S TS

Frontiers in psychology 20170904

Investigating individual differences in cognition requires addressing questions not often thought about in standard experimental designs, especially regarding the psychometric properties of the task. Using the AX-CPT cognitive control task as a case study example, we address four concerns that one may encounter when researching the topic of individual differences in cognition. First, we demonstrate the importance of variability in task scores, which in turn directly impacts reliability, particul ...[more]

PMID: 28928690

Similar Datasets

Project description:BackgroundSocial media platforms, such as Twitter, are increasingly popular among communities of people with chronic conditions, including those with type 1 diabetes (T1D). There is some evidence that social media confers emotional and health-related benefits to people with T1D, including emotional support and practical information regarding health maintenance. Research on social media has primarily relied on self-reports of web-based behavior and qualitative assessment of web-based content, which can be expensive and time-consuming. Meanwhile, recent advances in natural language processing have allowed for large-scale assessment of social media behavior.ObjectiveThis study attempts to document the major themes of Twitter posts using a natural language processing method to identify topics of interest in the T1D web-based community. We also seek to map social relations on Twitter as they relate to these topics of interest, to determine whether Twitter users in the T1D community post in "echo chambers," which reflect their own topics back to them, or whether users typically see a mix of topics on the internet.MethodsThrough Twitter scraping, we gathered a data set of 691,691 tweets from 8557 accounts, spanning a date range from 2008 to 2020, which includes people with T1D, their caregivers, health practitioners, and advocates. Tweet content was analyzed for sentiment and topic, using Latent Dirichlet Allocation. We used social network analysis to examine the degree to which identified topics are siloed within specific groups or disseminated through the broader T1D web-based community.ResultsTweets were, on average, positive in sentiment. Through topic modeling, we identified 6 broad-bandwidth topics, ranging from clinical to advocacy to daily management to emotional health, which can inform researchers and practitioners interested in the needs of people with T1D. These analyses also replicate prior work using machine learning methods to map social behavior on the internet. We extend these results through social network analysis, indicating that users are likely to see a mix of these topics discussed by the accounts they follow.ConclusionsTwitter communities are sources of information for people with T1D and members related to that community. Topics identified reveal key concerns of the T1D community and may be useful to practitioners and researchers alike. The methods used are efficient (low cost) while providing researchers with enormous amounts of data. We provide code to facilitate the use of these methods with other populations.

Project description:Resting-state connectivity measures the temporal coherence of the spontaneous neural activity of spatially distinct regions, and is commonly measured using BOLD-fMRI. The BOLD response follows neuronal activity, when changes in the relative concentration of oxygenated and deoxygenated haemoglobin cause fluctuations in the MRI T2* signal. Since the BOLD signal detects changes in relative concentrations of oxy/deoxy-haemoglobin, individual differences in haemoglobin levels may influence the BOLD signal-to-noise ratio in a manner independent of the degree of neural activity. In this study, we examined whether group differences in haemoglobin may confound measures of functional connectivity. We investigated whether relationships between measures of functional connectivity and cognitive performance could be influenced by individual variability in haemoglobin. Finally, we mapped the neuroanatomical distribution of the influence of haemoglobin on functional connectivity to determine where group differences in functional connectivity are manifest. In a cohort of 518 healthy elderly subjects (259 men), each sex group was median-split into two groups with high and low haemoglobin concentration. Significant differences were obtained in functional connectivity between the high and low haemoglobin groups for both men and women (Cohen's d 0.17 and 0.03 for men and women respectively). The haemoglobin connectome in males showed a widespread systematic increase in functional connectivity correlation values, whilst the female connectome showed predominantly parietal and subcortical increases and temporo-parietal decreases. Despite the haemoglobin groups having no differences in cognitive measures, significant differences in the linear relationships between cognitive performance and functional connectivity were obtained for all 5 cognitive tests in males, and 4 out of 5 tests in females. Our findings confirm that individual variability in haemoglobin levels that give rise to group differences are an important confounding variable in BOLD-fMRI-based studies of functional connectivity. Controlling for haemoglobin variability as a potentially confounding variable is crucial to ensure the reproducibility of human brain connectome studies, especially in studies that compare groups of individuals, compare sexes, or examine connectivity-cognition relationships.

Dataset Information

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT.

Publications

The Role of Psychometrics in Individual Differences Research in Cognition: A Case Study of the AX-CPT.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets