Dataset Information

How Much g Is in the Distractor? Re-Thinking Item-Analysis of Multiple-Choice Items.

ABSTRACT: Distractors might display discriminatory power with respect to the construct of interest (e.g., intelligence), which was shown in recent applications of nested logit models to the short-form of Raven's progressive matrices and other reasoning tests. In this vein, a simulation study was carried out to examine two effect size measures (i.e., a variant of Cohen's ? and the canonical correlation RCC) for their potential to detect distractors with ability-related discriminatory power. The simulation design was adopted to item selection scenarios relying on rather small sample sizes (e.g., N = 100 or N = 200). Both suggested effect size measures (Cohen's ? only when based on two ability groups) yielded acceptable to conservative type-I-error rates, whereas, the canonical correlation outperformed Cohen's ? in terms of empirical power. The simulation results further suggest that an effect size threshold of 0.30 is more appropriate as compared to more lenient (0.10) or stricter thresholds (0.50). The suggested item-analysis procedure is illustrated with an analysis of twelve Raven's progressive matrices items in a sample of N = 499 participants. Finally, strategies for item selection for cognitive ability tests with the goal of scaling by means of nested logit models are discussed.

SUBMITTER: Forthmann B

PROVIDER: S-EPMC7151189 | biostudies-literature | 2020 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

How Much g Is in the Distractor? Re-Thinking Item-Analysis of Multiple-Choice Items.

Forthmann Boris B Förster Natalie N Schütze Birgit B Hebbecker Karin K Flessner Janis J Peters Martin T MT Souvignier Elmar E

Journal of Intelligence 20200309 1

Distractors might display discriminatory power with respect to the construct of interest (e.g., intelligence), which was shown in recent applications of nested logit models to the short-form of Raven's progressive matrices and other reasoning tests. In this vein, a simulation study was carried out to examine two effect size measures (i.e., a variant of Cohen's ω and the canonical correlation RCC) for their potential to detect distractors with ability-related discriminatory powe ...[more]

PMID: 32182841

Similar Datasets

Project description:Neurodegenerative diseases are among the leading causes of disability and death worldwide. The disease-related socioeconomic burden is expected to increase with the steadily increasing life expectancy. In spite of decades of clinical and basic research, most strategies designed to manage degenerative brain diseases are palliative. This is not surprising as neurodegeneration progresses "silently" for decades before symptoms are noticed. Importantly, conceptual models with heuristic value used to study neurodegeneration have been constructed retrospectively, based on signs and symptoms already present in affected patients; a circumstance that may confound causes and consequences. Hence, innovative, paradigm-shifting views of the etiology of these diseases are necessary to enable their timely prevention and treatment. Here, we outline four alternative views, not mutually exclusive, on different etiological paths toward neurodegeneration. First, we propose neurodegeneration as being a secondary outcome of a primary cardiovascular cause with vascular pathology disrupting the vital homeostatic interactions between the vasculature and the brain, resulting in cognitive impairment, dementia, and cerebrovascular events such as stroke. Second, we suggest that the persistence of senescent cells in neuronal circuits may favor, together with systemic metabolic diseases, neurodegeneration to occur. Third, we argue that neurodegeneration may start in response to altered body and brain trophic interactions established via the hardwire that connects peripheral targets with central neuronal structures or by means of extracellular vesicle (EV)-mediated communication. Lastly, we elaborate on how lifespan body dysbiosis may be linked to the origin of neurodegeneration. We highlight the existence of bacterial products that modulate the gut-brain axis causing neuroinflammation and neuronal dysfunction. As a concluding section, we end by recommending research avenues to investigate these etiological paths in the future. We think that this requires an integrated, interdisciplinary conceptual research approach based on the investigation of the multimodal aspects of physiology and pathophysiology. It involves utilizing proper conceptual models, experimental animal units, and identifying currently unused opportunities derived from human data. Overall, the proposed etiological paths and experimental recommendations will be important guidelines for future cross-discipline research to overcome the translational roadblock and to develop causative treatments for neurodegenerative diseases.

Dataset Information

How Much g Is in the Distractor? Re-Thinking Item-Analysis of Multiple-Choice Items.

Publications

How Much <i>g</i> Is in the Distractor? Re-Thinking Item-Analysis of Multiple-Choice Items.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets