Dataset Information

Role of test motivation in intelligence testing.

ABSTRACT: Intelligence tests are widely assumed to measure maximal intellectual performance, and predictive associations between intelligence quotient (IQ) scores and later-life outcomes are typically interpreted as unbiased estimates of the effect of intellectual ability on academic, professional, and social life outcomes. The current investigation critically examines these assumptions and finds evidence against both. First, we examined whether motivation is less than maximal on intelligence tests administered in the context of low-stakes research situations. Specifically, we completed a meta-analysis of random-assignment experiments testing the effects of material incentives on intelligence-test performance on a collective 2,008 participants. Incentives increased IQ scores by an average of 0.64 SD, with larger effects for individuals with lower baseline IQ scores. Second, we tested whether individual differences in motivation during IQ testing can spuriously inflate the predictive validity of intelligence for life outcomes. Trained observers rated test motivation among 251 adolescent boys completing intelligence tests using a 15-min "thin-slice" video sample. IQ score predicted life outcomes, including academic performance in adolescence and criminal convictions, employment, and years of education in early adulthood. After adjusting for the influence of test motivation, however, the predictive validity of intelligence for life outcomes was significantly diminished, particularly for nonacademic outcomes. Collectively, our findings suggest that, under low-stakes research conditions, some individuals try harder than others, and, in this context, test motivation can act as a third-variable confound that inflates estimates of the predictive validity of intelligence for life outcomes.

SUBMITTER: Duckworth AL

PROVIDER: S-EPMC3093513 | biostudies-literature | 2011 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Role of test motivation in intelligence testing.

Duckworth Angela Lee AL Quinn Patrick D PD Lynam Donald R DR Loeber Rolf R Stouthamer-Loeber Magda M

Proceedings of the National Academy of Sciences of the United States of America 20110425 19

Intelligence tests are widely assumed to measure maximal intellectual performance, and predictive associations between intelligence quotient (IQ) scores and later-life outcomes are typically interpreted as unbiased estimates of the effect of intellectual ability on academic, professional, and social life outcomes. The current investigation critically examines these assumptions and finds evidence against both. First, we examined whether motivation is less than maximal on intelligence tests admini ...[more]

PMID: 21518867

Similar Datasets

Project description:BackgroundA number of factors have been demonstrated to be associated with Problematic Internet Use (PIU); otherwise known as Internet Addiction), which is mostly concerned with psychological problems such as loneliness. This study aimed to examine how and in what way loneliness influenced PIU.MethodsA self-report measurement on loneliness, the Internet addiction test (IAT) and instruments on interpersonal problems were administered to 318 medical students (57% females); mean age totaled 20.88 years (SD = 1.8). We performed a mediation analysis to evaluate direct effects of loneliness on IAT, as well as indirect effects mediated by interpersonal problems. In addition, motivation for internet use was added to the mediation model and tested whether it acted as the second mediator (serial mediation model) or a moderator (moderated mediation model).ResultsAfter controlling for sex and age, socially inhibited problems exhibited full mediation whereas the remainder showed partial mediation effects, with the exception that intrusive and cold interpersonal problems indicated no mediating role. Negative motivation and motivation for being accepted had mediation effects for all types of interpersonal problems. Motivation for working was found to be a significant mediator and moderator of the most interpersonal problems. Intrusive and cold styles became a mediator only when some motivation variables were added to the model, implying that not only psychological problems should be included when analyzing PIU, but also other variables such motivation for internet use. The percent of variance explained, by IAT score, increased from 13% in the mediation model to 33% by the moderated mediation model, and 43% using the serial mediation model.ConclusionThe study suggested the crucial role of loneliness and interpersonal problems on PIU, for which motivation for internet use explained how each interpersonal problem would be associated. This may provide some insight regarding the pathological characteristics of those using the internet as a coping strategy.

Project description:Different types of tasks exist, including tasks for research purposes or exams assessing knowledge. According to expectation-value theory, tests are related to different levels of effort and importance within a test taker. Test-taking effort and importance in students decreased over the course of high-stakes tests or low-stakes-tests in research on test-taking motivation. However, whether test-order changes affect effort, importance, and response processes of education students have seldomly been experimentally examined. We aimed to examine changes in effort and importance resulting from variations in test battery order and their relations to response processes. We employed an experimental design assessing N = 320 education students' test-taking effort and importance three times as well as their performance on cognitive ability tasks and a mock exam. Further relevant covariates were assessed once such as expectancies, test anxiety, and concentration. We randomly varied the order of the cognitive ability test and mock exam. The assumption of intraindividual changes in education students' effort and importance over the course of test taking was tested by one latent growth curve that separated data for each condition. In contrast to previous studies, responses and test response times were included in diffusion models for examining education students' response processes within the test-taking context. The results indicated intraindividual changes in education students' effort or importance depending on test order but similar mock-exam response processes. In particular effort did not decrease, when the cognitive ability test came first and the mock exam subsequently but significantly decreased, when the mock exam came first and the cognitive ability test subsequently. Diffusion modeling suggested differences in response processes (separation boundaries and estimated latent trait) on cognitive ability tasks suggesting higher motivational levels when the cognitive ability test came first than vice versa. The response processes on the mock exam tasks did not relate to condition.

Dataset Information

Role of test motivation in intelligence testing.

Publications

Role of test motivation in intelligence testing.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets