Dataset Information

Testing Students with Special Educational Needs in Large-Scale Assessments - Psychometric Properties of Test Scores and Associations with Test Taking Behavior.

ABSTRACT: Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are-at the same time-measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometric quality may be obtained with tests available in LSAs. We furthermore investigated whether differences in test-taking behavior may explain dissatisfying psychometric properties and measurement non-invariance of test scores within LSAs. We relied on person fit indices and mixture distribution models to identify students with SEN-L for whom test scores with satisfactory psychometric properties and measurement invariance may be obtained. We also captured differences in test-taking behavior related to guessing and missing responses. As a result we identified a subgroup of students with SEN-L for whom competence scores of adequate psychometric quality that are measurement invariant to those of general education students were obtained. Concerning test taking behavior, there was a small number of students who unsystematically picked response options. Removing these students from the sample slightly improved item fit. Furthermore, two different patterns of missing responses were identified that explain to some extent problems in the assessments of students with SEN-L.

SUBMITTER: Pohl S

PROVIDER: S-EPMC4763047 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Testing Students with Special Educational Needs in Large-Scale Assessments - Psychometric Properties of Test Scores and Associations with Test Taking Behavior.

Pohl Steffi S Südkamp Anna A Hardt Katinka K Carstensen Claus H CH Weinert Sabine S

Frontiers in psychology 20160223

Assessing competencies of students with special educational needs in learning (SEN-L) poses a challenge for large-scale assessments (LSAs). For students with SEN-L, the available competence tests may fail to yield test scores of high psychometric quality, which are-at the same time-measurement invariant to test scores of general education students. We investigated whether we can identify a subgroup of students with SEN-L, for which measurement invariant competence measures of adequate psychometr ...[more]

PMID: 26941665

Similar Datasets

Project description:Interactive apps delivered on touch-screen tablets can be effective at supporting the acquisition of basic skills in mainstream primary school children. This technology may also be beneficial for children with Special Educational Needs and Disabilities (SEND) as it can promote high levels of engagement with the learning task and an inclusive learning environment. However, few studies have measured extent of learning for SEND pupils when using interactive apps, so it has yet to be determined if this technology is effective at raising attainment for these pupils. We report the first observational study of a group of 33 pupils with SEND from two primary schools in Malawi that are implementing a new digital technology intervention which uses touch-screen tablets to deliver interactive apps designed to teach basic mathematical skills. The apps contain topics that align to the national curriculum. To assess learning gains, rate of progress (minutes per topic) for each pupil was determined by calculating the average time taken to complete a topic. Progress rate was then correlated with teacher ratings of extent of disability and independent ratings of pupil engagement with the apps. Results showed SEND pupils could interact with the apps and all pupils passed at least one topic. Average progress rate for SEND pupils was twice as long as mainstream peers. Stepwise regression revealed extent of disability significantly predicted progress rate. Further exploratory correlations revealed pupils with moderate to severe difficulties with hearing and/or language made slower progress through the apps than those with greater functionality in these two domains because the use of verbal instructions within the apps limited their capacity to learn. This original quantitative analysis demonstrates that interactive apps can raise learning standards in pupils with SEND but may have limited utility for pupils with severe difficulties. Software modifications are needed to address specific areas of difficulty preventing pupils from progressing.

Project description:One current challenge in the psychology of education is identifying the teaching strategies and learning contexts that best contribute to the learning of all students, especially those whose individual characteristics make their learning process more difficult, as is the case for students with special needs. One main theory in the psychology of education is the sociocultural approach to learning, which highlights the key role of interaction in children's learning. In the case of students with disabilities, this interactive understanding of learning is aligned with a social model of disability, which looks beyond individual students' limitations or potentialities and focuses on contextual aspects that can enhance their learning experience and results. In recent years, the interactive view of learning based on this theory has led to the development of educational actions, such as interactive groups and dialogic literary gatherings, that have improved the learning results of diverse children, including those with disabilities. The aim of this paper is to analyze the social impact achieved by a line of research that has explored the benefits of such successful educational actions for the education of students with special needs. National and European research projects based on the communicative methodology of research have been conducted. This methodology entails drawing on egalitarian dialogue with the end-users of research - including teachers, students with and without disabilities, students' relatives and other community members - to allow an intersubjective creation of knowledge that enables a deeper and more accurate understanding of the studied reality and its transformative potential. This line of research first allowed the identification of the benefits of interactive learning environments for students with disabilities educated in mainstream schools; later, it allowed the spreading of these actions to a greater number of mainstream schools; and more recently, it made it possible to transfer these actions to special schools and use these actions to create shared learning spaces between mainstream and special schools. The improvement of the educational opportunities for a greater number and greater diversity of students with special needs evidences the social impact of research based on key contributions of the psychology of education.

Project description:Different types of tasks exist, including tasks for research purposes or exams assessing knowledge. According to expectation-value theory, tests are related to different levels of effort and importance within a test taker. Test-taking effort and importance in students decreased over the course of high-stakes tests or low-stakes-tests in research on test-taking motivation. However, whether test-order changes affect effort, importance, and response processes of education students have seldomly been experimentally examined. We aimed to examine changes in effort and importance resulting from variations in test battery order and their relations to response processes. We employed an experimental design assessing N = 320 education students' test-taking effort and importance three times as well as their performance on cognitive ability tasks and a mock exam. Further relevant covariates were assessed once such as expectancies, test anxiety, and concentration. We randomly varied the order of the cognitive ability test and mock exam. The assumption of intraindividual changes in education students' effort and importance over the course of test taking was tested by one latent growth curve that separated data for each condition. In contrast to previous studies, responses and test response times were included in diffusion models for examining education students' response processes within the test-taking context. The results indicated intraindividual changes in education students' effort or importance depending on test order but similar mock-exam response processes. In particular effort did not decrease, when the cognitive ability test came first and the mock exam subsequently but significantly decreased, when the mock exam came first and the cognitive ability test subsequently. Diffusion modeling suggested differences in response processes (separation boundaries and estimated latent trait) on cognitive ability tasks suggesting higher motivational levels when the cognitive ability test came first than vice versa. The response processes on the mock exam tasks did not relate to condition.

Dataset Information

Testing Students with Special Educational Needs in Large-Scale Assessments - Psychometric Properties of Test Scores and Associations with Test Taking Behavior.

Publications

Testing Students with Special Educational Needs in Large-Scale Assessments - Psychometric Properties of Test Scores and Associations with Test Taking Behavior.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets