Unknown

Dataset Information

0

Examining the Impacts of Rater Effects in Performance Assessments.


ABSTRACT: Rater effects such as severity, centrality, and misfit are recurrent concerns in performance assessments. Despite their persistence in operational assessment settings and frequent discussion in research, researchers have not fully explored the impacts of rater effects as they relate to estimates of student achievement. The purpose of this study is to explore the impacts of rater severity, centrality, and misfit on student achievement estimates and on classification decisions. The results suggest that these three types of rater effects have substantial impacts on estimates of student achievement and on classification decisions that impact the fairness of rater-mediated assessments. Accordingly, it is essential that researchers and practitioners evaluate ratings across all stages of rater-mediated assessment procedures, including rater training and operational scoring.

SUBMITTER: Wind SA 

PROVIDER: S-EPMC6376535 | biostudies-literature | 2019 Mar

REPOSITORIES: biostudies-literature

altmetric image

Publications

Examining the Impacts of Rater Effects in Performance Assessments.

Wind Stefanie A SA  

Applied psychological measurement 20180805 2


Rater effects such as severity, centrality, and misfit are recurrent concerns in performance assessments. Despite their persistence in operational assessment settings and frequent discussion in research, researchers have not fully explored the impacts of rater effects as they relate to estimates of student achievement. The purpose of this study is to explore the impacts of rater severity, centrality, and misfit on student achievement estimates and on classification decisions. The results suggest  ...[more]

Similar Datasets

| S-EPMC6464413 | biostudies-literature
| S-EPMC6752840 | biostudies-literature
| S-EPMC6330301 | biostudies-literature
| S-EPMC7878944 | biostudies-literature
| S-EPMC3873077 | biostudies-literature
| S-EPMC5990009 | biostudies-literature
| S-EPMC7418198 | biostudies-literature
| S-EPMC9936142 | biostudies-literature
| S-EPMC5978607 | biostudies-literature
| S-EPMC3943796 | biostudies-other