Dataset Information

Setting a standard for low reading proficiency: A comparison of the bookmark procedure and constrained mixture Rasch model.

ABSTRACT: In order to draw pertinent conclusions about persons with low reading skills, it is essential to use validated standard-setting procedures by which they can be assigned to their appropriate level of proficiency. Since there is no standard-setting procedure without weaknesses, external validity studies are essential. Traditionally, studies have assessed validity by comparing different judgement-based standard-setting procedures. Only a few studies have used model-based approaches for validating judgement-based procedures. The present study addressed this shortcoming and compared agreement of the cut score placement between a judgement-based approach (i.e., Bookmark procedure) and a model-based one (i.e., constrained mixture Rasch model). This was performed by differentiating between individuals with low reading proficiency and those with a functional level of reading proficiency in three independent samples of the German National Educational Panel Study that included students from the ninth grade (N = 13,897) as well as adults (Ns = 5,335 and 3,145). The analyses showed quite similar mean cut scores for the two standard-setting procedures in two of the samples, whereas the third sample showed more pronounced differences. Importantly, these findings demonstrate that model-based approaches provide a valid and resource-efficient alternative for external validation, although they can be sensitive to the ability distribution within a sample.

SUBMITTER: Feseker T

PROVIDER: S-EPMC8629253 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Similar Datasets

Project description:For normally sighted readers, word neighborhood size (i.e., the total number of words that can be formed from a single word by changing only one letter) has a facilitator effect on word recognition. When reading with central field loss (CFL) however, individual letters may not be correctly identified, leading to possible misidentifications and a reverse neighborhood size effect. Here we investigate this inhibitory effect of word neighborhood size on reading performance and whether it is modulated by word predictability and reading proficiency. Nineteen patients with binocular CFL from 32 to 89 years old (mean ± SD = 75 ± 15) read short sentences presented with the self-paced reading paradigm. Accuracy and reading time were measured for each target word read, along with its predictability, i.e., its probability of occurrence following the two preceding words in the sentence using a trigram analysis. Linear mixed effects models were then fit to estimate the individual contributions of word neighborhood size, predictability, frequency and length on accuracy and reading time, while taking patients' reading proficiency into account. For the less proficient readers, who have given up daily reading as a consequence of their visual impairment, we found that the effect of neighborhood size was reversed compared to normally sighted readers and of higher amplitude than the effect of frequency. Furthermore, this inhibitory effect is of greater amplitude (up to 50% decrease in reading speed) when a word is not easily predictable because its chances to occur after the two preceding words in a specific sentence are rather low. Severely impaired patients with CFL often quit reading on a daily basis because this task becomes simply too exhausting. Based on our results, we envision lexical text simplification as a new alternative to promote effective rehabilitation in these patients. By increasing reading accessibility for those who struggle the most, text simplification might be used as an efficient rehabilitation tool and daily reading assistive technology, fostering overall reading ability and fluency through increased practice.

Project description:Academic English is discipline-specific and requires a high level of linguistic knowledge as well as expertise in respective fields. Therefore, doctoral students with limited exposure to academic English tend to face challenges in dealing with its demands, especially when they come from non-native English-speaking (NNES) backgrounds. At the doctoral level, research students are expected to work independently. Therefore, the ability to critically engage with academic materials written in English and the ability to write a dissertation in English at an expected standard play essential roles in successful PhD completion for students studying in international PhD programs where everything is conducted in English. This study investigates the relationship between English academic reading (EAR) and English academic writing (EAW) abilities among NNES doctoral students. We conducted a survey by employing a 1-6 Likert scale, following Dörnyei and Dewaele (2022), in the 2021-2022 academic year. A total of 255 international doctoral students studying in 65 PhD programs across Hungary voluntarily participated in the study. The students came from 49 countries and represented 48 mother tongues. The analysis revealed that students were positive about their abilities in both EAR and EAW, even though there was a significant gender difference at the p < 0.01 level. Additionally, students with the highest English proficiency level (C2) were found to be the most confident about their EAR and EAW abilities. The most junior students from 1st-year PhD programs were less confident about their abilities compared to their peers from 2nd, 3rd, 4th-year PhD programs. The analysis showed a significantly positive correlation between EAR and EAW (r = 0.792, p < 0.001). This study highlighted the inseparable role of EAR in fulfilling doctoral requirements and submitting a dissertation within a contracted PhD time framework, indicating the importance of targeted language support in facilitating academic progression within PhD programs.

Dataset Information

Setting a standard for low reading proficiency: A comparison of the bookmark procedure and constrained mixture Rasch model.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets