Dataset Information

A Rasch Model and Rating System for Continuous Responses Collected in Large-Scale Learning Systems.

ABSTRACT: An extension to a rating system for tracking the evolution of parameters over time using continuous variables is introduced. The proposed rating system assumes a distribution for the continuous responses, which is agnostic to the origin of the continuous scores and thus can be used for applications as varied as continuous scores obtained from language testing to scores derived from accuracy and response time from elementary arithmetic learning systems. Large-scale, high-stakes, online, anywhere anytime learning and testing inherently comes with a number of unique problems that require new psychometric solutions. These include (1) the cold start problem, (2) problem of change, and (3) the problem of personalization and adaptation. We outline how our proposed method addresses each of these problems. Three simulations are carried out to demonstrate the utility of the proposed rating system.

SUBMITTER: Deonovic B

PROVIDER: S-EPMC7775507 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Rasch Model and Rating System for Continuous Responses Collected in Large-Scale Learning Systems.

Deonovic Benjamin B Bolsinova Maria M Bechger Timo T Maris Gunter G

Frontiers in psychology 20201218

An extension to a rating system for tracking the evolution of parameters over time using continuous variables is introduced. The proposed rating system assumes a distribution for the continuous responses, which is agnostic to the origin of the continuous scores and thus can be used for applications as varied as continuous scores obtained from language testing to scores derived from accuracy and response time from elementary arithmetic learning systems. Large-scale, high-stakes, online, anywhere ...[more]

PMID: 33391063

Similar Datasets

Project description:BackgroundAntepartum activity restriction (AAR) is a common recommendation given to women at risk for preterm delivery. However, such treatment has been shown to cause heavy emotional burdens on the women receiving it since it requires them to face many challenges derived from the intervention. Nevertheless, current existing scales lack effective items that can reflect the distress of these women. The aim of this study was to develop a reliable instrument to assess the distress of women experiencing AAR.MethodThe Prenatal Activity Restriction Stress Questionnaire (PARSQ) was developed according to comprehensive literature review, women's interviews, and existing pregnancy-special stress scales from August 2016 to July 2017 in southern Taiwan. Six experts evaluated its content validity; the Rasch rating scale model (RSM) was used to examine its item-fit, dimensionality, and reliability with 200 women with AAR experience. Furthermore, the concurrent validity was assessed through computing the correlation of AAR women's scores on the PARSQ and Perceived Stress Scale (PSS), and discriminant validity of the PARSQ was assessed to compare the scores' differences between the AAR women and the healthy pregnant women.ResultsThe PARSQ was constructed with 23 items in the 4-dimensional scale: Role function changes (8 items), Fetal safety and health (5 items), Physical and psychological care issues (5 items), and Socioeconomic and medical issues (5 items). It was confirmed to have satisfactory content vitality (CVI = 0.78 to 1.0), reasonable item-fit (0.77 to 1.51), and good reliability in RSM model, as well as adequate concurrent validity (p = 0.005) and discriminant validity (p < 0.001).ConclusionsUnderstanding the distress of women undergoing AAR is necessary for developing appropriate prenatal care to assist women in coping with their situation to alleviate their emotional burdens. The developed PARSQ with satisfied psychometric properties can be an informative instrument for clinicians/researchers to assess the specific stress of pregnant women with AAR.

Project description:Many contemporary neuroscience experiments utilize high-throughput approaches to simultaneously collect behavioural data from many animals. The resulting data are often complex in structure and are subjected to systematic biases, which require new approaches for analysis and normalization. This study addressed the normalization need by establishing an approach based on linear-regression modeling. The model was established using a dataset of visual motor response (VMR) obtained from several strains of wild-type (WT) zebrafish collected at multiple stages of development. The VMR is a locomotor response triggered by drastic light change, and is commonly measured repeatedly from multiple larvae arrayed in 96-well plates. This assay is subjected to several systematic variations. For example, the light emitted by the machine varies slightly from well to well. In addition to the light-intensity variation, biological replication also created batch-batch variation. These systematic variations may result in differences in the VMR and must be normalized. Our normalization approach explicitly modeled the effect of these systematic variations on VMR. It also normalized the activity profiles of different conditions to a common baseline. Our approach is versatile, as it can incorporate different normalization needs as separate factors. The versatility was demonstrated by an integrated normalization of three factors: light-intensity variation, batch-batch variation and baseline. After normalization, new biological insights were revealed from the data. For example, we found larvae of TL strain at 6 days post-fertilization (dpf) responded to light onset much stronger than the 9-dpf larvae, whereas previous analysis without normalization shows that their responses were relatively comparable. By removing systematic variations, our model-based normalization can facilitate downstream statistical comparisons and aid detecting true biological differences in high-throughput studies of neurobehaviour.

Project description:This study aimed to empirically evaluate the hierarchical structure of the Coma Recovery Scale-Revised (CRS-R) rating scale categories and their alignment with the Aspen consensus criteria for determining disorders of consciousness (DoC) following a severe brain injury. CRS-R data from 262 patients with DoC following a severe brain injury were analyzed applying the partial credit Rasch Measurement Model. Rasch Analysis produced logit calibrations for each rating scale category. Twenty-eight of the 29 CRS-R rating scale categories were operationalized to the Aspen consensus criteria. We expected the hierarchical order of the calibrations to reflect Aspen consensus criteria. We also examined the association between the CRS-R Rasch person measures (indicative of performance ability) and states of consciousness as determined by the Aspen consensus criteria. Overall, the order of the 29 rating scale category calibrations reflected current literature regarding the continuum of neurobehavioral function: category 6 "Functional Object Use" of the Motor item was hardest for patients to achieve; category 0 "None" of the Oromotor/Verbal item was easiest to achieve. Of the 29 rating scale categories, six were not ordered as expected. Four rating scale categories reflecting the Vegetative State (VS)/Unresponsive Wakefulness Syndrome (UWS) had higher calibrations (reflecting greater neurobehavioral function) than the easiest Minimally Conscious State (MCS) item (category 2 "Fixation" of the Visual item). Two rating scale categories, one reflecting MCS and one not operationalized to the Aspen consensus criteria, had higher calibrations than the easiest eMCS item (category 2 "Functional: Accurate" of the Communication item). CRS-R person measures (indicating amount of neurobehavioral function) and states of consciousness, based on Aspen consensus criteria, showed a strong correlation (rs = 0.86; p < 0.01). Our study provides empirical evidence for revising the diagnostic criteria for MCS to also include category 2 "Localization to Sound" of the Auditory item and for Emerged from Minimally Conscious State (eMCS) to include category 4 "Consistent Movement to Command" of the Auditory item.

Dataset Information

A Rasch Model and Rating System for Continuous Responses Collected in Large-Scale Learning Systems.

Publications

A Rasch Model and Rating System for Continuous Responses Collected in Large-Scale Learning Systems.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets