Browse
Submit Data
Databases
API
Help

Dataset Information

32 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

A General Bayesian Multidimensional Item Response Theory Model for Small and Large Samples.

ABSTRACT: Although item response theory (IRT) models such as the bifactor, two-tier, and between-item-dimensionality IRT models have been devised to confirm complex dimensional structures in educational and psychological data, they can be challenging to use in practice. The reason is that these models are multidimensional IRT (MIRT) models and thus are highly parameterized, making them only suitable for data provided by large samples. Unfortunately, many educational and psychological studies are conducted on a small scale, leaving the researchers without the necessary MIRT models to confirm the hypothesized structures in their data. To address the lack of modeling options for these researchers, we present a general Bayesian MIRT model based on adaptive informative priors. Simulations demonstrated that our MIRT model could be used to confirm a two-tier structure (with two general and six specific dimensions), a bifactor structure (with one general and six specific dimensions), and a between-item six-dimensional structure in rating scale data representing sample sizes as small as 100. Although our goal was to provide a general MIRT model suitable for smaller samples, the simulations further revealed that our model was applicable to larger samples. We also analyzed real data from 121 individuals to illustrate that the findings of our simulations are relevant to real situations.

SUBMITTER: Fujimoto KA

PROVIDER: S-EPMC7307486 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

The Bayesian Multilevel Trifactor Item Response Theory Model.

Project description:Advancements in item response theory (IRT) have led to models for dual dependence, which control for cluster and method effects during a psychometric analysis. Currently, however, this class of models does not include one that controls for when the method effects stem from two method sources in which one source functions differently across the aspects of another source (i.e., a nested method-source interaction). For this study, then, a Bayesian IRT model is proposed, one that accounts for such interaction among method sources while controlling for the clustering of individuals within the sample. The proposed model accomplishes these tasks by specifying a multilevel trifactor structure for the latent trait space. Details of simulations are also reported. These simulations demonstrate that this model can identify when item response data represent a multilevel trifactor structure, and it does so in data from samples as small as 250 cases nested within 50 clusters. Additionally, the simulations show that misleading estimates for the item discriminations could arise when the trifactor structure reflected in the data is not correctly accounted for. The utility of the model is also illustrated through the analysis of empirical data.

| S-EPMC6506989 | biostudies-literature

A Bayesian Random Block Item Response Theory Model for Forced-Choice Formats.

Project description:Based on the framework of testlet models, the current study suggests the Bayesian random block item response theory (BRB IRT) model to fit forced-choice formats where an item block is composed of three or more items. To account for local dependence among items within a block, the BRB IRT model incorporated a random block effect into the response function and used a Markov Chain Monte Carlo procedure for simultaneous estimation of item and trait parameters. The simulation results demonstrated that the BRB IRT model performed well for the estimation of item and trait parameters and for screening those with relatively low scores on target traits. As found in the literature, the composition of item blocks was crucial for model performance; negatively keyed items were required for item blocks. The empirical application showed the performance of the BRB IRT model was equivalent to that of the Thurstonian IRT model. The potential advantage of the BRB IRT model as a base for more complex measurement models was also demonstrated by incorporating gender as a covariate into the BRB IRT model to explain response probabilities. Recommendations for the adoption of forced-choice formats were provided along with the discussion about using negatively keyed items.

| S-EPMC7221495 | biostudies-literature

Using multidimensional item response theory to evaluate how response styles impact measurement.

Project description:Multidimensional item response theory (MIRT) models for response style (e.g., Bolt, Lu, & Kim, 2014, Psychological Methods, 19, 528; Falk & Cai, 2016, Psychological Methods, 21, 328) provide flexibility in accommodating various response styles, but often present difficulty in isolating the effects of response style(s) from the intended substantive trait(s). In the presence of such measurement limitations, we consider several ways in which MIRT models are nevertheless useful in lending insight into how response styles may interfere with measurement for a given test instrument. Such a study can also inform whether alternative design considerations (e.g., anchoring vignettes, self-report items of heterogeneous content) that seek to control for response style effects may be helpful. We illustrate several aspects of an MIRT approach using real and simulated analyses.

| S-EPMC6765459 | biostudies-literature

Multidimensional Computerized Adaptive Testing Using Non-Compensatory Item Response Theory Models.

Project description:Current use of multidimensional computerized adaptive testing (MCAT) has been developed in conjunction with compensatory multidimensional item response theory (MIRT) models rather than with non-compensatory ones. In recognition of the usefulness of MCAT and the complications associated with non-compensatory data, this study aimed to develop MCAT algorithms using non-compensatory MIRT models and to evaluate their performance. For the purpose of the study, three item selection methods were adapted and compared, namely, the Fisher information method, the mutual information method, and the Kullback-Leibler information method. The results of a series of simulations showed that the Fisher information and mutual information methods performed similarly, and both outperformed the Kullback-Leibler information method. In addition, it was found that the more stringent the termination criterion and the higher the correlation between the latent traits, the higher the resulting measurement precision and test reliability. Test reliability was very similar across the dimensions, regardless of the correlation between the latent traits and termination criterion. On average, the difficulties of the administered items were found to be at a lower level than the examinees' abilities, which shed light on item bank construction for non-compensatory items.

| S-EPMC6696872 | biostudies-literature

Supervised Multidimensional Item Response Theory Modeling of Pediatric Iatrogenic Withdrawal Symptoms.

Project description:Item-level data from composite scales can be analyzed with pharmacometric item response theory (IRT) models to improve the quantification of disease severity compared with the use of total composite scores. However, regular IRT models assume unidimensionality, which is violated in the scale measuring iatrogenic withdrawal in children because some items are also affected by pain, undersedation, or delirium. Here, we compare regular IRT modelling of pediatric iatrogenic withdrawal symptom data with two new analysis approaches in which the latent variable is guided towards the condition of interest using numerical withdrawal severity scored by nurses as a "supervising variable:" supervised IRT (sIRT) and supervised multi-dimensional (smIRT) modelling. In this example, in which the items scores are affected by multiple conditions, regular IRT modeling is worse to quantify disease severity than the total composite score, whereas improved performance compared with the composite score is observed for the sIRT and smIRT models.

| S-EPMC6930857 | biostudies-literature

Parameter Recovery in Multidimensional Item Response Theory Models Under Complexity and Nonnormality.

Project description:Information about the psychometric properties of items can be highly useful in assessment development, for example, in item response theory (IRT) applications and computerized adaptive testing. Although literature on parameter recovery in unidimensional IRT abounds, less is known about parameter recovery in multidimensional IRT (MIRT), notably when tests exhibit complex structures or when latent traits are nonnormal. The current simulation study focuses on investigation of the effects of complex item structures and the shape of examinees' latent trait distributions on item parameter recovery in compensatory MIRT models for dichotomous items. Outcome variables included bias and root mean square error. Results indicated that when latent traits were skewed, item parameter recovery was generally adversely impacted. In addition, the presence of complexity contributed to decreases in the precision of parameter recovery, particularly for discrimination parameters along one dimension when at least one latent trait was generated as skewed.

| S-EPMC5978474 | biostudies-literature

A Multidimensional Item Response Theory Model for Continuous and Graded Responses With Error in Persons and Items.

Project description:Item response theory "dual" models (DMs) in which both items and individuals are viewed as sources of differential measurement error so far have been proposed only for unidimensional measures. This article proposes two multidimensional extensions of existing DMs: the M-DTCRM (dual Thurstonian continuous response model), intended for (approximately) continuous responses, and the M-DTGRM (dual Thurstonian graded response model), intended for ordered-categorical responses (including binary). A rationale for the extension to the multiple-content-dimensions case, which is based on the concept of the multidimensional location index, is first proposed and discussed. Then, the models are described using both the factor-analytic and the item response theory parameterizations. Procedures for (a) calibrating the items, (b) scoring individuals, (c) assessing model appropriateness, and (d) assessing measurement precision are finally discussed. The simulation results suggest that the proposal is quite feasible, and an illustrative example based on personality data is also provided. The proposals are submitted to be of particular interest for the case of multidimensional questionnaires in which the number of items per scale would not be enough for arriving at stable estimates if the existing unidimensional DMs were fitted on a separate-scale basis.

| S-EPMC8451022 | biostudies-literature

New resilience instrument for family caregivers in cancer: a multidimensional item response theory analysis.

Project description:ObjectiveResilience instruments specific to family caregivers (FCs) in cancer are limited. This study was designed to validate the 10-item Resilience Scale Specific to Cancer (RS-SC-10) in FCs using multidimensional item response theory (MIRT) analysis.Methods382 FCs were enrolled from Be Resilient to Cancer Program (BRCP) and administered with RS-SC-10 and 36-item Short Form Health Survey (SF-36). MIRT was performed to evaluate item parameters while Generalized Additive Model (GAM) and Latent Profile Analysis (LPA) were performed to test the non-linear relationship between resilience (RS-SC-10) and Quality of Life (QoL, SF-36).ResultsRS-SC-10 retained 10 items with high multidimensional discrimination, monotonous thresholds and its original two-factor structure (Generic and Shift-Persist). Four latent resilience subgroups were identified and a non-linear dose-response pattern between resilience and QoL was confirmed (per-SD increase OR = 1.62, 95% CI 1.16-2.13, p = 0.0019).ConclusionRS-SC-10 is a brief and suitable resilience instrument for FCs in cancer. The resilience screening of patients and FCs can be performed simultaneously in clinical practice.

| S-EPMC8600888 | biostudies-literature

School Burnout Inventory: Latent Profile and Item Response Theory Analyses in Undergraduate Samples.

Project description:The current research reports both latent profile (person-oriented) and item response theory (IRT) analyses of the School Burnout Inventory (SBI) in United States undergraduate samples. Study 1 (n = 1,007) comprises a latent profile analysis (LPA) that identified four mutually exclusive subgroups based on patterns of school burnout responses. Covariate analyses of grade point average and negative affect suggested that school burnout profiles function similarly to variable-oriented approaches. Study 2 (n = 544) explored longitudinal patterns of school burnout among college students via use of a repeated measures LPA. Findings suggested that the profiles identified reflect a relatively stable school burnout trajectory over time. Covariate analysis of sleep quality and academic engagement demonstrated differences across profiles, but the patterns were similar to variable-oriented statistical approaches. Study 3 (n = 2,364) utilized an IRT analysis of the SBI to identify a short, efficient measure. Item information curves and graded response model item discrimination parameters identified a 4-item SBI scale (SBI-4) that offered reasonably high levels of information for assessing school burnout in comparison to the original nine-item SBI. Implications and future research are identified.

| S-EPMC7069246 | biostudies-literature

Associating Psychotic Symptoms with Altered Brain Anatomy in Psychotic Disorders Using Multidimensional Item Response Theory Models.

Project description:Reduced cortical thickness has been demonstrated in psychotic disorders, but its relationship to clinical symptoms has not been established. We aimed to identify the regions throughout neocortex where clinical psychosis manifestations correlate with cortical thickness. Rather than perform a traditional correlation analysis using total scores on psychiatric rating scales, we applied multidimensional item response theory to identify a profile of psychotic symptoms that was related to a region where cortical thickness was reduced. This analysis was performed using a large population of probands with psychotic disorders (N = 865), their family members (N = 678) and healthy volunteers (N = 347), from the 5-site Bipolar-Schizophrenia Network for Intermediate Phenotypes. Regional cortical thickness from structural magnetic resonance scans was measured using FreeSurfer; individual symptoms were rated using the Positive and Negative Syndrome Scale, Montgomery-Asberg Depression Rating Scale, and Young Mania Rating Scale. A cluster of cortical regions whose thickness was inversely related to severity of psychosis symptoms was identified. The regions turned out to be located contiguously in a large region of heteromodal association cortex including temporal, parietal and frontal lobe regions, suggesting a cluster of contiguous neocortical regions important to psychosis expression. When we tested the relationship between reduced cortical surface area and high psychotic symptoms we found no linked regions describing a related cortical set.

| S-EPMC7197072 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data