Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Ability and Prior Distribution Mismatch: An Exploration of Common-Item Linking Methods.

ABSTRACT: Linking of two forms is an important task when using item response theory, particularly when two forms are administered to nonequivalent groups. When linking with characteristic curve methods, the ability distribution and weights associated with that distribution can be used to weight observations differently. These are commonly specified as equally spaced intervals from -4 to 4, but other options or distributional forms can be specified. The use of these different distributions and weights of the ability distributions will be explored with a Monte Carlo simulation. Primary simulation conditions will include sample size, number of items, number of common items, ability distribution, and randomly varying population transformation constants. Study results show that the linking weights have little impact on the estimation of the linking constants; however, the underlying ability distribution of examinees does have significant impact. Implications for applied researchers will be discussed.

SUBMITTER: LeBeau B

PROVIDER: S-EPMC5978475 | biostudies-literature | 2017 Oct

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Ability and Prior Distribution Mismatch: An Exploration of Common-Item Linking Methods.

LeBeau Brandon B

Applied psychological measurement 20170518 7

Linking of two forms is an important task when using item response theory, particularly when two forms are administered to nonequivalent groups. When linking with characteristic curve methods, the ability distribution and weights associated with that distribution can be used to weight observations differently. These are commonly specified as equally spaced intervals from -4 to 4, but other options or distributional forms can be specified. The use of these different distributions and weights of t ...[more]

PMID: 29881105

Similar Datasets

Methods for Estimating Item-Score Reliability.

Project description:Reliability is usually estimated for a test score, but it can also be estimated for item scores. Item-score reliability can be useful to assess the item's contribution to the test score's reliability, for identifying unreliable scores in aberrant item-score patterns in person-fit analysis, and for selecting the most reliable item from a test to use as a single-item measure. Four methods were discussed for estimating item-score reliability: the Molenaar-Sijtsma method (method MS), Guttman's method ?6 , the latent class reliability coefficient (method LCRC), and the correction for attenuation (method CA). A simulation study was used to compare the methods with respect to median bias, variability (interquartile range [IQR]), and percentage of outliers. The simulation study consisted of six conditions: standard, polytomous items, unequal ? parameters, two-dimensional data, long test, and small sample size. Methods MS and CA were the most accurate. Method LCRC showed almost unbiased results, but large variability. Method ?6 consistently underestimated item-score reliabilty, but showed a smaller IQR than the other methods.

| S-EPMC6140096 | biostudies-literature

Linking of Rasch-Scaled Tests: Consequences of Limited Item Pools and Model Misfit.

Project description:In the context of item response theory (IRT), linking the scales of two measurement points is a prerequisite to examine a change in competence over time. In educational large-scale assessments, non-identical test forms sharing a number of anchor-items are frequently scaled and linked using two- or three-parametric item response models. However, if item pools are limited and/or sample sizes are small to medium, the sparser Rasch model is a suitable alternative regarding the precision of parameter estimation. As the Rasch model implies stricter assumptions about the response process, a violation of these assumptions may manifest as model misfit in form of item discrimination parameters empirically deviating from their fixed value of one. The present simulation study investigated the performance of four IRT linking methods-fixed parameter calibration, mean/mean linking, weighted mean/mean linking, and concurrent calibration-applied to Rasch-scaled data with a small item pool. Moreover, the number of anchor items required in the absence/presence of moderate model misfit was investigated in small to medium sample sizes. Effects on the link outcome were operationalized as bias, relative bias, and root mean square error of the estimated sample mean and variance of the latent variable. In the light of this limited context, concurrent calibration had substantial convergence issues, while the other methods resulted in an overall satisfying and similar parameter recovery-even in the presence of moderate model misfit. Our findings suggest that in case of model misfit, the share of anchor items should exceed 20% as is currently proposed in the literature. Future studies should further investigate the effects of anchor item composition regarding unbalanced model misfit.

| S-EPMC8289883 | biostudies-literature

DI2: prior-free and multi-item discretization of biological data and its applications.

Project description:BackgroundA considerable number of data mining approaches for biomedical data analysis, including state-of-the-art associative models, require a form of data discretization. Although diverse discretization approaches have been proposed, they generally work under a strict set of statistical assumptions which are arguably insufficient to handle the diversity and heterogeneity of clinical and molecular variables within a given dataset. In addition, although an increasing number of symbolic approaches in bioinformatics are able to assign multiple items to values occurring near discretization boundaries for superior robustness, there are no reference principles on how to perform multi-item discretizations.ResultsIn this study, an unsupervised discretization method, DI2, for variables with arbitrarily skewed distributions is proposed. Statistical tests applied to assess differences in performance confirm that DI2 generally outperforms well-established discretizations methods with statistical significance. Within classification tasks, DI2 displays either competitive or superior levels of predictive accuracy, particularly delineate for classifiers able to accommodate border values.ConclusionsThis work proposes a new unsupervised method for data discretization, DI2, that takes into account the underlying data regularities, the presence of outlier values disrupting expected regularities, as well as the relevance of border values. DI2 is available at https://github.com/JupitersMight/DI2.

| S-EPMC8425008 | biostudies-literature

Evaluation of MCQs from MOOCs for common item writing flaws.

Project description:OBJECTIVE:There is a dearth of research into the quality of assessments based on Multiple Choice Question (MCQ) items in Massive Open Online Courses (MOOCs). This dataset was generated to determine whether MCQ item writing flaws existed in a selection of MOOC assessments, and to evaluate their prevalence if so. Hence, researchers reviewed MCQs from a sample of MOOCs, using an evaluation protocol derived from the medical health education literature, which has an extensive evidence-base with regard to writing quality MCQ items. DATA DESCRIPTION:This dataset was collated from MCQ items in 18 MOOCs in the areas of medical health education, life sciences and computer science. Two researchers critically reviewed 204 questions using an evidence-based evaluation protocol. In the data presented, 50% of the MCQs (112) have one or more item writing flaw, while 28% of MCQs (57) contain two or more flaws. Thus, a majority of the MCQs in the dataset violate item-writing guidelines, which mirrors findings of previous research that examined rates of flaws in MCQs in traditional formal educational contexts.

| S-EPMC6276217 | biostudies-literature

Stratified Item Selection Methods in Cognitive Diagnosis Computerized Adaptive Testing.

Project description:Cognitive diagnostic computerized adaptive testing (CD-CAT) aims to obtain more useful diagnostic information by taking advantages of computerized adaptive testing (CAT). Cognitive diagnosis models (CDMs) have been developed to classify examinees into the correct proficiency classes so as to get more efficient remediation, whereas CAT tailors optimal items to the examinee's mastery profile. The item selection method is the key factor of the CD-CAT procedure. In recent years, a large number of parametric/nonparametric item selection methods have been proposed. In this article, the authors proposed a series of stratified item selection methods in CD-CAT, which are combined with posterior-weighted Kullback-Leibler (PWKL), nonparametric item selection (NPS), and weighted nonparametric item selection (WNPS) methods, and named S-PWKL, S-NPS, and S-WNPS, respectively. Two different types of stratification indices were used: original versus novel. The performances of the proposed item selection methods were evaluated via simulation studies and compared with the PWKL, NPS, and WNPS methods without stratification. Manipulated conditions included calibration sample size, item quality, number of attributes, number of strata, and data generation models. Results indicated that the S-WNPS and S-NPS methods performed similarly, and both outperformed the S-PWKL method. And item selection methods with novel stratification indices performed slightly better than the ones with original stratification indices, and those without stratification performed the worst.

| S-EPMC7433381 | biostudies-literature

Proposal to extend the PROMIS® item bank v2.0 'Ability to Participate in Social Roles and Activities': item generation and content validity.

Project description:PurposePrevious research indicated that the Patient-Reported Outcomes Measurement Information System (PROMIS®) item bank v2.0 'Ability to Participate in Social Roles and Activities' may miss subdomains of social participation. The purpose of this study was to generate items for these missing subdomains and to evaluate their content validity.MethodsA three-step approach was followed: (1) Item generation for 16 International Classification of Functioning Disability and Health subdomains currently not covered by the item bank; (2) Evaluation of content validity of generated items through expert review (n = 20) and think-aloud interviews with a purposeful sample of people with and without (chronic) health conditions (n = 10), to assess item comprehensibility, relevance, and comprehensiveness; and 3) Item revision based on the results of step 2, in a consensus procedure.ResultsFirst, 48 items were generated. Second, overall, content experts indicated that the generated items were relevant. Furthermore, based on experts' responses, items were simplified and 'participation in social media' was identified as an important additional subdomain of social participation. Additionally, 'participating in various social roles simultaneously' was identified as a missing item. Based on the responses of the interviewed adults items were simplified. Third, in total 17 items, covering 17 subdomains, were proposed to be added to the original item bank.DiscussionThe relevance, comprehensibility and comprehensiveness of the 17 proposed items were supported. Whether the proposed extension of the item bank leads to better psychometric properties of the item bank should be tested in a large-scale field study.

| S-EPMC7561593 | biostudies-literature

Cross-linking BioThings APIs through JSON-LD to facilitate knowledge exploration.

Project description:BackgroundApplication Programming Interfaces (APIs) are now widely used to distribute biological data. And many popular biological APIs developed by many different research teams have adopted Javascript Object Notation (JSON) as their primary data format. While usage of a common data format offers significant advantages, that alone is not sufficient for rich integrative queries across APIs.ResultsHere, we have implemented JSON for Linking Data (JSON-LD) technology on the BioThings APIs that we have developed, MyGene.info , MyVariant.info and MyChem.info . JSON-LD provides a standard way to add semantic context to the existing JSON data structure, for the purpose of enhancing the interoperability between APIs. We demonstrated several use cases that were facilitated by semantic annotations using JSON-LD, including simpler and more precise query capabilities as well as API cross-linking.ConclusionsWe believe that this pattern offers a generalizable solution for interoperability of APIs in the life sciences.

| S-EPMC5796402 | biostudies-literature

Parametric exploration of the liver by magnetic resonance methods.

Project description:MRI, as a completely noninvasive technique, can provide quantitative assessment of perfusion, diffusion, viscoelasticity and metabolism, yielding diverse information about liver function. Furthermore, pathological accumulations of iron and lipids can be quantified. Perfusion MRI with various contrast agents is commonly used for the detection and characterization of focal liver disease and the quantification of blood flow parameters. An extended new application is the evaluation of the therapeutic effect of antiangiogenic drugs on liver tumours. Novel, but already widespread, is a histologically validated relaxometry method using five gradient echo sequences for quantifying liver iron content elevation, a measure of inflammation, liver disease and cancer. Because of the high perfusion fraction in the liver, the apparent diffusion coefficients strongly depend on the gradient factors used in diffusion-weighted MRI. While complicating analysis, this offers the opportunity to study perfusion without contrast injection. Another novel method, MR elastography, has already been established as the only technique able to stage fibrosis or diagnose mild disease. Liver fat content is accurately determined with multivoxel MR spectroscopy (MRS) or by faster MRI methods that are, despite their widespread use, prone to systematic error. Focal liver disease characterisation will be of great benefit once multivoxel methods with fat suppression are implemented in proton MRS, in particular on high-field MR systems providing gains in signal-to-noise ratio and spectral resolution.

| S-EPMC2762052 | biostudies-other

PedsQL™ Gastroparesis Symptoms Module Domain and Item Development: Qualitative Methods.

Project description:ObjectivesLike adults, children suffer from gastroparesis; however, there are currently no validated instruments to determine the impact of gastroparesis in pediatric patients. The objective of this study was to develop the items and domains to support the content validity of the new Pediatric Quality of Life Inventory (PedsQL™) Gastroparesis Symptoms Module.MethodsPatients were recruited from the National Institute of Diabetes and Digestive and Kidney Diseases Pediatric Gastroparesis Registry. The qualitative methods involved an iterative process comprising a literature review of existing questionnaires and gastroparesis clinical research, an expert review panel of pediatric gastroenterologists who provided feedback on the conceptual framework in developing the semi-structured interview, and in-depth focus interviews with six pediatric patients with gastroparesis and five of their parents (one did not participate) in developing relevant domains and item content. In the subsequent cognitive interviews phase, five additional patients with gastroparesis and their parents provided detailed feedback on item content, relevance, importance, and understandability of the domains and items.ResultsTen domains/scales were derived from the qualitative methods, with item content saturation achieved at 67 items, with no further themes or content identified during the final cognitive interviews. The Module is comprised of 10 individual scales measuring nausea, stomach fullness when eating, vomiting, dry heaves, heartburn and reflux, stomach pain and hurt, food and drink limits, bloating, appetite, and worry.ConclusionsOur study supports the content validity of the new PedsQL Gastroparesis Symptoms Module. The Module field test study will be conducted in a multisite national study.

| S-EPMC8373654 | biostudies-literature

The Consumer Motivation Scale: A detailed review of item generation, exploration, confirmation, and validation procedures.

Project description:This data article offers a detailed description of analyses pertaining to the development of the Consumer Motivation Scale (CMS), from item generation and the extraction of factors, to confirmation of the factor structure and validation of the emergent dimensions. The established goal structure - consisting of the sub-goals Value for Money, Quality, Safety, Stimulation, Comfort, Ethics, and Social Acceptance - is shown to be related to a variety of consumption behaviors in different contexts and for different products, and should thereby prove useful in standard marketing research, as well as in the development of tailored marketing strategies, and the segmentation of consumer groups, settings, brands, and products.

| S-EPMC5447383 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data