Browse
Submit Data
Databases
API
Help

Dataset Information

23 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Comparing Simple Scoring With IRT Scoring of Personality Measures: The Navy Computer Adaptive Personality Scales.

ABSTRACT: This article analyzes data from U.S. Navy sailors (N = 8,956), with the central measure being the Navy Computer Adaptive Personality Scales (NCAPS). Analyses and results from this article extend and qualify those from previous research efforts by examining the properties of the NCAPS and its adaptive structure in more detail. Specifically, this article examines item exposure rates, the efficiency of item use based on item response theory (IRT)-based Expected A Posteriori (EAP) scoring, and a comparison of IRT-EAP scoring with much more parsimonious scoring methods that appear to work just as well (stem-level scoring and dichotomous scoring). The cutting-edge nature of adaptive personality testing will necessitate a series of future efforts like this: to examine the benefits of adaptive scoring schemes and novel measurement methods continually, while pushing testing technology further ahead.

SUBMITTER: Oswald FL

PROVIDER: S-EPMC5978510 | biostudies-literature | 2015 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

Comparing Simple Scoring With IRT Scoring of Personality Measures: The Navy Computer Adaptive Personality Scales.

Oswald Frederick L FL Shaw Amy A Farmer William L WL

Applied psychological measurement 20141224 2

This article analyzes data from U.S. Navy sailors (<i>N</i> = 8,956), with the central measure being the Navy Computer Adaptive Personality Scales (NCAPS). Analyses and results from this article extend and qualify those from previous research efforts by examining the properties of the NCAPS and its adaptive structure in more detail. Specifically, this article examines item exposure rates, the efficiency of item use based on item response theory (IRT)-based Expected A Posteriori (EAP) scoring, an ...[more]

PMID: 29880999

Similar Datasets

Alternative Approaches to Addressing Non-Normal Distributions in the Application of IRT Models to Personality Measures.

Project description:It is generally assumed that the latent trait is normally distributed in the population when estimating logistic item response theory (IRT) model parameters. This assumption requires that the latent trait be fully continuous and the population homogenous (i.e., not a mixture). When this normality assumption is violated, models are misspecified, and item and person parameter estimates are inaccurate. When normality cannot be assumed, it might be appropriate to consider alternative modeling approaches: (a) a zero-inflated mixture, (b) a log-logistic, (c) a Ramsay curve, or (d) a heteroskedastic-skew model. The first 2 models were developed to address modeling problems associated with so-called quasi-continuous or unipolar constructs, which apply only to a subset of the population, or are meaningful at one end of the continuum only. The second 2 models were developed to address non-normal latent trait distributions and violations of homogeneity of error variance, respectively. To introduce these alternative IRT models and illustrate their strengths and weaknesses, we performed real data application comparing results to those from a graded response model. We review both statistical and theoretical challenges in applying these models and choosing among them. Future applications of these and other alternative models (e.g., unfolding, diffusion) are needed to advance understanding about model choice in particular situations.

| S-EPMC6252010 | biostudies-literature

Comparing computer-generated and pathologist-generated tumour segmentations for immunohistochemical scoring of breast tissue microarrays.

Project description:Tissue microarrays (TMAs) have become a valuable resource for biomarker expression in translational research. Immunohistochemical (IHC) assessment of TMAs is the principal method for analysing large numbers of patient samples, but manual IHC assessment of TMAs remains a challenging and laborious task. With advances in image analysis, computer-generated analyses of TMAs have the potential to lessen the burden of expert pathologist review.In current commercial software computerised oestrogen receptor (ER) scoring relies on tumour localisation in the form of hand-drawn annotations. In this study, tumour localisation for ER scoring was evaluated comparing computer-generated segmentation masks with those of two specialist breast pathologists. Automatically and manually obtained segmentation masks were used to obtain IHC scores for thirty-two ER-stained invasive breast cancer TMA samples using FDA-approved IHC scoring software.Although pixel-level comparisons showed lower agreement between automated and manual segmentation masks (?=0.81) than between pathologists' masks (?=0.91), this had little impact on computed IHC scores (Allred; =0.91, Quickscore; =0.92).The proposed automated system provides consistent measurements thus ensuring standardisation, and shows promise for increasing IHC analysis of nuclear staining in TMAs from large clinical trials.

| S-EPMC4651129 | biostudies-other

Random intercept EFA of personality scales.

Project description:Previous research suggests that simple structure CFAs of Big Five personality measures fail to accurately reflect the scale's complex factorial structure, whereas EFAs generally perform better. Another strand of research suggests that acquiescence or uniform response bias masks the scale's "true" factorial structure. Random Intercept EFA (RI-EFA) captures acquiescence as well as the complex item-factor structure typical for personality measures. It is applied to the NEO-FFI and the BFI scale to test whether an accurate model-to-data fit can be achieved and whether the "clarity" of the factorial structure improves. The results lend confidence in the general effectiveness of RI-EFA whenever acquiescence bias is an issue. Example Mplus code is provided for replication.

| S-EPMC4251787 | biostudies-literature

Reliability Estimation in Multidimensional Scales: Comparing the Bias of Six Estimators in Measures With a Bifactor Structure.

Project description:In the context of multidimensional structures, with the presence of a common factor and multiple specific or group factors, estimates of reliability require specific estimators. The use of classical procedures such as the alpha coefficient or omega total that ignore structural complexity are not appropriate, since they can lead to strongly biased estimates. Through a simulation study, the bias of six estimators of reliability in multidimensional measures was evaluated and compared. The study is complemented by an empirical illustration that exemplifies the procedure. Results showed that the estimators with the lowest bias in the estimation of the total reliability parameter are omega total, the two versions of greatest lower bound (GLB) and the alpha coefficient, which in turn are also those that produce the highest overestimation of the reliability of the general factor. Nevertheless, the most appropriate estimators, in that they produce less biased estimates of the reliability parameter of the general factor, are omega limit and omega hierarchical.

| S-EPMC8263896 | biostudies-literature

Comparing Two Algorithms for Calibrating the Restricted Non-Compensatory Multidimensional IRT Model.

Project description:The non-compensatory class of multidimensional item response theory (MIRT) models frequently represents the cognitive processes underlying a series of test items better than the compensatory class of MIRT models. Nevertheless, few researchers have used non-compensatory MIRT in modeling psychological data. One reason for this lack of use is because non-compensatory MIRT item parameters are notoriously difficult to accurately estimate. In this article, we propose methods to improve the estimability of a specific non-compensatory model. To initiate the discussion, we address the non-identifiability of the explored non-compensatory MIRT model by suggesting that practitioners use an item-dimension constraint matrix (namely, a Q-matrix) that results in model identifiability. We then compare two promising algorithms for high-dimensional model calibration, Markov chain Monte Carlo (MCMC) and Metropolis-Hastings Robbins-Monro (MH-RM), and discuss, via analytical demonstrations, the challenges in estimating model parameters. Based on simulation studies, we show that when the dimensions are not highly correlated, and when the Q-matrix displays appropriate structure, the non-compensatory MIRT model can be accurately calibrated (using the aforementioned methods) with as few as 1,000 people. Based on the simulations, we conclude that the MCMC algorithm is better able to estimate model parameters across a variety of conditions, whereas the MH-RM algorithm should be used with caution when a test displays complex structure and when the latent dimensions are highly correlated.

| S-EPMC5978509 | biostudies-literature

An IRT Modeling Approach for Assessing Item and Person Discrimination in Binary Personality Responses.

Project description:Conventional item response theory (IRT) modeling of personality responses considers two item characteristics-location and discrimination-but only one person characteristic-location or trait level. An IRT modeling approach that jointly considers item and person discriminations, however, is thought to be more realistic and appropriate in this domain and has several potential advantages. This article develops a model of this type for unidimensional binary responses together with procedures for estimating item and person parameters and assessing model appropriateness (including person fit). A series of preliminary simulations suggests that the approach is feasible, and a real-data example illustrates the potential advantages with respect to the standard two-parameter model. Limitations of the proposal and further work are also discussed.

| S-EPMC5978483 | biostudies-literature

The Abbreviation of Personality, or how to Measure 200 Personality Scales with 200 Items.

Project description:Personality researchers have recently advocated the use of very short personality inventories in order to minimize administration time. However, few such inventories are currently available. Here I introduce an automated method that can be used to abbreviate virtually any personality inventory with minimal effort. After validating the method against existing measures in Studies 1 and 2, a new 181-item inventory is generated in Study 3 that accurately recaptures scores on 8 different broadband inventories comprising 203 distinct scales. Collectively, the results validate a powerful new way to improve the efficiency of personality measurement in research settings.

| S-EPMC2858332 | biostudies-literature

Identifying affective personality profiles: A latent profile analysis of the Affective Neuroscience Personality Scales.

Project description:Based on evolutionary theory, a recent model in affective neuroscience delineated six emotional brain systems at the core of human personality: SEEKING, CARING, PLAYFULNESS, FEAR, ANGER, SADNESS. The Affective Neuroscience Personality Scales (ANPS) assess their functioning. Using a person-centred approach of the ANPS, this study: (i) examined the existence of latent personality profiles, (ii) studied their gender invariance, (iii) assessed their longitudinal (4 years) stability, and (iv) explored how they relate to several intrapersonal, interpersonal, and emotion regulation skills. Latent Profile Analysis in 2 samples (Canadian, longitudinal, N?=?520; French, cross-sectional, N?=?830) found that, qualitatively, 3 profiles characterized both populations and genders, with one distinction for the second profile where the French women endorsed slightly higher and lower scores for, respectively, the negative and positive emotions. Whilst not being quantitatively similar across genders, the personality profiles remained consistent across time in the longitudinal sample. Associations between profiles and intrapersonal (e.g. depression), interpersonal (e.g. empathy), and emotion regulation skills measures (e.g. emotional intelligence) offered concurrent validity evidence. This person centred approach to ANPS offers a holistic and parsimonious way to study affective personality dimensions. It opens promising avenues for future studies on the predictive value of ANPS profiles, and for personality-targeted interventions.

| S-EPMC5495783 | biostudies-literature

A scoping review and mapping exercise comparing the content of patient-reported outcome measures (PROMs) across heart disease-specific scales.

Project description:BACKGROUND:Over the past decade, the importance of person-centered care has led to increased interest in patient-reported outcome measures (PROMs). In cardiovascular care, selecting an appropriate PROM for clinical use or research is challenging because multimorbidity is often common in patients. The aim was therefore to provide an overview of heart-disease specific PROMs and to compare the content of those outcomes using a bio-psycho-social framework of health. METHODS:A scoping review of heart disease-specific PROMs, including arrhythmia/atrial fibrillation, congenital heart disease, heart failure, ischemic heart disease, and valve diseases was conducted in PubMed (January 2018). All items contained in the disease-specific PROMs were mapped to WHO's International Classification of Functioning, Disability and Health (ICF) according to standardized linking rules. RESULTS:A total of 34 PROMs (heart diseases in general n = 5; cardiac arrhythmia n = 6; heart failure n = 14; ischemic heart disease n = 9) and 147 ICF categories were identified. ICF categories covered Body functions (n = 61), Activities & Participation (n = 69), and Environmental factors (n = 17). Most items were about experienced problems of Body functions and less often about patients' daily activities, and most PROMs were specifically developed for heart failure and no PROM were identified for valve disease or congenital heart disease. CONCLUSIONS:Our results motivate and provide information to develop comprehensive PROMs that consider activity and participation by patients with various types of heart disease.

| S-EPMC6977790 | biostudies-literature

After Differential Item Functioning Is Detected: IRT Item Calibration and Scoring in the Presence of DIF.

Project description:Researchers are commonly interested in group comparisons such as comparisons of group means, called impact, or comparisons of individual scores across groups. A meaningful comparison can be made between the groups when there is no differential item functioning (DIF) or differential test functioning (DTF). During the past three decades, much progress has been made in detecting DIF and DTF. However, little research has been conducted on what researchers can do after such detection. This study presents and evaluates a confirmatory multigroup multidimensional item response model to obtain the purified item parameter estimates, person scores, and impact estimates on the primary dimension, controlling for the secondary dimension due to DIF. In addition, the item response model approach was compared with current practices of DIF treatment such as deleting and ignoring DIF items and using multigroup item response models through simulation studies. The authors suggested guidelines for DIF treatment based on the simulation study results.

| S-EPMC5978721 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data