Correcting for Extreme Response Style: Model Choice Matters
Ontology highlight
ABSTRACT:
SUBMITTER: Schoenmakers M
PROVIDER: S-EPMC10795569 | biostudies-literature | 2023 Feb
REPOSITORIES: biostudies-literature
Similar Datasets
Project description:This paper presents a mixture item response tree (IRTree) model for extreme response style. Unlike traditional applications of single IRTree models, a mixture approach provides a way of representing the mixture of respondents following different underlying response processes (between individuals), as well as the uncertainty present at the individual level (within an individual). Simulation analyses reveal the potential of the mixture approach in identifying subgroups of respondents exhibiting response behavior reflective of different underlying response processes. Application to real data from the Students Like Learning Mathematics (SLM) scale of Trends in International Mathematics and Science Study (TIMSS) 2015 demonstrates the superior comparative fit of the mixture representation, as well as the consequences of applying the mixture on the estimation of content and response style traits. We argue that methodology applied to investigate response styles should attend to the inherent uncertainty of response style influence due to the likely influence of both response styles and the content trait on the selection of extreme response categories.
| S-EPMC7797955 | biostudies-literature
Project description:This paper explores extreme response style to the Life Impact Burn Recovery Evaluation (LIBRE) Profile, a measure of social participation in burn survivors. We fit a Multidimensional Generalized Partial Credit Model (MGPCM) with a positive extreme response style (PERS) factor and compared this model with the original MGPCM, estimated the impact that PERS has on scores, and examined the personal characteristics that may result in an individual more likely to respond in a fashion that would inflate their true low scores. The average impact of the PERS, based upon the root mean squared bias, ranged from 0.27 to 0.50 of a standard deviation of the scale. Individuals who were older, had participated in a burn survivor support group, and had selected to self-administer the measure were less likely to have a high PERS bias that masks low scores. Future work can consider PERS when measuring the psychosocial impacts of burn injuries and other health conditions.
| S-EPMC6502351 | biostudies-literature
Project description:Countering misinformation can reduce belief in the moment, but corrective messages quickly fade from memory. We tested whether the longer-term impact of fact-checks depends on when people receive them. In two experiments (total N = 2,683), participants read true and false headlines taken from social media. In the treatment conditions, "true" and "false" tags appeared before, during, or after participants read each headline. Participants in a control condition received no information about veracity. One week later, participants in all conditions rated the same headlines' accuracy. Providing fact-checks after headlines (debunking) improved subsequent truth discernment more than providing the same information during (labeling) or before (prebunking) exposure. This finding informs the cognitive science of belief revision and has practical implications for social media platform designers.
| S-EPMC7865139 | biostudies-literature
Project description:Several multidimensional item response models have been proposed for survey responses affected by response styles. Through simulation, this study compares three models designed to account for extreme response tendencies: the IRTree Model, the multidimensional nominal response model, and the modified generalized partial credit model. The modified generalized partial credit model results in the lowest item mean squared error (MSE) across simulation conditions of sample size (500, 1,000), survey length (10, 20), and number of response options (4, 6). The multidimensional nominal response model is equally suitable for surveys measuring one substantive trait using responses to 10 four-option, forced-choice Likert-type items. Based on data validation, comparison of item MSE, and posterior predictive model checking, the IRTree Model is hypothesized to account for additional sources of construct-irrelevant variance.
| S-EPMC6512164 | biostudies-literature
Project description:To what extent are we beholden to the information we encounter about others? Are there aspects of cognition that are unduly influenced by gossip or outright disinformation, even when we deem it unlikely to be true? Research has shown that implicit impressions of others are often insensitive to the truth value of the evidence. We examined whether the believability of new, contradictory information about others influenced whether people corrected their implicit and explicit impressions. Contrary to previous work, we found that across seven studies, the perceived believability of new evidence predicted whether people corrected their implicit impressions. Subjective assessments of truth value also uniquely predicted correction beyond other properties of information such as diagnosticity/extremity. This evidence shows that the degree to which someone thinks new information is true influences whether it impacts implicit impressions.
| S-EPMC6525494 | biostudies-literature
Project description:Deliberate attempts to portray oneself in an unrealistic manner are commonly encountered in the administration of personality questionnaires. The main aim of the present study was to explore whether mouse tracking temporal indicators and machine learning models could improve the detection of subjects implementing a faking-good response style when answering personality inventories with four choice alternatives, with and without time pressure. A total of 120 volunteers were randomly assigned to one of four experimental groups and asked to respond to the Virtuous Responding (VR) validity scale of the PPI-R and the Positive Impression Management (PIM) validity scale of the PAI via a computer mouse. A mixed design was implemented, and predictive models were calculated. The results showed that, on the PIM scale, faking-good participants were significantly slower in responding than honest respondents. Relative to VR items, PIM items are shorter in length and feature no negations. Accordingly, the PIM scale was found to be more sensitive in distinguishing between honest and faking-good respondents, demonstrating high classification accuracy (80-83%).
| S-EPMC8476468 | biostudies-literature
Project description:This study examined individual differences in mathematics learning by combining antecedent (A), opportunity (O), and propensity (P) indicators within the Opportunity-Propensity Model. Although there is already some evidence for this model based on secondary datasets, there currently is no primary data available that simultaneously takes into account A, O, and P factors in children with and without Mathematical Learning Disabilities (MLD). Therefore, the mathematical abilities of 114 school-aged children (grade 3 till 6) with and without MLD were analyzed and combined with information retrieved from standardized tests and questionnaires. Results indicated significant differences in personality, motivation, temperament, subjective well-being, self-esteem, self-perceived competence, and parental aspirations when comparing children with and without MLD. In addition, A, O, and P factors were found to underlie mathematical abilities and disabilities. For the A factors, parental aspirations explained about half of the variance in fact retrieval speed in children without MLD, and SES was especially involved in the prediction of procedural accuracy in general. Teachers' experience contributed as O factor and explained about 6% of the variance in mathematical abilities. P indicators explained between 52 and 69% of the variance, with especially intelligence as overall significant predictor. Indirect effects pointed towards the interrelatedness of the predictors and the value of including A, O, and P indicators in a comprehensive model. The role parental aspirations played in fact retrieval speed was partially mediated through the self-perceived competence of the children, whereas the effect of SES on procedural accuracy was partially mediated through intelligence in children of both groups and through working memory capacity in children with MLD. Moreover, in line with the componential structure of mathematics, our findings were dependent on the math task used. Different A, O, and P indicators seemed to be important for fact retrieval speed compared to procedural accuracy. Also, mathematical development type (MLD or typical development) mattered since some A, O, and P factors were predictive for MLD only and the other way around. Practical implications of these findings and recommendations for future research on MLD and on individual differences in mathematical abilities are provided.
| S-EPMC5952253 | biostudies-literature
Project description:BackgroundMixed models are used to correct for confounding due to population stratification and hidden relatedness in genome-wide association studies. This class of models includes linear mixed models and generalized linear mixed models. Existing mixed model approaches to correct for population substructure have been previously investigated with both continuous and case-control response variables. However, they have not been investigated in the context of extreme phenotype sampling (EPS), where genetic covariates are only collected on samples having extreme response variable values. In this work, we compare the performance of existing binary trait mixed model approaches (GMMAT, LEAP and CARAT) on EPS data. Since linear mixed models are commonly used even with binary traits, we also evaluate the performance of a popular linear mixed model implementation (GEMMA).ResultsWe used simulation studies to estimate the type I error rate and power of all approaches assuming a population with substructure. Our simulation results show that for a common candidate variant, both LEAP and GMMAT control the type I error rate while CARAT's rate remains inflated. We applied all methods to a real dataset from a Québec, Canada, case-control study that is known to have population substructure. We observe similar type I error control with the analysis on the Québec dataset. For rare variants, the false positive rate remains inflated even after correction with mixed model approaches. For methods that control the type I error rate, the estimated power is comparable.ConclusionsThe methods compared in this study differ in their type I error control. Therefore, when data are from an EPS study, care should be taken to ensure that the models underlying the methodology are suitable to the sampling strategy and to the minor allele frequency of the candidate SNPs.
| S-EPMC8815214 | biostudies-literature
Project description:Due to poling action and upper body engagement, Nordic walking (NW) has additional health benefits with respect to conventional walking. The aim of this study was to evaluate the differences in muscle activation and metabolic responses between NW, performed with the technique suggested by NW instructors, and with some modifications in the way to move upper limb and poles. Ten NW instructors volunteered to walk on a treadmill at 5.5 km•h-1 in five conditions: walking (W), Nordic walking (NW), NW with a weak poling action (NWweak), with straight-upper limbs moving the shoulders (NWshoulder) and with elbow flexion-extension pattern and shoulder freezed (NWelbow). Poling forces, body segments and poles movement, upper and lower body muscle activation, as well as metabolic parameters were measured.All modified NW techniques elicited lower muscular activation and metabolic responses with respect to the suggested NW technique (P < 0.05). All NW techniques elicited higher muscular activation and metabolic responses than W. All parameters observed with the NWweak were lower than NW. A decreased activation of shoulder extensor muscles and increased activation of anterior deltoid muscle were the main features of NWshoulder. Lower triceps brachii muscle activation and reduced propulsive poling action with respect to NW were seen for NWelbow, resulting also in shorter steps.Nordic walking instructors, sport technicians and practitioners should be aware that any deviation from the technique usually suggested might lead to lower benefits. However it is worth to note that any walking technique with poles elicits higher metabolic responses and muscular activation than walking.
| S-EPMC5886538 | biostudies-literature
Project description:Neuro-imaging holds great potential for predicting choice behavior from brain responses. In this study we used both traditional mass-univariate and state-of-the-art multivariate pattern analysis to establish which brain regions respond to preferred packages and to what extent neural activation patterns can predict realistic low-involvement consumer choices. More specifically, this was assessed in the context of package-induced binary food choices. Mass-univariate analyses showed that several regions, among which the bilateral striatum, were more strongly activated in response to preferred food packages. Food choices could be predicted with an accuracy of up to 61.2% by activation patterns in brain regions previously found to be involved in healthy food choices (superior frontal gyrus) and visual processing (middle occipital gyrus). In conclusion, this study shows that mass-univariate analysis can detect small package-induced differences in product preference and that MVPA can successfully predict realistic low-involvement consumer choices from functional MRI data.
| S-EPMC3404976 | biostudies-literature