Using Item Response Theory to Compare Irritability Measures in Early Adolescent and Childhood Samples.
Ontology highlight
ABSTRACT:
SUBMITTER: Dougherty LR
PROVIDER: S-EPMC8724905 | biostudies-literature | 2021 Apr
REPOSITORIES: biostudies-literature
Publications
Using Item Response Theory to Compare Irritability Measures in Early Adolescent and Childhood Samples.
Dougherty Lea R LR Galano Maria M MM Chad-Friedman Emma E Olino Thomas M TM Bufferd Sara J SJ Klein Daniel N DN
Assessment 20200702 3
Limited psychometric information is available to guide best practices for measuring youth irritability. This report compares performance of irritability measures using item response theory (IRT). Study 1 used a sample of 482 early adolescents and compared the parent- and youth-report affective reactivity index (ARI) and irritability factors derived from the parent-report Child Behavior Checklist (CBCL) and clinician-administered Kiddie Schedule for Affective Disorders (K-SADS). Study 2 combined ...[more]
Similar Datasets
Project description:This study investigated how well components of the psychopathy trait are measured among college students with the Levenson Self-Report Psychopathy Scale (LSRP), the Personality Assessment Inventory-Antisocial Features Scale (PAI ANT), the Psychopathic Personality Inventory-Short Form (PPI-SF), and the Self-Report Psychopathy Scale-II (SRP-II). Using Samejima (1969)'s graded response model (GRM), the subscales were found to vary in their ability to measure the corresponding latent traits. The LSRP primary psychopathy factor is more precise in measuring the latent trait than the secondary psychopathy factor. The PAI ANT items show coherent psychometric properties, whereas the PPI-SF factors differ in their precision to measure the corresponding traits. The SRP-II factors are effective in discriminating among individuals with varying levels of the latent traits. Results suggest that multiple self-report measures should be used to tap the multidimensional psychopathy construct. However, there are concerns with respect to using negatively worded items to assess certain aspects of psychopathy. (PsycINFO Database Record
| S-EPMC5773402 | biostudies-literature
Project description:Background: Subjective well-being refers to the extent to which a person believes or feels that her life is going well. It is considered as one of the best available proxies for a broader, more canonical form of well-being. For over 30 years, one important distinction in the conceptualization of subjective well-being is the contrast between more affective evaluations of biological emotional reactions and more cognitive evaluations of one's life in relation to a psychologically self-imposed ideal. More recently, researchers have suggested the addition of harmony in life, comprising behavioral evaluations of how one is doing in a social context. Since measures used to assess subjective well-being are self-reports, often validated only using Classical Test Theory, our aim was to focus on the psychometric properties of the measures using Item Response Theory. Method: A total of 1000 participants responded to the Positive Affect Negative Affect Schedule. At random, half of the participants answered to the Satisfaction with Life Scale or to the Harmony in life Scale. First, we evaluate and provide enough evidence of unidimensionality for each scale. Next, we conducted graded response models to validate the psychometric properties of the subjective well-being scales. Results: All scales showed varied frequency item distribution, high discrimination values (Alphas), and had different difficulty parameters (Beta) on each response options. For example, we identified items that respondents found difficult to endorse at the highest/lowest point of the scales (e.g., "Proud" for positive affect; item 5, "If I could live my life over, I would change almost nothing," for life satisfaction; and item 3, "I am in harmony," for harmony in life). In addition, all scales could cover a good portion of the range of subjective well-being (Theta): -2.50 to 2.30 for positive affect, -1.00 to 3.50 for negative affect, -2.40 to 2.50 for life satisfaction, and -2.40 to 2.50 for harmony in life. Importantly, for all scales, there were weak reliability for respondents with extreme latent scores of subjective well-being. Conclusion: The affective component, especially low levels of negative affect, were less accurately measured, while both the cognitive and social component were covered to an equal degree. There was less reliability for respondents with extreme latent scores of subjective well-being. Thus, to improve reliability at the level of the scale, at the item level and at the level of the response scale for each item, we point out specific items that need to be modified or added. Moreover, the data presented here can be used as normative data for each of the subjective well-being constructs.
| S-EPMC6987476 | biostudies-literature
Project description:This article introduces three new variants of entropy to detect person misfit (Ei, EMi , and EMRi ), and provides preliminary evidence that these measures are worthy of further investigation. Previously, entropy has been used as a measure of approximate data-model fit to quantify how well individuals are classified into latent classes, and to quantify the quality of classification and separation between groups in logistic regression models. In the current study, entropy is explored through conceptual examples and Monte Carlo simulation comparing entropy with established measures of person fit in item response theory (IRT) such as lz, lz*, U, and W. Simulation results indicated that EMi and EMRi were successfully able to detect aberrant response patterns when comparing contaminated and uncontaminated subgroups of persons. In addition, EMi and EMRi performed similarly in showing separation between the contaminated and uncontaminated subgroups. However, EMRi may be advantageous over other measures when subtests include a small number of items. EMi and EMRi are recommended for use as approximate person-fit measures for IRT models. These measures of approximate person fit may be useful in making relative judgments about potential persons whose response patterns do not fit the theoretical model.
| S-EPMC5978476 | biostudies-literature
Project description:INTRODUCTION:Models from signal detection theory are commonly used to score neuropsychological test data, especially tests of recognition memory. Here we show that certain item response theory models can be formulated as signal detection theory models, thus linking two complementary but distinct methodologies. We then use the approach to evaluate the validity (construct representation) of commonly used research measures, demonstrate the impact of conditional error on neuropsychological outcomes, and evaluate measurement bias. METHOD:Signal detection-item response theory (SD-IRT) models were fitted to recognition memory data for words, faces, and objects. The sample consisted of U.S. Infantry Marines and Navy Corpsmen participating in the Marine Resiliency Study. Data comprised item responses to the Penn Face Memory Test (PFMT; N = 1,338), Penn Word Memory Test (PWMT; N = 1,331), and Visual Object Learning Test (VOLT; N = 1,249), and self-report of past head injury with loss of consciousness. RESULTS:SD-IRT models adequately fitted recognition memory item data across all modalities. Error varied systematically with ability estimates, and distributions of residuals from the regression of memory discrimination onto self-report of past head injury were positively skewed towards regions of larger measurement error. Analyses of differential item functioning revealed little evidence of systematic bias by level of education. CONCLUSIONS:SD-IRT models benefit from the measurement rigor of item response theory-which permits the modeling of item difficulty and examinee ability-and from signal detection theory-which provides an interpretive framework encompassing the experimentally validated constructs of memory discrimination and response bias. We used this approach to validate the construct representation of commonly used research measures and to demonstrate how nonoptimized item parameters can lead to erroneous conclusions when interpreting neuropsychological test data. Future work might include the development of computerized adaptive tests and integration with mixture and random-effects models.
| S-EPMC6050112 | biostudies-literature
Project description:Spatial ability is important for success in STEM fields but is typically measured using a small number of tests that were not developed in the STEM context, have not been normed with recent samples, or have not been subjected to modern psychometric analyses. Here, an approach to developing valid, reliable, and efficient computer-based tests of spatial skills is proposed and illustrated via the development of an efficient test of the ability to visualize cross-sections of three-dimensional (3D) objects. After pilot testing, three measures of this ability were administered online to 498 participants (256 females, aged 18-20). Two of the measures, the Santa Barbara Solids and Planes of Reference tests had good psychometric properties and measured a domain-general ability to visualize cross-sections, with sub-factors related to item difficulty. Item-level statistics informed the development of the refined versions of these tests and a combined measure composed of the most informative test items. Sex and ethnicity had no significant effects on the combined measure after controlling for mathematics education, verbal ability, and age. The measures ofcross-sectioning ability developed in the context of geology education were found to be too difficult, likely because they measured domain knowledge in addition to cross-sectioning ability. Recommendations are made for the use of cross-section tests in selection and training and for the more general development of spatial ability measures.
| S-EPMC10672093 | biostudies-literature
Project description:The current research reports both latent profile (person-oriented) and item response theory (IRT) analyses of the School Burnout Inventory (SBI) in United States undergraduate samples. Study 1 (n = 1,007) comprises a latent profile analysis (LPA) that identified four mutually exclusive subgroups based on patterns of school burnout responses. Covariate analyses of grade point average and negative affect suggested that school burnout profiles function similarly to variable-oriented approaches. Study 2 (n = 544) explored longitudinal patterns of school burnout among college students via use of a repeated measures LPA. Findings suggested that the profiles identified reflect a relatively stable school burnout trajectory over time. Covariate analysis of sleep quality and academic engagement demonstrated differences across profiles, but the patterns were similar to variable-oriented statistical approaches. Study 3 (n = 2,364) utilized an IRT analysis of the SBI to identify a short, efficient measure. Item information curves and graded response model item discrimination parameters identified a 4-item SBI scale (SBI-4) that offered reasonably high levels of information for assessing school burnout in comparison to the original nine-item SBI. Implications and future research are identified.
| S-EPMC7069246 | biostudies-literature
Project description:Although item response theory (IRT) models such as the bifactor, two-tier, and between-item-dimensionality IRT models have been devised to confirm complex dimensional structures in educational and psychological data, they can be challenging to use in practice. The reason is that these models are multidimensional IRT (MIRT) models and thus are highly parameterized, making them only suitable for data provided by large samples. Unfortunately, many educational and psychological studies are conducted on a small scale, leaving the researchers without the necessary MIRT models to confirm the hypothesized structures in their data. To address the lack of modeling options for these researchers, we present a general Bayesian MIRT model based on adaptive informative priors. Simulations demonstrated that our MIRT model could be used to confirm a two-tier structure (with two general and six specific dimensions), a bifactor structure (with one general and six specific dimensions), and a between-item six-dimensional structure in rating scale data representing sample sizes as small as 100. Although our goal was to provide a general MIRT model suitable for smaller samples, the simulations further revealed that our model was applicable to larger samples. We also analyzed real data from 121 individuals to illustrate that the findings of our simulations are relevant to real situations.
| S-EPMC7307486 | biostudies-literature
Project description:OBJECTIVE:Advances in developmentally sensitive measurement have enabled differentiation of normative versus clinically salient irritability in early childhood. However, clinical application of these measures is still nascent. The authors developed an optimized model of clinically salient irritable behaviors at preschool age. Based on this model, the authors derived an empirically based cutoff in relation to concurrent DSM-5 irritability-related disorders (i.e., oppositional defiant disorder, disruptive mood dysregulation disorder, other depressive disorders) and used longitudinal models to test the predictive validity of the cutoff for impairment and irritability trajectories and later DSM disorders. METHOD:Preschool children oversampled for irritability were followed over 3 time points into early school age (N = 425; mean age at baseline 4.7 years, mean follow-up 2.9 years). Mothers reported on children's irritability using the developmentally validated Multidimensional Assessment of Profile of Disruptive Behavior (MAP-DB) Temper Loss scale, impairment using the Family Life Impairment Scale, and DSM categories using the Preschool Age Psychiatric Assessment and the Schedule for Affective Disorders and Schizophrenia-Present and Lifetime Version. RESULTS:Of 22 MAP-DB Temper Loss behaviors, 2 behaviors-1 normative (easily frustrated) and 1 rare dysregulated (destructive tantrums)-were uniquely related to cross-domain impairment. At baseline, these 2 irritability items identified diagnostic status (oppositional defiant disorder, disruptive mood dysregulation disorder, other depressive disorders) with good sensitivity (70-73%) and specificity (74-83%). Children above the irritability cutoff at baseline also exhibited more persistent irritability and impairment and greater likelihood of DSM disorders in early school age. CONCLUSION:Clinical identification of early-onset irritability can be enhanced using brief, developmentally optimized indicators. Further research to apply these findings to tiered early intervention is important.
| S-EPMC5860673 | biostudies-literature
Project description:BACKGROUND:Children with neurodevelopmental disorders are at increased risk of developing depression. Irritability predicts depression in the general population and is common in children with neurodevelopmental disorders. Thus, it is possible that irritability in children with neurodevelopmental disorders contributes to the link with later depression. This study aimed to (a) examine the association between childhood neurodevelopmental difficulties and adolescent depression and (b) test whether irritability explains this association. METHODS:Children with any neurodevelopmental difficulty at the age of 7-9 (n = 1,697) and a selected, comparison group without any neurodevelopmental difficulty (n = 3,177) were identified from a prospective, UK population-based cohort, the Avon Longitudinal Study of Parents and Children. Neurodevelopmental difficulties were defined as a score in the bottom 5% of the sample on at least one measure of cognitive ability, communication, autism spectrum symptoms, attention-deficit/hyperactivity symptoms, reading or motor coordination. The Development and Well-Being Assessment measured parent-reported child irritability at the age of 7, parent-reported adolescent depression at the age of 10 and 13, and self-reported depression at the age of 15. Depression measures were combined, deriving an outcome of major depressive disorder (MDD) in adolescence. Logistic regression examined the association between childhood neurodevelopmental difficulties and adolescent MDD, controlling for gender. Path analysis estimated the proportion of this association explained by irritability. Analyses were repeated for individual neurodevelopmental problems. RESULTS:Childhood neurodevelopmental difficulties were associated with adolescent MDD (OR = 2.11, 95% CI = 1.24, 3.60, p = .006). Childhood irritability statistically accounted for 42% of this association. On examining each neurodevelopmental difficulty separately, autistic, communication and ADHD problems were each associated with depression, with irritability explaining 29%-51% of these links. CONCLUSIONS:Childhood irritability appears to be a key contributor to the link between childhood neurodevelopmental difficulties and adolescent MDD. High rates of irritability in children with autistic and ADHD difficulties may explain elevated rates of depression in the neurodevelopmental group.
| S-EPMC6767365 | biostudies-literature
Project description:Testing item-level fit is important in scale development to guide item revision/deletion. Many item-level fit indices have been proposed in literature, yet none of them were directly applicable to an important family of models, namely, the higher order item response theory (HO-IRT) models. In this study, chi-square-based fit indices (i.e., Yen's Q 1, McKinley and Mill's G 2, Orlando and Thissen's S-X 2, and S-G 2) were extended to HO-IRT models. Their performances are evaluated via simulation studies in terms of false positive rates and correct detection rates. The manipulated factors include test structure (i.e., test length and number of dimensions), sample size, level of correlations among dimensions, and the proportion of misfitting items. For misfitting items, the sources of misfit, including the misfitting item response functions, and misspecifying factor structures were also manipulated. The results from simulation studies demonstrate that the S-G 2 is promising for higher order items.
| S-EPMC6291895 | biostudies-literature