Browse
Submit Data
Databases
API
Help

Dataset Information

11 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Explanatory Cognitive Diagnostic Models: Incorporating Latent and Observed Predictors.

ABSTRACT: Large-scale educational testing data often contain vast amounts of variables associated with information pertaining to test takers, schools, or access to educational resources-information that can help explain relationships between test taker performance and their learning environment. This study examines approaches to incorporate latent and observed explanatory variables as predictors for cognitive diagnostic models (CDMs). Methods to specify and simultaneously estimate observed and latent variables (estimated using item response theory) as predictors affecting attribute mastery were examined. Real-world data analyses were conducted to demonstrate the application using large-scale international testing data. Simulation studies were conducted to examine the recovery and classification for simultaneously estimating multiple latent (using dichotomous and polytomous items as indicators for the latent construct) and observed predictors for varying sample sizes and number of attributes. Results showed stable parameter recovery and consistency in attribute classification. Implications for latent predictors and attribute specifications are discussed.

SUBMITTER: Park YS

PROVIDER: S-EPMC6023094 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Explanatory Cognitive Diagnosis Models Incorporating Item Features.

Project description:Item quality is crucial to psychometric analyses for cognitive diagnosis. In cognitive diagnosis models (CDMs), item quality is often quantified in terms of item parameters (e.g., guessing and slipping parameters). Calibrating the item parameters with only item response data, as a common practice, could result in challenges in identifying the cause of low-quality items (e.g., the correct answer is easy to be guessed) or devising an effective plan to improve the item quality. To resolve these challenges, we propose the item explanatory CDMs where the CDM item parameters are explained with item features such that item features can serve as an additional source of information for item parameters. The utility of the proposed models is demonstrated with the Trends in International Mathematics and Science Study (TIMSS)-released items and response data: around 20 item linguistic features were extracted from the item stem with natural language processing techniques, and the item feature engineering process is elaborated in the paper. The proposed models are used to examine the relationships between the guessing/slipping item parameters of the higher-order DINA model and eight of the item features. The findings from a follow-up simulation study are presented, which corroborate the validity of the inferences drawn from the empirical data analysis. Finally, future research directions are discussed.

| S-EPMC10971092 | biostudies-literature

Bayesian hierarchical latent class models for estimating diagnostic accuracy.

Project description:The diagnostic accuracy of a test or rater has a crucial impact on clinical decision making. The assessment of diagnostic accuracy for multiple tests or raters also merits much attention. A Bayesian hierarchical conditional independence latent class model for estimating sensitivities and specificities for a large group of tests or raters is proposed, which is applicable to both with-gold-standard and without-gold-standard situations. Through the hierarchical structure, not only are the sensitivities and specificities of individual tests estimated, but also the diagnostic performance of the whole group of tests. For a small group of tests or raters, the proposed model is further extended by introducing pairwise covariances between tests to improve the fitting and to allow for more modeling flexibility. Correlation residual analysis is applied to detect any significant covariance between multiple tests. Just Another Gibbs Sampler (JAGS) implementation is efficiently adopted for both models. Three real data sets from literature are analyzed to explicitly illustrate the proposed methods.

| S-EPMC6884669 | biostudies-literature

Developmental cognitive neuroscience using latent change score models: A tutorial and applications.

Project description:Assessing and analysing individual differences in change over time is of central scientific importance to developmental neuroscience. However, the literature is based largely on cross-sectional comparisons, which reflect a variety of influences and cannot directly represent change. We advocate using latent change score (LCS) models in longitudinal samples as a statistical framework to tease apart the complex processes underlying lifespan development in brain and behaviour using longitudinal data. LCS models provide a flexible framework that naturally accommodates key developmental questions as model parameters and can even be used, with some limitations, in cases with only two measurement occasions. We illustrate the use of LCS models with two empirical examples. In a lifespan cognitive training study (COGITO, N = 204 (N = 32 imaging) on two waves) we observe correlated change in brain and behaviour in the context of a high-intensity training intervention. In an adolescent development cohort (NSPN, N = 176, two waves) we find greater variability in cortical thinning in males than in females. To facilitate the adoption of LCS by the developmental community, we provide analysis code that can be adapted by other researchers and basic primers in two freely available SEM software packages (lavaan and Ωnyx).

| S-EPMC6614039 | biostudies-other

Evaluation of diagnostic test procedures for SARS-CoV-2 using latent class models.

Project description:Polymerase chain reaction (PCR) and antigen tests have been used extensively for screening during the severe acute respiratory syndrome coronavirus 2 pandemics. However, the real-world sensitivity and specificity of the two testing procedures in the field have not yet been estimated without assuming that the PCR constitutes a gold standard test. We use latent class models to estimate the in situ performance of both tests using data from the Danish national registries. We find that the specificity of both tests is very high (>99.7%), while the sensitivities are 95.7% (95% confidence interval [CI]: 92.8%-98.4%) and 53.8% (95% CI: 49.8%-57.9%) for the PCR and antigen tests, respectively. These findings have implications for the use of confirmatory PCR tests following a positive antigen test result: we estimate that serial testing is counterproductive at higher prevalence levels.

| S-EPMC9349895 | biostudies-literature

Evaluation of the sensitivity of a measles diagnostic real-time RT-PCR assay incorporating recently observed priming mismatch variants, 2024.

Project description:We investigated a variant of measles virus that encodes three mismatches to the reverse priming site for a widely used diagnostic real-time RT-PCR assay; reduction of sensitivity was hypothesised. We examined performance of the assay in context of the variant using in silico data, synthetic RNA templates and clinical specimens. Sensitivity was reduced observed at low copy numbers for templates encoding the variant sequence. We designed and tested an alternate priming strategy, rescuing the sensitivity of the assay.

| S-EPMC11241853 | biostudies-literature

A Sequential Higher Order Latent Structural Model for Hierarchical Attributes in Cognitive Diagnostic Assessments.

Project description:The higher-order structure and attribute hierarchical structure are two popular approaches to defining the latent attribute space in cognitive diagnosis models. However, to our knowledge, it is still impossible to integrate them to accommodate the higher-order latent trait and hierarchical attributes simultaneously. To address this issue, this article proposed a sequential higher-order latent structural model (LSM) by incorporating various hierarchical structures into a higher-order latent structure. The feasibility of the proposed higher-order LSM was examined using simulated data. Results indicated that, in conjunction with the deterministic-inputs, noisy "and" gate model, the sequential higher-order LSM produced considerable improvement in person classification accuracy compared with the conventional higher-order LSM, when a certain attribute hierarchy existed. An empirical example was presented as well to illustrate the application of the proposed LSM.

| S-EPMC6906392 | biostudies-literature

Measuring students' learning progressions in energy using cognitive diagnostic models.

Project description:This study applied cognitive diagnostic models to assess students' learning progressions in energy. A Q-matrix (i.e., an item attribute alignment table) was proposed based on existing literature about learning progressions of energy in the physical science domain and the Trends in International Mathematics and Science Study (TIMSS) assessment framework. The Q-matrix was validated by expert review and real data analysis. Then, the deterministic inputs, noisy 'and' gate (DINA) model with hierarchical relations was applied to data from three jurisdictions that had stable, defined science curricula (i.e., Australia, Hong Kong, and Ontario). The results suggested that the hypothesized learning progression was consistent with the observed progression in understanding the energy concept. We also found similarities in students' attribute mastery across the three jurisdictions. In addition, we examined the instructional sensitivity of the selected item. We discuss several curriculum-related issues and student misconceptions that may affect students' learning progressions and mastery patterns in different regions of the world.

| S-EPMC9396370 | biostudies-literature

On the robustness of latent class models for diagnostic testing with no gold standard.

Project description:It is difficult to estimate sensitivity and specificity of diagnostic tests when there is no gold standard. Latent class models have been proposed as a potential solution as they provide estimates without the need for a gold standard. Using a motivating example of the evaluation of point of care tests for leptospirosis in Tanzania, we show how a realistic violation of assumptions underpinning the latent class model can lead directly to substantial bias in the estimates of the parameters of interest. In particular, we consider the robustness of estimates of sensitivity, specificity, and prevalence, to the presence of additional latent states when fitting a two-state latent class model. The violation is minor in the sense that it cannot be routinely detected with goodness-of-fit procedures, but is major with regard to the resulting bias.

| S-EPMC8440412 | biostudies-literature

Cognitive predictors of grief trajectories in the first months of loss: A latent growth mixture model.

Project description:OBJECTIVE:The identification of modifiable cognitive antecedents of trajectories of grief is of clinical and theoretical interest. METHOD:The study gathered 3-wave data on 275 bereaved adults in the first 12-18 months postloss (T1 = 0-6 months, T2 = 6-12 months, T3 = 12-18 months). Participants completed measures of grief severity, cognitive factors (loss-related memory characteristics, negative appraisals, unhelpful coping strategies, and grief resilience), as well as measures of interpersonal individual differences (attachment and dependency). Latent growth mixture modeling was used to identify classes of grief trajectories. Predictors of class membership were identified using multinomial logistic regression and multigroup structural equation modeling. RESULTS:Four latent classes were identified: 3 high grief classes (Stable, Low Adaptation, and High Adaptation) and a low grief class (Low Grief). When considered separately, variance in all four cognitive factors predicted membership of the high grief classes. When considered together, membership of the high grief classes was predicted by higher mean scores on memory characteristics. More negative appraisals predicted low or no adaptation from high grief severity. Losing a child also predicted membership to the stable class. Fast adaptation of high grief was predicted by a pattern of high memory characteristics but low engagement with unhelpful coping strategies. CONCLUSIONS:The findings have implications for clinical practice and point to early cognitive predictors of adaptation patterns in grief. Findings are consistent with cognitive models highlighting the importance of characteristics of memory, negative appraisals, and unhelpful coping strategies in the adaptation to highly negative life events. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

| S-EPMC6939605 | biostudies-literature

Bayesian Estimation of Diagnostic Accuracy of Three Diagnostic Tests for Bovine Tuberculosis in Egyptian Dairy Cattle Using Latent Class Models.

Project description:The aim of the present study was to calculate the sensitivity (Se) and specificity (Sp) of the single cervical tuberculin test (SCT), rapid lateral flow test (RLFT), and real-time polymerase chain reaction (RT-PCR) for the diagnosis of Mycobacterium bovis (M. bovis) infection in Egyptian dairy cattle herds within a Bayesian framework. The true M. bovis infection within-herd prevalence was assessed as a secondary objective. Data on the test results of SCT, RLFT, and RT-PCR for the detection of M. bovis were available from 245 cows in eleven herds in six major governorates in Egypt. A Bayesian latent class model was built for the estimation of the characteristics of the three tests. Our findings showed that Se of SCT (0.93 (95% Posterior credible interval (PCI): 0.89-0.93)) was higher than that of RT-PCR (0.83 (95% PCI: 0.28-0.93)) but was similar to the Se of RLFT (0.93 (95% PCI: 0.31-0.99)). On the contrary, SCT showed the lowest Sp estimate (0.60 (95% PCI: 0.59-0.65)), whereas Sp estimates of RT-PCR (0.99 (95% PCI: 0.95-1.00)) and RLFT (0.99 (95% PCI: 0.95-1.00)) were comparable. The true prevalence of M. bovis ranged between 0.07 and 0.71. In conclusion, overall, RT-PCR and RLFT registered superior performance to SCT, making them good candidates for routine use in the Egyptian bovine tuberculosis control program.

| S-EPMC8622144 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data