Browse
Submit Data
Databases
API
Help

Dataset Information

14 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

Research on the Cognitive Diagnosis of Chinese Listening Comprehension Ability Based on the G-DINA Model.

ABSTRACT: As a new generation of measurement theory, cognitive diagnosis theory shows significant potential and advantages in educational evaluation in that it combines a cognitive process and a measurement method. The application of the theory not only reveals the potential characteristics of learners in cognitive processing, but also provides targeted remedies and strategic guidance for individuals. Given the difficulties of traditional assessment models in providing an insightful and fine-grained account for individualized and procedural learning, providing personalized learning strategies for learners of Chinese as a second language has been a new goal of teaching and measurement in Chinese listening. This study constructs a cognitive diagnosis model of Chinese listening comprehension for Chinese-as-a-second-language learners through theoretical exploration, model hypotheses, repeated verification, and model modification. The results show that the Q-matrix (Q₃) constructed by the experts within modification has the highest fitting degree with the empirical data. The parameter recovery rate, the accuracy of the tested attribute or mode, and the relative fitting index obtained from the simulation study are consistent with the information extracted from the empirical data. The diagnostic reliability and effectiveness of generalized deterministic inputs, noise "and" gate (G-DINA) are higher than those of DINA, deterministic inputs, noisy "or" gate (DINO), and reduced reparametrized unified model (RRUM). In the estimation of the item and subject parameters, the G-DINA model shows good convergence, and the average classification accuracy rate based on attribute level is 0.861.

SUBMITTER: Li L

PROVIDER: S-EPMC8452943 | biostudies-literature |

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Similar Datasets

Consistency of Cluster Analysis for Cognitive Diagnosis: The DINO Model and the DINA Model Revisited.

Project description:The Asymptotic Classification Theory of Cognitive Diagnosis (ACTCD) developed by Chiu, Douglas, and Li proved that for educational test data conforming to the Deterministic Input Noisy Output "AND" gate (DINA) model, the probability that hierarchical agglomerative cluster analysis (HACA) assigns examinees to their true proficiency classes approaches 1 as the number of test items increases. This article proves that the ACTCD also covers test data conforming to the Deterministic Input Noisy Output "OR" gate (DINO) model. It also demonstrates that an extension to the statistical framework of the ACTCD, originally developed for test data conforming to the Reduced Reparameterized Unified Model or the General Diagnostic Model (a) is valid also for both the DINA model and the DINO model and (b) substantially increases the accuracy of HACA in classifying examinees when the test data conform to either of these two models.

| S-EPMC5978609 | biostudies-literature

Functional anatomy of listening and reading comprehension during development.

Project description:Listening and reading comprehension of paragraph-length material are considered higher-order language skills fundamental to social and academic functioning. Using ecologically relevant language stimuli that were matched for difficulty according to developmental level, we analyze the effects of task, age, neuropsychological skills, and post-task performance on fMRI activation and hemispheric laterality. Areas of supramodal language processing are identified, with the most robust region being left-lateralized activation along the superior temporal sulcus. Functionally, this conjunction has a role in semantic and syntactic processing, leading us to refer to this conjunction as "comprehension cortex." Different from adults, supramodal areas for children include less extensive inferior frontal gyrus but more extensive right cerebellum and right temporal pole. Broader neuroanatomical pathways are recruited for reading, reflecting the more active processing and larger set of cognitive demands needed for reading compared to listening to stories. ROI analyses reveal that reading is a less lateralized language task than listening in inferior frontal and superior temporal areas, which likely reflects the difficulty of the task as children in this study are still developing their reading skills. For listening to stories, temporal activation is stable by age four with no correlations with age, neuropsychological skills or post-task performance. In contrast, frontal activation during listening to stories occurs more often in older children, and frontal activation is positively correlated with better performance on comprehension questions, suggesting that the activation of frontal networks may reflect greater integration and depth of story processing.

| S-EPMC2962416 | biostudies-literature

Multilevel Modeling of Cognitive Diagnostic Assessment: The Multilevel DINA Example.

Project description:Many multilevel linear and item response theory models have been developed to account for multilevel data structures. However, most existing cognitive diagnostic models (CDMs) are unilevel in nature and become inapplicable when data have a multilevel structure. In this study, using the log-linear CDM as the item-level model, multilevel CDMs were developed based on the latent continuous variable approach and the multivariate Bernoulli distribution approach. In a series of simulations, the newly developed multilevel deterministic input, noisy, and gate (DINA) model was used as an example to evaluate the parameter recovery and consequences of ignoring the multilevel structures. The results indicated that all parameters in the new multilevel DINA were recovered fairly well by using the freeware Just Another Gibbs Sampler (JAGS) and that ignoring multilevel structures by fitting the standard unilevel DINA model resulted in poor estimates for the student-level covariates and underestimated standard errors, as well as led to poor recovery for the latent attribute profiles for individuals. An empirical example using the 2003 Trends in International Mathematics and Science Study eighth-grade mathematical test was provided.

| S-EPMC6297912 | biostudies-literature

Assessing Item-Level Fit for the DINA Model.

Project description:This research focuses on developing item-level fit checking procedures in the context of diagnostic classification models (DCMs), and more specifically for the "Deterministic Input; Noisy 'And' gate" (DINA) model. Although there is a growing body of literature discussing model fit checking methods for DCM, the item-level fit analysis is not adequately discussed in literature. This study intends to take an initiative to fill in this gap. Two approaches are proposed, one stems from classical goodness-of-fit test statistics coupled with the Expectation-Maximization algorithm for model estimation, and the other is the posterior predictive model checking (PPMC) method coupled with the Markov chain Monte Carlo estimation. For both approaches, the chi-square statistic and a power-divergence index are considered, along with Stone's method for considering uncertainty in latent attribute estimation. A simulation study with varying manipulated factors is carried out. Results show that both approaches are promising if Stone's method is imposed, but the classical goodness-of-fit approach has a much higher detection rate (i.e., proportion of misfit items that are correctly detected) than the PPMC method.

| S-EPMC5978514 | biostudies-literature

Aortic Dissection Auxiliary Diagnosis Model and Applied Research Based on Ensemble Learning.

Project description:Aortic dissection (AD), a dangerous disease threatening to human beings, has a hidden onset and rapid progression and has few effective methods in its early diagnosis. At present, although CT angiography acts as the gold standard on AD diagnosis, it is so expensive and time-consuming that it can hardly offer practical help to patients. Meanwhile, the artificial intelligence technology may provide a cheap but effective approach to building an auxiliary diagnosis model for improving the early AD diagnosis rate by taking advantage of the data of the general conditions of AD patients, such as the data about the basic inspection information. Therefore, this study proposes to hybrid five types of machine learning operators into an integrated diagnosis model, as an auxiliary diagnostic approach, to cooperate with the AD-clinical analysis. To improve the diagnose accuracy, the participating rate of each operator in the proposed model may adjust adaptively according to the result of the data learning. After a set of experimental evaluations, the proposed model, acting as the preliminary AD-discriminant, has reached an accuracy of over 80%, which provides a promising instance for medical colleagues.

| S-EPMC8733407 | biostudies-literature

Exploring Multiple Strategic Problem Solving Behaviors in Educational Psychology Research by Using Mixture Cognitive Diagnosis Model.

Project description:A mixture cognitive diagnosis model (CDM), which is called mixture multiple strategy-Deterministic, Inputs, Noisy "and" Gate (MMS-DINA) model, is proposed to investigate individual differences in the selection of response categories in multiple-strategy items. The MMS-DINA model system is an effective psychometric and statistical approach consisting of multiple strategies for practical skills diagnostic testing, which not only allows for multiple strategies of problem solving, but also allows for different strategies to be associated with different levels of difficulty. A Markov chain Monte Carlo (MCMC) algorithm for parameter estimation is given to estimate model, and four simulation studies are presented to evaluate the performance of the MCMC algorithm. Based on the available MCMC outputs, two Bayesian model selection criteria are computed for guiding the choice of the single strategy DINA model and multiple strategy DINA models. An analysis of fraction subtraction data is provided as an illustration example.

| S-EPMC8211444 | biostudies-literature

A Comparison of Software Packages Available for DINA Model Estimation

Project description:This article provides a review of software packages for fitting maximum likelihood estimation of the deterministic input, noisy “and” gate (DINA) model. Six software packages—flexMIRT, Latent GOLD, mdltm, Mplus, OxEdit, and R—are considered. Each package is reviewed regarding data manipulation, statistical capabilities, output, and documentation. The results of these packages are compared using a sample data set and a Q-matrix. The article aims to give the reader a summary of the different capabilities of each package.

| S-EPMC7003186 | biostudies-literature

Bayesian Estimation of the DINA Model With Polya-Gamma Gibbs Sampling.

Project description:With the increasing demanding for precision of test feedback, cognitive diagnosis models have attracted more and more attention to fine classify students whether has mastered some skills. The purpose of this paper is to propose a highly effective Pólya-Gamma Gibbs sampling algorithm (Polson et al., 2013) based on auxiliary variables to estimate the deterministic inputs, noisy "and" gate model (DINA) model that have been widely used in cognitive diagnosis study. The new algorithm avoids the Metropolis-Hastings algorithm boring adjustment the turning parameters to achieve an appropriate acceptance probability. Four simulation studies are conducted and a detailed analysis of fraction subtraction data is carried out to further illustrate the proposed methodology.

| S-EPMC7076190 | biostudies-literature

Using Standardized Test Scores to Include General Cognitive Ability in Education Research and Policy.

Project description:In education research and education policy, much attention is paid to schools, curricula, and teachers, but little attention is paid to the characteristics of students. Differences in general cognitive ability (g) are often overlooked as a source of important variance among schools and in outcomes among students within schools. Standardized test scores such as the SAT and ACT are reasonably good proxies for g and are available for most incoming college students. Though the idea of g being important in education is quite old, we present contemporary evidence that colleges and universities in the United States vary considerably in the average cognitive ability of their students, which correlates strongly with other methods (including international methods) of ranking colleges. We also show that these g differences are reflected in the extent to which graduates of colleges are represented in various high-status and high-income occupations. Finally, we show how including individual-level measures of cognitive ability can substantially increase the statistical power of experiments designed to measure educational treatment effects. We conclude that education policy researchers should give more consideration to the concept of individual differences in cognitive ability as well as other factors.

| S-EPMC6480800 | biostudies-other