Dataset Information

Attribute Discrimination Index-Based Method to Balance Attribute Coverage for Short-Length Cognitive Diagnostic Computerized Adaptive Testing.

ABSTRACT: We propose a new method that balances attribute coverage for short-length cognitive diagnostic computerized adaptive testing (CD-CAT). The new method uses the attribute discrimination index (ADI-based method) instead of the number of items that measure each attribute [modified global discrimination index (MGDI)-based method] to balance the attribute coverage. Therefore, the information that each attribute provides can be captured. The purpose of the simulation study was to evaluate the performance of the new method, and the results showed the following: (a) Compared with uncontrolled attribute-balance coverage method, the new method produced a higher mastery pattern correct classification rate (PCCR) and attribute correct classification rate (ACCR) with both the posterior-weighted Kullback-Leibler (PWKL) and the modified PWKL (MPWKL) item selection method. (b) Equalization of ACCR (E-ACCR) based on the ADI-based method leads to better results, followed by the MGDI-based method. The uncontrolled method leads to the worst results regardless of item selection methods. (c) Both the ADI-based and MGDI-based methods produced acceptable examinee qualification rates, regardless of item selection methods, although they were relatively low for the uncontrolled condition.

SUBMITTER: Wang Y

PROVIDER: S-EPMC7059599 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Attribute Discrimination Index-Based Method to Balance Attribute Coverage for Short-Length Cognitive Diagnostic Computerized Adaptive Testing.

Wang Yutong Y Sun Xiaojian X Chong Weifeng W Xin Tao T

Frontiers in psychology 20200228

We propose a new method that balances attribute coverage for short-length cognitive diagnostic computerized adaptive testing (CD-CAT). The new method uses the attribute discrimination index (ADI-based method) instead of the number of items that measure each attribute [modified global discrimination index (MGDI)-based method] to balance the attribute coverage. Therefore, the information that each attribute provides can be captured. The purpose of the simulation study was to evaluate the performan ...[more]

PMID: 32180747

Similar Datasets

Project description:ObjectivesTo build an item response theory-based computer adaptive test (CAT) for balance from 3 traditional, fixed-form balance measures: Berg Balance Scale (BBS), Performance-Oriented Mobility Assessment (POMA), and dynamic gait index (DGI); and to examine whether the CAT's psychometric performance exceeded that of individual measures.DesignSecondary analysis combining 2 existing datasets.SettingCommunity based.ParticipantsCommunity-dwelling older adults (N=187) who were aged ≥65 years (mean age, 75.2±6.8y, 69% women).InterventionsNot applicable.Main outcome measuresThe BBS, POMA, and DGI items were compiled into an initial 38-item bank. The Rasch partial credit model was used for final item bank calibration. CAT simulations were conducted to identify the ideal CAT. CAT score accuracy, reliability, floor and ceiling effects, and validity were examined. Floor and ceiling effects and validity of the CAT and individual measures were compared.ResultsA 23-item bank met model expectations. A 10-item CAT was selected, showing a very strong association with full item bank scores (r=.97) and good overall reliability (.78). Reliability was better in low- to midbalance ranges as a result of better item targeting to balance ability when compared with the highest balance ranges. No floor effect was noted. The CAT ceiling effect (11.2%) was significantly lower than the POMA (40.1%) and DGI (40.3%) ceiling effects (P<.001 per comparison). The CAT outperformed individual measures, being the only test to discriminate between fallers and nonfallers (P=.007), and being the strongest predictor of self-reported function.ConclusionsThe balance CAT showed excellent accuracy, good overall reliability, and excellent validity compared with individual measures, being the only measure to discriminate between fallers and nonfallers. Prospective examination, particularly in low-functioning older adults and clinical populations with balance deficits, is recommended. Development of an improved CAT based on an expanded item bank containing higher difficulty items is also recommended.

Dataset Information

Attribute Discrimination Index-Based Method to Balance Attribute Coverage for Short-Length Cognitive Diagnostic Computerized Adaptive Testing.

Publications

Attribute Discrimination Index-Based Method to Balance Attribute Coverage for Short-Length Cognitive Diagnostic Computerized Adaptive Testing.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets