Dataset Information

Diagnostic Classification Models for Ordinal Item Responses.

ABSTRACT: The purpose of this study is to develop and evaluate two diagnostic classification models (DCMs) for scoring ordinal item data. We first applied the proposed models to an operational dataset and compared their performance to an epitome of current polytomous DCMs in which the ordered data structure is ignored. Findings suggest that the much more parsimonious models that we proposed performed similarly to the current polytomous DCMs and offered useful item-level information in addition to option-level information. We then performed a small simulation study using the applied study condition and demonstrated that the proposed models can provide unbiased parameter estimates and correctly classify individuals. In practice, the proposed models can accommodate much smaller sample sizes than current polytomous DCMs and thus prove useful in many small-scale testing scenarios.

SUBMITTER: Liu R

PROVIDER: S-EPMC6297886 | biostudies-literature | 2018

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Diagnostic Classification Models for Ordinal Item Responses.

Liu Ren R Jiang Zhehan Z

Frontiers in psychology 20181211

The purpose of this study is to develop and evaluate two diagnostic classification models (DCMs) for scoring ordinal item data. We first applied the proposed models to an operational dataset and compared their performance to an epitome of current polytomous DCMs in which the ordered data structure is ignored. Findings suggest that the much more parsimonious models that we proposed performed similarly to the current polytomous DCMs and offered useful item-level information in addition to option-l ...[more]

PMID: 30618941

Similar Datasets

Project description:Diagnostic tests are frequently reliant upon the interpretation of images by skilled raters. In many clinical settings, however, the variability observed between experts' ratings plays a detrimental role in the degree of confidence in these interpretations, leading to uncertainty in the diagnostic process. For example, in breast cancer testing, radiologists interpret mammographic images, while breast biopsy results are examined by pathologists. Each of these procedures involves elements of subjectivity. We propose here a flexible two-stage Bayesian latent variable model to investigate how the skills of individual raters impact the diagnostic accuracy of image-related testing in large-scale medical testing studies. A strength of the proposed model is that the true disease status of a patient within a reasonable time frame may or may not be known. In these studies, many raters each contribute classifications on a large sample of patients using a defined ordinal grading scale, leading to a complex correlation structure between ratings. Our modeling approach considers the different sources of variability contributed by experts and patients while accounting for correlations present between ratings and patients, in contrast to currently available methods. We propose a novel measure of a rater's ability (magnifier) that, in contrast to conventional measures of sensitivity and specificity, is robust to the underlying prevalence of disease in the population, providing an alternative measure of diagnostic accuracy across patient populations. Extensive simulation studies demonstrate lower bias in estimation of parameters and measures of accuracy, and illustrate outperformance of the proposed model when compared with existing models. Receiver operator characteristic curves are derived to assess the diagnostic accuracy of individual experts and their overall performance. Our proposed modeling approach is applied to a large breast imaging study for known disease status and a uterine cancer dataset for unknown disease status.

Project description:BackgroundChlorophyceae is one of three most species-rich green algal classes and also the only class in core Chlorophyta whose monophyly remains uncontested as gene and taxon sampling improves. However, some key relationships within Chlorophyceae are less clear-cut and warrant further investigation. The present study combined genome-scale chloroplast data and rich sampling in an attempt to resolve the ordinal classification in Chlorophyceae. The traditional division into Sphaeropleales and Volvocales (SV), and a clade containing Oedogoniales, Chaetopeltidales, and Chaetophorales (OCC) was of particular interest with the addition of deeply branching members of these groups, as well as the placement of several incertae sedis taxa.MethodsWe sequenced 18 chloroplast genomes across Chlorophyceae to compile a data set of 58 protein-coding genes of a total of 68 chlorophycean taxa. We analyzed the concatenated nucleotide and amino acid datasets in the Bayesian and Maximum Likelihood frameworks, supplemented by analyses to examine potential discordant signal among genes. We also examined gene presence and absence data across Chlorophyceae.ResultsConcatenated analyses yielded at least two well-supported phylogenies: nucleotide data supported the traditional classification with the inclusion of the enigmatic Treubarinia into Sphaeropleales sensu lato. However, amino acid data yielded equally strong support for Sphaeropleaceae as sister to Volvocales, with the rest of the taxa traditionally classified in Sphaeropleales in a separate clade, and Treubarinia as sister to all of the above. Single-gene and other supplementary analyses indicated that the data have low phylogenetic signal at these critical nodes. Major clades were supported by genomic structural features such as gene losses and trans-spliced intron insertions in the plastome.DiscussionWhile the sequence and gene order data support the deep split between the SV and OCC lineages, multiple phylogenetic hypotheses are possible for Sphaeropleales s.l. Given this uncertainty as well as the higher-taxonomic disorder seen in other algal groups, dwelling on well-defined, strongly supported Linnaean orders is not currently practical in Chlorophyceae and a less formal clade system may be more useful in the foreseeable future. For example, we identify two strongly and unequivocally supported clades: Treubarinia and Scenedesminia, as well as other smaller groups that could serve a practical purpose as named clades. This system does not preclude future establishment of new orders, or emendment of the current ordinal classification if new data support such conclusions.

Dataset Information

Diagnostic Classification Models for Ordinal Item Responses.

Publications

Diagnostic Classification Models for Ordinal Item Responses.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure