Dataset Information

Exploring Rubric-Related Multidimensionality in Polytomously Scored Test Items.

ABSTRACT: Test items scored as polytomous have the potential to display multidimensionality across rating scale score categories. This article uses a multidimensional nominal response model (MNRM) to examine the possibility that the proficiency dimension/dimensional composite best measured by a polytomously scored item may vary by score category, an issue not generally considered in multidimensional item response theory (MIRT). Some practical considerations in exploring rubric-related multidimensionality, including potential consequences of not attending to it, are illustrated through simulation examples. A real data application is applied in the study of item format effects using the 2007 administration of Trends in Mathematics and Science Study (TIMSS) among eighth graders in the United States.

SUBMITTER: Bolt DM

PROVIDER: S-EPMC5978550 | biostudies-literature | 2017 May

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Exploring Rubric-Related Multidimensionality in Polytomously Scored Test Items.

Bolt Daniel M DM Adams Daniel J DJ

Applied psychological measurement 20161124 3

Test items scored as polytomous have the potential to display multidimensionality across rating scale score categories. This article uses a multidimensional nominal response model (MNRM) to examine the possibility that the proficiency dimension/dimensional composite best measured by a polytomously scored item may vary by score category, an issue not generally considered in multidimensional item response theory (MIRT). Some practical considerations in exploring rubric-related multidimensionality, ...[more]

PMID: 29881086

Similar Datasets

Project description:IntroductionPrevious studies have identified "trust" as a key mechanism to achieve sustainable partnerships in participatory health research, which themselves can represent social networks. A recent review discussed the potential for social network analysis to investigate the development and maintenance of trust and its effects on partnership functioning in participatory health research partnerships. This review also recommended considering a comprehensive, nuanced and multidimensional approach to conceptualizing, operationalizing and measuring trust in research partnerships. Thus, this study aims to explore empirically the conceptualizing, operationalizing and measuring of trust in a multidimensional manner, approaching each trust dimension as an individual trust network, as well as combined as an overall trust network.MethodsWe sampled the whole network, recruiting from a newly established network of 57 individuals that must collaborate to achieve a common goal. These individuals represented academic, service and community organizations of an existing participatory partnership, the Public and Patient Involvement Ignite Network in Ireland. Of the 57 individuals invited to take part in the study, 75% (n = 43) individuals completed the network survey. A survey about trust was designed based on literature in the area and was administered via Qualtrics. The survey included eight network questions: one on collaboration, and seven on specific dimensions of trust. From this, we constructed a network for each trust dimension. We compared several core network measures of each to identify structural differences between the dimensions of trust. To statistically validate them, we compared them to a random and preferential null model.ResultsAll the networks had a high reciprocity but were decentralized. Key differences were identified across trust dimensions, particularly in terms of integrity and shared values, visions and goals. None of the networks compared well to the null models indicating participants did not randomly or preferentially (based on how much trust they receive for a particular trust dimension) trust other partners.Discussion/conclusionThis novel empirical social network analysis of trust in a real-world partnership elucidates the nuances and multidimensional nature of trust. This provides support for expanding this research direction to enhance understanding of and interventions for trust in participatory health research.

Dataset Information

Exploring Rubric-Related Multidimensionality in Polytomously Scored Test Items.

Publications

Exploring Rubric-Related Multidimensionality in Polytomously Scored Test Items.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets