Browse
Submit Data
Databases
API
Help

Dataset Information

0 Views

0 Connections

0 Citations

0 Reanalyses

0 Downloads

Omics score: 0

On Misconceptions and the Limited Usefulness of Ordinal Alpha.

ABSTRACT: This article discusses the theoretical and practical contributions of Zumbo, Gadermann, and Zeisser's family of ordinal reliability statistics. Implications, interpretation, recommendations, and practical applications regarding their ordinal measures, particularly ordinal alpha, are discussed. General misconceptions relating to this family of ordinal reliability statistics are highlighted, and arguments for interpreting ordinal alpha as a measure of hypothetical reliability, as opposed to observed reliability, are presented. It is concluded that ordinal alpha should not be used in routine reliability analyses and reports, and instead should be understood as hypothetical tool, similar to the Spearman-Brown prophecy formula, for theoretically increasing the number of ordinal categorical response options in future applied testing applications.

SUBMITTER: Chalmers RP

PROVIDER: S-EPMC6293415 | biostudies-literature | 2018 Dec

REPOSITORIES: biostudies-literature

ACCESS DATA

Json Xml

Publications

On Misconceptions and the Limited Usefulness of Ordinal Alpha.

Chalmers R Philip RP

Educational and psychological measurement 20170921 6

This article discusses the theoretical and practical contributions of Zumbo, Gadermann, and Zeisser's family of ordinal reliability statistics. Implications, interpretation, recommendations, and practical applications regarding their ordinal measures, particularly ordinal alpha, are discussed. General misconceptions relating to this family of ordinal reliability statistics are highlighted, and arguments for interpreting ordinal alpha as a measure of hypothetical reliability, as opposed to observ ...[more]

PMID: 30559513

Similar Datasets

Limited Usefulness of Capture Procedure and Capture Percentage for Evaluating Reproducibility in Psychological Science.

Project description:In psychological science, there is an increasing concern regarding the reproducibility of scientific findings. For instance, Replication Project: Psychology (Open Science Collaboration, 2015) found that the proportion of successful replication in psychology was 41%. This proportion was calculated based on Cumming and Maillardet (2006) widely employed capture procedure (CPro) and capture percentage (CPer). Despite the popularity of CPro and CPer, we believe that using them may lead to an incorrect conclusion of (a) successful replication when the population effect sizes in the original and replicated studies are different; and (b) unsuccessful replication when the population effect sizes in the original and replicated studies are identical but their sample sizes are different. Our simulation results show that the performances of CPro and CPer become biased, such that researchers can easily make a wrong conclusion of successful/unsuccessful replication. Implications of these findings are considered in the conclusion.

| S-EPMC6141826 | biostudies-literature

Maximizing limited space: usefulness of percutaneous cricothyrotomy and super-soft hood for hypopharyngeal endoscopic submucosal dissection.

Project description:Video 1Demonstration of the usefulness of percutaneous cricothyrotomy and a super-soft hood for hypopharyngeal endoscopic submucosal dissection.

| S-EPMC10577375 | biostudies-literature

Refuting misconceptions in medical physiology.

Project description:BackgroundIn medical physiology, educators and students face a serious challenge termed misconceptions. Misconceptions are incorrect ideas that do not match current scientific views. Accordingly, they have shown to hamper teaching and learning of physiological concepts. Conceptual Change Theory forms the basis of new teaching and learning practices that may alleviate misconceptions and facilitate critical thinking skills that are essential in becoming knowledgeable, self-regulated health professionals. In this study, we examined if such an intervention named refutation texts, could enhance medical students' cognition and metacognition.MethodsFirst-year medical students (N = 161) performed a pre-test and post-test on cardiovascular physiology concepts, including a self-perceived confidence rating. In between, students read either a standard text with an explanation of the correct answer, or a refutation text which additionally refuted related misconceptions.ResultsIn both groups, average performance scores (refutation: + 22.5%, standard: + 22.8%) and overall confidence ratings (refutation: Δ0.42 out of 5, standard: Δ0.35 out of 5) increased significantly (all p < .001), but a significant effect of the specific refutation element was not found. Initially incorrect answers were corrected less frequently in cases of high confidence (35.8%) than low confidence (61.4%).ConclusionsOur results showed that refutation texts significantly increased students' knowledge, however, the refutation element did not have a significant additional effect. Furthermore, high confidence in incorrect answers negatively affected the likelihood of correction. These findings provide implications for teaching practices on concept learning, by showing that educators should take into account the key role of metacognition, and the nature of misconceptions.

| S-EPMC7409498 | biostudies-literature

Use of ordinal information by fish.

Project description:Mammals and birds can process ordinal numerical information which can be used, for instance, for recognising an object on the basis of its position in a sequence of similar objects. Recent studies have shown that teleost fish possess numerical abilities comparable to those of other vertebrates, but it is unknown if they can also learn ordinal numerical relations. Guppies (Poecilia reticulata) learned to recognise the 3(rd) feeder in a row of 8 identical ones even when inter-feeder distance and feeder positions were varied among trials to prevent the use of any spatial information. To assess whether guppies spontaneously use ordinal or spatial information when both are simultaneously available, fish were then trained with constant feeder positions and inter-feeder distance. In probe trials where these two sources of information were contrasted, the subjects selected the correct ordinal position significantly more often than the original spatial position, indicating that the former was preferentially encoded during training. Finally, a comparison between subjects trained on the 3(rd) and the 5(th) position revealed that guppies can also learn the latter discrimination, but the larger error rate observed in this case suggests that 5 is close to the upper limit of discrimination in guppies.

| S-EPMC4620454 | biostudies-other

Cancer and environment: definitions and misconceptions.

Project description:BACKGROUND:Scientific evidence supports an association between environmental exposures and cancer. However, a reliable estimate for the proportion of cancers attributable to environmental factors is currently unavailable. This may be related to the varying definitions of the term "environment." The current review aims to determine how the reporting of the definition of the environment and of the estimates of environmentally attributable risks have changed over the past 50 years. METHODS:A systematic literature search was performed to retrieve all relevant publications relating to the environment and cancer from January 1960 to December 2010 using PubMed, EMBASE, Scopus, and Web of Science. Definitions of the environment and environmentally attributable risks for cancer were extracted from each relevant publication. RESULTS:The search resulted in 261 relevant publications. We found vast discrepancies in the definition of the environment, ranging from broad (including lifestyle factors, occupational exposures, pollutants, and other non-genetic factors) to narrow (including air, water, and soil pollutants). Reported environmentally attributable risk estimates ranged from 1% to 100%. CONCLUSIONS:Our findings emphasize the discrepancies in reporting environmental causation of cancer and the limits of inference in interpreting environmentally attributable risk estimates. Rather than achieving consensus on a single definition for the environment, we suggest the focus be on achieving transparency for any environmentally attributable risks.

| S-EPMC3267861 | biostudies-literature

Biology undergraduates' misconceptions about genetic drift.

Project description:This study explores biology undergraduates' misconceptions about genetic drift. We use qualitative and quantitative methods to describe students' definitions, identify common misconceptions, and examine differences before and after instruction on genetic drift. We identify and describe five overarching categories that include 16 distinct misconceptions about genetic drift. The accuracy of students' conceptions ranges considerably, from responses indicating only superficial, if any, knowledge of any aspect of evolution to responses indicating knowledge of genetic drift but confusion about the nuances of genetic drift. After instruction, a significantly greater number of responses indicate some knowledge of genetic drift (p = 0.005), but 74.6% of responses still contain at least one misconception. We conclude by presenting a framework that organizes how students' conceptions of genetic drift change with instruction. We also articulate three hypotheses regarding undergraduates' conceptions of evolution in general and genetic drift in particular. We propose that: 1) students begin with undeveloped conceptions of evolution that do not recognize different mechanisms of change; 2) students develop more complex, but still inaccurate, conceptual frameworks that reflect experience with vocabulary but still lack deep understanding; and 3) some new misconceptions about genetic drift emerge as students comprehend more about evolution.

| S-EPMC3433298 | biostudies-literature

Ordinal Logic Regression: A classifier for discovering combinations of binary markers for ordinal outcomes.

Project description:In medicine, it is often useful to stratify patients according to disease risk, severity, or response to therapy. Since many diseases arise from complex gene-gene and gene-environment interactions, patient strata may be defined by combinations of genetic and environmental factors. Traditional statistical methods require specifying interactions a priori making it difficult to identify high order interactions. Alternatively, machine learning methods can model complex interactions, however these models are often difficult to interpret in a clinical setting. Logic regression (LR) enables modeling a binary outcome using logical combinations of binary predictors yielding easily interpretable models. However LR, as currently available, cannot model ordinal responses. This paper extends LR to model an ordinal response and the resulting method is called Ordinal Logic Regression (OLR). Several simulations comparing OLR and Classification and Regression Trees (CART) demonstrate that OLR is superior to CART for identifying variable interactions associated with an ordinal response. OLR is applied to data from a study to determine associations between genetic and health factors with severity of adult periodontitis.

| S-EPMC4397503 | biostudies-literature

Distinguishing ordinal and disordinal interactions.

Project description:Re-parameterized regression models may enable tests of crucial theoretical predictions involving interactive effects of predictors that cannot be tested directly using standard approaches. First, we present a re-parameterized regression model for the Linear × Linear interaction of 2 quantitative predictors that yields point and interval estimates of 1 key parameter-the crossover point of predicted values-and leaves certain other parameters unchanged. We explain how resulting parameter estimates provide direct evidence for distinguishing ordinal from disordinal interactions. We generalize the re-parameterized model to Linear × Qualitative interactions, where the qualitative variable may have 2 or 3 categories, and then describe how to modify the re-parameterized model to test moderating effects. To illustrate our new approach, we fit alternate models to social skills data on 438 participants in the National Institute of Child Health and Human Development Study of Early Child Care. The re-parameterized regression model had point and interval estimates of the crossover point that fell near the mean on the continuous environment measure. The disordinal form of the interaction supported 1 theoretical model-differential-susceptibility-over a competing model that predicted an ordinal interaction.

| S-EPMC3553243 | biostudies-literature

Generalized semiparametrically structured ordinal models.

Project description:Semiparametrically structured models are defined as a class of models for which the predictors may contain parametric parts, additive parts of covariates with an unspecified functional form, and interactions which are described as varying coefficients. In the case of an ordinal response the complexity of the predictor is determined by different sorts of effects. Global effects and category-specific effects are distinguished; the latter allow the effect to vary across response categories. A general framework is developed in which global as well as category-specific effects may have unspecified functional form. The framework extends various existing methods of modeling ordinal responses. The Wilkinson-Rogers notation is extended to incorporate smooth model parts and varying coefficient terms, the latter being important for the smooth specification of category-specific effects.

| S-EPMC3464104 | biostudies-literature

Misconceptions about mirror-induced motor cortex activation.

Project description:Observation of self-produced hand movements through a mirror, creating an illusion of the opposite hand moving, was recently reported to induce ipsilateral motor cortex activation, that is, motor cortex activation for the hand in rest. The reported work goes far beyond earlier work on motor cortex activation induced by action observation, by implying a complete reversal of contralateral and ipsilateral motor cortex activation under mirror view conditions. Such a reversal would represent an unprecedented degree of neural plasticity. We considered such a reversal physiologically implausible and conducted a study with an improved design. The results refute the reversal of contralateral and ipsilateral motor cortex activation under mirrored viewing conditions as methodologically unsound. The investigation confirmed, however, more subtle expressions of motor cortical activity induced by self-produced movements observed through a mirror.

| S-EPMC3138518 | biostudies-literature

OmicsDI is part of the ELIXIR infrastructure

OmicsDI is an Elixir interoperability service. Learn more ›

Tweets

OmicsDI Databases

PRIDE
PeptideAtlas
MassIVE
JPOST Repository
Physiome Model Repository

EGA
EVA
ENA
LINCS
PAXDB
Cell Collective

MetaboLights
Metabolomics Workbench
MetabolomeExpress
GNPS
BioModels
FAIRDOMHub

ArrayExpress
dbGaP
ExpressionAtlas
GEO
NODE

Information

Databases
Help
API
Contact us
Code on GitHub
Terms of use
Submit Data