Measures of agreement between many raters for ordinal classifications.

ABSTRACT: Screening and diagnostic procedures often require a physician's subjective interpretation of a patient's test result using an ordered categorical scale to define the patient's disease severity. Because of wide variability observed between physicians' ratings, many large-scale studies have been conducted to quantify agreement between multiple experts' ordinal classifications in common diagnostic procedures such as mammography. However, very few statistical approaches are available to assess agreement in these large-scale settings. Many existing summary measures of agreement rely on extensions of Cohen's kappa. These are prone to prevalence and marginal distribution issues, become increasingly complex for more than three experts, or are not easily implemented. Here we propose a model-based a

SUBMITTER: Nelson KP 

PROVIDER: S-EPMC4560692 | biostudies-literature | 2015 Oct

REPOSITORIES: biostudies-literature