Summary measures of agreement and association between many raters' ordinal classifications.

ABSTRACT:

Purpose

Interpretation of screening tests such as mammograms usually require a radiologist's subjective visual assessment of images, often resulting in substantial discrepancies between radiologists' classifications of subjects' test results. In clinical screening studies to assess the strength of agreement between experts, multiple raters are often recruited to assess subjects' test results using an ordinal classification scale. However, using traditional measures of agreement in some studies is challenging because of the presence of many raters, the use of an ordinal classification scale, and unbalanced data.

Methods

We assess and compare the performances of existing measures of agreement and association as well as a newly developed model-based measure of agreement to thre

SUBMITTER: Mitani AA 

PROVIDER: S-EPMC5687310 | biostudies-literature | 2017 Oct

REPOSITORIES: biostudies-literature