Unknown

Dataset Information

0

Criteria for evaluating risk prediction of multiple outcomes.


ABSTRACT: Risk prediction models have been developed in many contexts to classify individuals according to a single outcome, such as risk of a disease. Emerging "-omic" biomarkers provide panels of features that can simultaneously predict multiple outcomes from a single biological sample, creating issues of multiplicity reminiscent of exploratory hypothesis testing. Here I propose definitions of some basic criteria for evaluating prediction models of multiple outcomes. I define calibration in the multivariate setting and then distinguish between outcome-wise and individual-wise prediction, and within the latter between joint and panel-wise prediction. I give examples such as screening and early detection in which different senses of prediction may be more appropriate. In each case I propose definitions of sensitivity, specificity, concordance, positive and negative predictive value and relative utility. I link the definitions through a multivariate probit model, showing that the accuracy of a multivariate prediction model can be summarised by its covariance with a liability vector. I illustrate the concepts on a biomarker panel for early detection of eight cancers, and on polygenic risk scores for six common diseases.

SUBMITTER: Dudbridge F 

PROVIDER: S-EPMC7682512 | biostudies-literature | 2020 Dec

REPOSITORIES: biostudies-literature

altmetric image

Publications

Criteria for evaluating risk prediction of multiple outcomes.

Dudbridge Frank F  

Statistical methods in medical research 20200629 12


Risk prediction models have been developed in many contexts to classify individuals according to a single outcome, such as risk of a disease. Emerging "-omic" biomarkers provide panels of features that can simultaneously predict multiple outcomes from a single biological sample, creating issues of multiplicity reminiscent of exploratory hypothesis testing. Here I propose definitions of some basic criteria for evaluating prediction models of multiple outcomes. I define calibration in the multivar  ...[more]

Similar Datasets

| S-EPMC3135785 | biostudies-literature
| S-EPMC3695651 | biostudies-literature
| S-EPMC8247971 | biostudies-literature
| S-EPMC3356231 | biostudies-literature
| S-EPMC5997745 | biostudies-literature
| S-EPMC6447061 | biostudies-literature
| S-EPMC3142453 | biostudies-literature
| S-EPMC4859766 | biostudies-literature
| S-EPMC6583088 | biostudies-literature
| S-EPMC6460739 | biostudies-literature