Unknown

Dataset Information

0

Revised standards for statistical evidence.


ABSTRACT: Recent advances in Bayesian hypothesis testing have led to the development of uniformly most powerful Bayesian tests, which represent an objective, default class of Bayesian hypothesis tests that have the same rejection regions as classical significance tests. Based on the correspondence between these two classes of tests, it is possible to equate the size of classical hypothesis tests with evidence thresholds in Bayesian tests, and to equate P values with Bayes factors. An examination of these connections suggest that recent concerns over the lack of reproducibility of scientific studies can be attributed largely to the conduct of significance tests at unjustifiably high levels of significance. To correct this problem, evidence thresholds required for the declaration of a significant finding should be increased to 25-50:1, and to 100-200:1 for the declaration of a highly significant finding. In terms of classical hypothesis tests, these evidence standards mandate the conduct of tests at the 0.005 or 0.001 level of significance.

SUBMITTER: Johnson VE 

PROVIDER: S-EPMC3845140 | biostudies-literature | 2013 Nov

REPOSITORIES: biostudies-literature

altmetric image

Publications

Revised standards for statistical evidence.

Johnson Valen E VE  

Proceedings of the National Academy of Sciences of the United States of America 20131111 48


Recent advances in Bayesian hypothesis testing have led to the development of uniformly most powerful Bayesian tests, which represent an objective, default class of Bayesian hypothesis tests that have the same rejection regions as classical significance tests. Based on the correspondence between these two classes of tests, it is possible to equate the size of classical hypothesis tests with evidence thresholds in Bayesian tests, and to equate P values with Bayes factors. An examination of these  ...[more]

Similar Datasets

| S-EPMC3571951 | biostudies-literature
| S-EPMC2220054 | biostudies-literature
| S-EPMC4223774 | biostudies-literature
| S-EPMC3280503 | biostudies-literature
| S-EPMC9476672 | biostudies-literature
| S-EPMC4620592 | biostudies-literature
| S-EPMC8737267 | biostudies-literature
| S-EPMC7928410 | biostudies-literature
| S-EPMC1679897 | biostudies-literature
| S-EPMC5497909 | biostudies-other