Unknown

Dataset Information

0

Maximizing the information learned from finite data selects a simple model.


ABSTRACT: We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as much as possible from limited data. When many parameters are poorly constrained by the available data, we find that this prior puts weight only on boundaries of the parameter space. Thus, it selects a lower-dimensional effective theory in a principled way, ignoring irrelevant parameter directions. In the limit where there are sufficient data to tightly constrain any number of parameters, this reduces to the Jeffreys prior. However, we argue that this limit is pathological when applied to the hyperribbon parameter manifolds generic in science, because it leads to dramatic dependence on effects invisible to experiment.

SUBMITTER: Mattingly HH 

PROVIDER: S-EPMC5828598 | biostudies-literature | 2018 Feb

REPOSITORIES: biostudies-literature

altmetric image

Publications

Maximizing the information learned from finite data selects a simple model.

Mattingly Henry H HH   Transtrum Mark K MK   Abbott Michael C MC   Machta Benjamin B BB  

Proceedings of the National Academy of Sciences of the United States of America 20180206 8


We use the language of uninformative Bayesian prior choice to study the selection of appropriately simple effective models. We advocate for the prior which maximizes the mutual information between parameters and predictions, learning as much as possible from limited data. When many parameters are poorly constrained by the available data, we find that this prior puts weight only on boundaries of the parameter space. Thus, it selects a lower-dimensional effective theory in a principled way, ignori  ...[more]

Similar Datasets

| S-EPMC7052242 | biostudies-literature
| S-EPMC5424123 | biostudies-literature
| S-EPMC5069499 | biostudies-literature
| S-EPMC8157929 | biostudies-literature
| S-EPMC3561087 | biostudies-literature
| S-EPMC10611648 | biostudies-literature
| S-EPMC4552863 | biostudies-literature
| S-EPMC8613858 | biostudies-literature
| S-EPMC8655093 | biostudies-literature
| S-EPMC2000915 | biostudies-literature