Ontology highlight
ABSTRACT:
SUBMITTER: Wang D
PROVIDER: S-EPMC6923147 | biostudies-literature | 2019 Dec
REPOSITORIES: biostudies-literature
Wang Dilin D Tang Ziyang Z Bajaj Chandrajit C Liu Qiang Q
Advances in neural information processing systems 20191201
Stein variational gradient descent (SVGD) is a particle-based inference algorithm that leverages gradient information for efficient approximate inference. In this work, we enhance SVGD by leveraging preconditioning matrices, such as the Hessian and Fisher information matrix, to incorporate geometric information into SVGD updates. We achieve this by presenting a generalization of SVGD that replaces the <i>scalar-valued</i> kernels in vanilla SVGD with more general <i>matrix-valued</i> kernels. Th ...[more]