Novel Change of Measure Inequalities with Applications to PAC-Bayesian Bounds and Monte Carlo Estimation

preprint2020arXivOpen access

Abstract

We introduce several novel change of measure inequalities for two families of divergences: ff-divergences and αα-divergences. We show how the variational representation for ff-divergences leads to novel change of measure inequalities. We also present a multiplicative change of measure inequality for αα-divergences and a generalized version of Hammersley-Chapman-Robbins inequality. Finally, we present several applications of our change of measure inequalities, including PAC-Bayesian bounds for various classes of losses and non-asymptotic intervals for Monte Carlo estimates.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.