Rapid Convergence of the Unadjusted Langevin Algorithm: Isoperimetry Suffices

preprint2022arXivOpen access

Abstract

We study the Unadjusted Langevin Algorithm (ULA) for sampling from a probability distribution ν=e−fν= e^{-f} on Rn\mathbb{R}^n. We prove a convergence guarantee in Kullback-Leibler (KL) divergence assuming νν satisfies a log-Sobolev inequality and the Hessian of ff is bounded. Notably, we do not assume convexity or bounds on higher derivatives. We also prove convergence guarantees in Rényi divergence of order q>1q > 1 assuming the limit of ULA satisfies either the log-Sobolev or Poincaré inequality. We also prove a bound on the bias of the limiting distribution of ULA assuming third-order smoothness of ff, without requiring isoperimetry.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.