Convergence of Langevin-Simulated Annealing algorithms with multiplicative noise II: Total Variation

preprint2022arXivOpen access

Abstract

We study the convergence of Langevin-Simulated Annealing type algorithms with multiplicative noise, i.e. for V:Rd→RV : \mathbb{R}^d \to \mathbb{R} a potential function to minimize, we consider the stochastic differential equation dYt=−σσ⊤∇V(Yt)dt+a(t)σ(Yt)dWt+a(t)2Υ(Yt)dtdY_t = - σσ^\top \nabla V(Y_t) dt + a(t)σ(Y_t)dW_t + a(t)^2Υ(Y_t)dt, where (Wt)(W_t) is a Brownian motion, where σ:Rd→Md(R)σ: \mathbb{R}^d \to \mathcal{M}_d(\mathbb{R}) is an adaptive (multiplicative) noise, where a:R+→R+a : \mathbb{R}^+ \to \mathbb{R}^+ is a function decreasing to 00 and where ΥΥ is a correction term. Allowing σσ to depend on the position brings faster convergence in comparison with the classical Langevin equation dYt=−∇V(Yt)dt+σdWtdY_t = -\nabla V(Y_t)dt + σdW_t. In a previous paper we established the convergence in L1L^1-Wasserstein distance of YtY_t and of its associated Euler scheme Yˉt\bar{Y}_t to argmin(V)\text{argmin}(V) with the classical schedule a(t)=Alog⁡−1/2(t)a(t) = A\log^{-1/2}(t). In the present paper we prove the convergence in total variation distance. The total variation case appears more demanding to deal with and requires regularization lemmas.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.