The forward-backward envelope for sampling with the overdamped Langevin algorithm

被引:3
|
作者
Eftekhari, Armin [1 ]
Vargas, Luis [2 ,3 ]
Zygalakis, Konstantinos C. [2 ,3 ]
机构
[1] Umea Univ, Dept Math & Math Stat, Umea, Sweden
[2] Bayes Ctr, Maxwell Inst Math Sci, 47 Potterrow, Edinburgh, Scotland
[3] Univ Edinburgh, Sch Math, Edinburgh, Scotland
基金
英国工程与自然科学研究理事会;
关键词
Markov chain Monte Carlo; Convex optimization; Langevin equation; MONTE-CARLO; MINIMIZATION; CONVERGENCE; SMOOTH;
D O I
10.1007/s11222-023-10254-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
In this paper, we analyse a proximal method based on the idea of forward-backward splitting for sampling from distributions with densities that are not necessarily smooth. In particular, we study the non-asymptotic properties of the Euler-Maruyama discretization of the Langevin equation, where the forward-backward envelope is used to deal with the non-smooth part of the dynamics. An advantage of this envelope, when compared to widely-used Moreu-Yoshida one and the MYULA algorithm, is that it maintains the MAP estimator of the original non-smooth distribution. We also study a number of numerical experiments that support our theoretical findings.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] The forward–backward envelope for sampling with the overdamped Langevin algorithm
    Armin Eftekhari
    Luis Vargas
    Konstantinos C. Zygalakis
    Statistics and Computing, 2023, 33
  • [2] CONVERGENCE OF INEXACT FORWARD-BACKWARD ALGORITHMS USING THE FORWARD-BACKWARD ENVELOPE
    Bonettini, S.
    Prato, M.
    Rebegoldi, S.
    SIAM JOURNAL ON OPTIMIZATION, 2020, 30 (04) : 3069 - 3097
  • [3] Extended forward-backward algorithm
    Lassonde, Marc
    Nagesseur, Ludovic
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2013, 403 (01) : 167 - 172
  • [4] A generalization of forward-backward algorithm
    Azuma A.
    Matsumoto Y.
    Transactions of the Japanese Society for Artificial Intelligence, 2010, 25 (03) : 494 - 503
  • [5] On the Locality of the Forward-Backward Algorithm
    Merialdo, Bernard
    IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 1993, 1 (02): : 255 - 257
  • [6] A Generalization of Forward-Backward Algorithm
    Azuma, Ai
    Matsumoto, Yuji
    MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, PT I, 2009, 5781 : 99 - 114
  • [7] A forward-backward abstraction refinement algorithm
    Ranzato, Francesco
    Doria, Olivia Rossi
    Tapparo, Francesco
    VERIFICATION, MODEL CHECKING, AND ABSTRACT INTERPRETATION, 2008, 4905 : 248 - 262
  • [8] On the memory complexity of the forward-backward algorithm
    Khreich, Wael
    Granger, Eric
    Miri, Ali
    Sabourin, Robert
    PATTERN RECOGNITION LETTERS, 2010, 31 (02) : 91 - 99
  • [9] The Forward-Backward Algorithm and the Normal Problem
    Moursi, Walaa M.
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2018, 176 (03) : 605 - 624
  • [10] QUANTUM LANGEVIN EQUATION FROM FORWARD-BACKWARD PATH-INTEGRAL
    KLEINERT, H
    SHABANOV, SV
    PHYSICS LETTERS A, 1995, 200 (3-4) : 224 - 232