Sampling from a Log-Concave Distribution with Projected Langevin Monte Carlo

被引:49
作者
Bubeck, Sebastien [1 ]
Eldan, Ronen [2 ]
Lehec, Joseph [3 ]
机构
[1] Microsoft Res, Redmond, WA 98052 USA
[2] Weizmann Inst Sci, Fac Math & Comp Sci, IL-7610001 Rehovot, Israel
[3] Univ Paris 09, CEREMADE, F-75016 Paris, France
关键词
Langevin Monte Carlo; Sampling and optimization; Log-concave measures; Rapidly-mixing random walks;
D O I
10.1007/s00454-018-9992-1
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We extend the Langevin Monte Carlo (LMC) algorithm to compactly supported measures via a projection step, akin to projected stochastic gradient descent (SGD). We show that (projected) LMC allows to sample in polynomial time from a log-concave distribution with smooth potential. This gives a new Markov chain to sample from a log-concave distribution. Our main result shows in particular that when the target distribution is uniform, LMC mixes in steps (where n is the dimension). We also provide preliminary experimental evidence that LMC performs at least as well as hit-and-run, for which a better mixing time of was proved by Lovasz and Vempala.
引用
收藏
页码:757 / 783
页数:27
相关论文
共 19 条
  • [1] Ahn S., 2012, P 29 INT C MACH LEAR, P782
  • [2] [Anonymous], 2013, ADV NEURAL INFORM PR
  • [3] Bypassing KLS: Gaussian Cooling and an O*(n3) Volume Algorithm
    Cousins, Ben
    Vempala, Santosh
    [J]. STOC'15: PROCEEDINGS OF THE 2015 ACM SYMPOSIUM ON THEORY OF COMPUTING, 2015, : 539 - 548
  • [4] Dalalyan A. S., J R STAT SOC STAT B, DOI [10.1111/rssb.12183, DOI 10.1111/RSSB.12183]
  • [5] A RANDOM POLYNOMIAL-TIME ALGORITHM FOR APPROXIMATING THE VOLUME OF CONVEX-BODIES
    DYER, M
    FRIEZE, A
    KANNAN, R
    [J]. JOURNAL OF THE ACM, 1991, 38 (01) : 1 - 17
  • [6] Random Walks on Polytopes and an Affine Interior Point Method for Linear Programming
    Kannan, Ravindran
    Narayanan, Hariharan
    [J]. MATHEMATICS OF OPERATIONS RESEARCH, 2012, 37 (01) : 1 - 20
  • [7] Ledoux M., 1991, ERGEBNISSE MATH IHRE, V23
  • [8] Representation formula for the entropy and functional inequalities
    Lehec, Joseph
    [J]. ANNALES DE L INSTITUT HENRI POINCARE-PROBABILITES ET STATISTIQUES, 2013, 49 (03): : 885 - 899
  • [9] Levin D. A., 2009, MARKOV CHAINS MIXING, DOI DOI 10.1090/MBK/058
  • [10] COUPLING OF MULTIDIMENSIONAL DIFFUSIONS BY REFLECTION
    LINDVALL, T
    ROGERS, LCG
    [J]. ANNALS OF PROBABILITY, 1986, 14 (03) : 860 - 872