SPECTRAL GAPS FOR A METROPOLIS-HASTINGS ALGORITHM IN INFINITE DIMENSIONS

被引:99
|
作者
Hairer, Martin [1 ]
Stuart, Andrew M. [1 ]
Vollmer, Sebastian J. [1 ]
机构
[1] Univ Warwick, Math Inst, Coventry CV4 7AL, W Midlands, England
来源
ANNALS OF APPLIED PROBABILITY | 2014年 / 24卷 / 06期
基金
英国工程与自然科学研究理事会;
关键词
CHAIN MONTE-CARLO; RECURRENT MARKOV-CHAINS; CENTRAL-LIMIT-THEOREM; MCMC METHODS; INVERSE PROBLEMS; ERROR-BOUNDS; INEQUALITIES; CONVERGENCE; SEMIGROUPS; SPACES;
D O I
10.1214/13-AAP982
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study the problem of sampling high and infinite dimensional target measures arising in applications such as conditioned diffusions and inverse problems. We focus on those that arise from approximating measures on Hilbert spaces defined via a density with respect to a Gaussian reference measure. We consider the Metropolis Hastings algorithm that adds an accept reject mechanism to a Markov chain proposal in order to make the chain reversible with respect to the target measure. We focus on cases where the proposal is either a Gaussian random walk (RWM) with covariance equal to that of the reference measure or an Ornstein-Uhlenbeck proposal (pCN) for which the reference measure is invariant. Previous results in terms of scaling and diffusion limits suggested that the pCN has a convergence rate that is independent of the dimension while the RWM method has undesirable dimension-dependent behaviour. We confirm this claim by exhibiting a dimension-independent Wasserstein spectral gap for pCN algorithm for a large class of target measures. In our setting this Wasserstein spectral gap implies an L-2-spectral gap. We use both spectral gaps to show that the ergodic average satisfies a strong law of large numbers, the central limit theorem and nonasymptotic bounds on the mean square error, all dimension independent. In contrast we show that the spectral gap of the RWM algorithm applied to the reference measures degenerates as the dimension tends to infinity.
引用
收藏
页码:2455 / 2490
页数:36
相关论文
共 50 条
  • [1] SPECTRAL GAPS AND ERROR ESTIMATES FOR INFINITE-DIMENSIONAL METROPOLIS-HASTINGS WITH NON-GAUSSIAN PRIORS
    Hosseini, Bamdad
    Johndrow, James E.
    ANNALS OF APPLIED PROBABILITY, 2023, 33 (03): : 1827 - 1873
  • [2] A history of the Metropolis-Hastings algorithm
    Hitchcock, DB
    AMERICAN STATISTICIAN, 2003, 57 (04): : 254 - 257
  • [3] UNDERSTANDING THE METROPOLIS-HASTINGS ALGORITHM
    CHIB, S
    GREENBERG, E
    AMERICAN STATISTICIAN, 1995, 49 (04): : 327 - 335
  • [4] The Implicit Metropolis-Hastings Algorithm
    Neklyudov, Kirill
    Egorov, Evgenii
    Vetrov, Dmitry
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), 2019, 32
  • [5] A Metropolis-Hastings Algorithm for Task Allocation
    Hamza, Doha
    Toonsi, Sarah
    Shamma, Jeff S.
    2021 60TH IEEE CONFERENCE ON DECISION AND CONTROL (CDC), 2021, : 4539 - 4545
  • [6] Maximal Couplings of the Metropolis-Hastings Algorithm
    O'Leary, John
    Wang, Guanyang
    Jacob, Pierre E.
    24TH INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS (AISTATS), 2021, 130
  • [7] Density estimation for the Metropolis-Hastings algorithm
    Sköld, M
    Roberts, GO
    SCANDINAVIAN JOURNAL OF STATISTICS, 2003, 30 (04) : 699 - 718
  • [8] Control variates for the Metropolis-Hastings algorithm
    Hammer, Hugo
    Tjelmeland, Hakon
    SCANDINAVIAN JOURNAL OF STATISTICS, 2008, 35 (03) : 400 - 414
  • [9] A geometric interpretation of the Metropolis-Hastings algorithm
    Billera, LJ
    Diaconis, P
    STATISTICAL SCIENCE, 2001, 16 (04) : 335 - 339
  • [10] A history of the Metropolis-Hastings algorithm - Comment
    Kotz, S
    Johnson, NL
    Read, CB
    Banks, DL
    AMERICAN STATISTICIAN, 2004, 58 (01): : 90 - 90