Optimal acceptance rates for Metropolis algorithms: Movin beyond 0.234

被引:50
作者
Bedard, Mylene [1 ]
机构
[1] Univ Montreal, Dept Math & Stat, Montreal, PQ H3C 3J7, Canada
基金
加拿大自然科学与工程研究理事会;
关键词
Weak convergence; Optimal scaling; Langevin diffusion; Generator; Markov chain Monte Carlo;
D O I
10.1016/j.spa.2007.12.005
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Recent optimal scaling theory has produced a condition for the asymptotically optimal acceptance rate of Metropolis algorithms to be the well-known 0.234 when applied to certain multi-dimensional target distributions. These d-dimensional target distributions are formed of independent components, each of which is scaled according to its own function of d. We show that when the condition is not met the limiting process of the algorithm is altered, yielding an asymptotically optimal acceptance rate which might drastically differ from the usual 0.234. Specifically, we prove that as d -> infinity the sequence of stochastic processes formed by say the i*th component of each Markov chain Usually converges to a Langevin diffusion process with a new speed measure v, except in particular cases where it converges to a one-dimensional Metropolis algorithm with acceptance rule alpha*. We also discuss the use of inhomogeneous proposals, which might prove to be essential in specific cases. (C) 2008 Elsevier B.V. All rights reserved.
引用
收藏
页码:2198 / 2222
页数:25
相关论文
共 15 条
[1]  
[Anonymous], 2004, Probability Surveys, DOI 10.1214/154957804100000024
[2]  
[Anonymous], 2000, 1 LOOK RIGOROUS PROB
[3]  
BEDARD M, 2006, J COMPUT GR IN PRESS
[4]   Weak convergence of metropolis algorithms for non-IID target distributions [J].
Bedard, Mylene .
ANNALS OF APPLIED PROBABILITY, 2007, 17 (04) :1222-1244
[5]   BAYESIAN COMPUTATION AND STOCHASTIC-SYSTEMS [J].
BESAG, J ;
GREEN, P ;
HIGDON, D ;
MENGERSEN, K .
STATISTICAL SCIENCE, 1995, 10 (01) :3-41
[6]  
BESAG J, 1993, J ROY STAT SOC B MET, V55, P25
[7]   From metropolis to diffusions: Gibbs states and optimal scaling [J].
Breyer, LA ;
Roberts, GO .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2000, 90 (02) :181-206
[8]  
CHRISTENSEN OF, 2003, J R STAT SOC B, V67, P253
[9]  
ETHIER S, 1986, PROCESSES CHARACTERI
[10]  
HASTINGS WK, 1970, BIOMETRIKA, V57, P97, DOI 10.1093/biomet/57.1.97