ON BACKWARD SMOOTHING ALGORITHMS

被引:3
作者
Dau, Hai-dang [1 ]
Chopin, Nicolas [1 ]
机构
[1] Inst Polytech Paris, CREST ENSAE, Crest, France
关键词
State -space model; smoothing; sequential Monte Carlo; FEYNMAN-KAC; PARTICLE;
D O I
10.1214/23-AOS2324
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In the context of state-space models, skeleton-based smoothing algo-rithms rely on a backward sampling step, which by default, has a O(N-2) complexity (where N is the number of particles). Existing improvements in the literature are unsatisfactory: a popular rejection sampling-based approach, as we shall show, might lead to badly behaved execution time; another rejec-tion sampler with stopping lacks complexity analysis; yet another MCMC-inspired algorithm comes with no stability guarantee. We provide several re-sults that close these gaps. In particular, we prove a novel nonasymptotic stability theorem, thus enabling smoothing with truly linear complexity and adequate theoretical justification. We propose a general framework, which unites most skeleton-based smoothing algorithms in the literature and allows to simultaneously prove their convergence and stability, both in online and offline contexts. Furthermore, we derive, as a special case of that frame-work, a new coupling-based smoothing algorithm applicable to models with intractable transition densities. We elaborate practical recommendations and confirm those with numerical experiments.
引用
收藏
页码:2145 / 2169
页数:25
相关论文
共 34 条
[1]   Particle Markov chain Monte Carlo methods [J].
Andrieu, Christophe ;
Doucet, Arnaud ;
Holenstein, Roman .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2010, 72 :269-342
[2]  
[Anonymous], 2006, Foundations of multidimensional and metric data structures
[3]   Exact and computationally efficient likelihood-based estimation for discretely observed diffusion processes (with discussion) [J].
Beskos, Alexandros ;
Papaspiliopoulos, Omiros ;
Roberts, Gareth O. ;
Fearnhead, Paul .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2006, 68 :333-361
[4]  
Bishop C., 2006, Pattern Recognition and Machine Learning
[5]   Improved Particle Approximations to the Joint Smoothing Distribution Using Markov Chain Monte Carlo [J].
Bunch, Pete ;
Godsill, Simon .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2013, 61 (04) :956-963
[6]  
Chopin N., 2020, Springer Ser. Statist, DOI DOI 10.1007/978-3-030-47845-2
[7]  
DAU H.-D, 2023, Supplement to "On backward smoothing algorithms, DOI [10.1214/23-AOS2324SUPP, DOI 10.1214/23-AOS2324SUPP]
[8]  
Del Moral P, 2001, ANN APPL PROBAB, V11, P1166
[9]  
Del Moral P., 2004, PROB APPL S, P427
[10]   A BACKWARD PARTICLE INTERPRETATION OF FEYNMAN-KAC FORMULAE [J].
Del Moral, Pierre ;
Doucet, Arnaud ;
Singh, Sumeetpal S. .
ESAIM-MATHEMATICAL MODELLING AND NUMERICAL ANALYSIS-MODELISATION MATHEMATIQUE ET ANALYSE NUMERIQUE, 2010, 44 (05) :947-975