Additive smoothing error in backward variational inference for general state-space models

被引:0
作者
Chagneux, Mathis [1 ]
Gassiat, Elisabeth [2 ]
Gloaguen, Pierre [3 ]
Le Cor, Sylvain [4 ]
机构
[1] Telecom Paris, LTCI, Palaiseau, France
[2] Univ Paris Saclay, Lab Math Orsay, CNRS, Orsay, France
[3] Univ Bretagne Sud, Lorient, France
[4] Sorbonne Univ, UMR CNRS 8001, LPSM, Paris, France
关键词
Variational inference; State-space models; Smoothing; Backward decomposi tion; State inference;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the problem of state estimation in general state-space models using variational inference. For a generic variational family defined using the same backward decomposition as the actual joint smoothing distribution, we establish under mixing assumptions that the variational approximation of expectations of additive state functionals induces an error which grows at most linearly in the number of observations. This guarantee is consistent with the known upper bounds for the approximation of smoothing distributions using standard Monte Carlo methods. We illustrate our theoretical result with state-of-the art variational solutions based both on the backward parameterization and on alternatives using forward decompositions. This numerical study proposes guidelines for variational inference based on neural networks in state-space models.
引用
收藏
页数:33
相关论文
共 27 条
[1]  
Bayer J., 2021, INT C LEARN REPR
[2]  
Campbell A, 2021, ADV NEUR IN, V34
[3]  
Cappe O., 2005, Inference in Hidden Markov Models
[4]   Stability of nonlinear filters in nonmixing case [J].
Chigansky, P ;
Liptser, R .
ANNALS OF APPLIED PROBABILITY, 2004, 14 (04) :2038-2056
[5]  
Chopin N., 2020, Importance Sampling
[6]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[7]   Forgetting the initial distribution for Hidden Markov Models [J].
Douc, R. ;
Fort, G. ;
Moulines, E. ;
Priouret, P. .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 2009, 119 (04) :1235-1256
[8]   SEQUENTIAL MONTE CARLO SMOOTHING FOR GENERAL STATE SPACE HIDDEN MARKOV MODELS [J].
Douc, Randal ;
Garivier, Aurelien ;
Moulines, Eric ;
Olsson, Jimmy .
ANNALS OF APPLIED PROBABILITY, 2011, 21 (06) :2109-2145
[9]  
Douc Randal, 2014, Nonlinear Time Series: Theory, Methods and Applications with R Examples
[10]   Non-asymptotic deviation inequalities for smoothed additive functionals in nonlinear state-space models [J].
Dubarry, Cyrille ;
Le Corff, Sylvain .
BERNOULLI, 2013, 19 (5B) :2222-2249