On the Linearity of Bayesian Interpolators for Non-Gaussian Continuous-Time AR(1) Processes

被引:9
作者
Amini, Arash [1 ]
Thevenaz, Philippe [1 ]
Ward, John Paul [1 ]
Unser, Michael [1 ]
机构
[1] Ecole Polytech Fed Lausanne, Biomed Imaging Grp, CH-1015 Lausanne, Switzerland
基金
瑞士国家科学基金会;
关键词
Alpha-stable innovation; autoregressive; Bayesian estimator; interpolation; Ornstein-Uhlenbeck process; MODELS; SPLINES;
D O I
10.1109/TIT.2013.2258371
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Bayesian estimation problems involving Gaussian distributions often result in linear estimation techniques. Nevertheless, there are no general statements as to whether the linearity of the Bayesian estimator is restricted to the Gaussian case. The two common strategies for non-Gaussian models are either finding the best linear estimator or numerically evaluating the Bayesian estimator by Monte Carlo methods. In this paper, we focus on Bayesian interpolation of non-Gaussian first-order autoregressive (AR) processes where the driving innovation can admit any symmetric infinitely divisible distribution characterized by the Levy-Khintchine representation theorem. We redefine the Bayesian estimation problem in the Fourier domain with the help of characteristic forms. By providing analytic expressions, we show that the optimal interpolator is linear for all symmetric alpha-stable distributions. The Bayesian interpolator can be expressed in a convolutive form where the kernel is described in terms of exponential splines. We also show that the limiting case of Levy-type AR(1) processes, the system of which has a pole at the origin, always corresponds to a linear Bayesian interpolator made of a piecewise linear spline, irrespective of the innovation distribution. Finally, we show the two mentioned cases to be the only ones within the family for which the Bayesian interpolator is linear.
引用
收藏
页码:5063 / 5074
页数:12
相关论文
共 32 条
[1]   Optimal filtering of a Gaussian signal in the presence of Levy noise [J].
Ahn, H ;
Feldman, RE .
SIAM JOURNAL ON APPLIED MATHEMATICS, 1999, 60 (01) :359-369
[2]   FITTING AUTOREGRESSIVE MODELS FOR PREDICTION [J].
AKAIKE, H .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 1969, 21 (02) :243-&
[3]   NONLINEAR BAYESIAN ESTIMATION USING GAUSSIAN SUM APPROXIMATIONS [J].
ALSPACH, DL ;
SORENSON, HW .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1972, AC17 (04) :439-&
[4]   Compressibility of Deterministic and Random Infinite Sequences [J].
Amini, Arash ;
Unser, Michael ;
Marvasti, Farokh .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (11) :5193-5201
[5]  
Anderson B.D.O., 1979, Optimal Filtering
[6]   Non-Gaussian Ornstein-Uhlenbeck-based models and some of their uses in financial economics [J].
Barndorff-Nielsen, OE ;
Shephard, N .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2001, 63 :167-207
[7]  
Benth F., 2007, Appl. Math. Finance, V14, P153
[8]  
Cho Y., 2009, INT C MACH LEARN MON
[9]   M-ESTIMATION FOR AUTOREGRESSIONS WITH INFINITE VARIANCE [J].
DAVIS, RA ;
KNIGHT, K ;
LIU, J .
STOCHASTIC PROCESSES AND THEIR APPLICATIONS, 1992, 40 (01) :145-180
[10]   On sequential Monte Carlo sampling methods for Bayesian filtering [J].
Doucet, A ;
Godsill, S ;
Andrieu, C .
STATISTICS AND COMPUTING, 2000, 10 (03) :197-208