Unscented Grid Filtering and Elman Recurrent Networks

被引:0
作者
Nikolaev, Nikolay Y. [1 ]
Mirikitani, Derrick [1 ]
Smirnov, Evgueni [2 ]
机构
[1] Univ London Goldsmiths Coll, Dept Comp, London SE14 6NW, England
[2] Maastricht Univ, Dept Comp, MICC IKAT, NL-6200 MD Maastricht, Netherlands
来源
2010 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS IJCNN 2010 | 2010年
关键词
KALMAN FILTER; SYSTEMS;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper develops an unscented grid-based filter for improved recurrent neural network modeling of time series. The filter approximates directly the weight posterior distribution as a linear mixture using deterministic unscented sampling. The weight posterior is obtained in one step, without linearisation through derivatives. An expectation maximisation algorithm is formulated for evaluation of the complete data likelihood and finding the state noise and observation noise hyperparemeters. Empirical investigations show that the proposed unscented grid filter compares favourably to other similar filters on recurrent network modeling of two real-world time series of environmental importance.
引用
收藏
页数:7
相关论文
共 21 条
[1]  
[Anonymous], 2004, Beyond the Kalman Filter: Particle Filters for Tracking Applications
[2]  
Arasaratnam I, 2008, LECT NOTES ARTIF INT, V5317, P12, DOI 10.1007/978-3-540-88636-5_2
[3]   LEARNING LONG-TERM DEPENDENCIES WITH GRADIENT DESCENT IS DIFFICULT [J].
BENGIO, Y ;
SIMARD, P ;
FRASCONI, P .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1994, 5 (02) :157-166
[4]   DIGITAL SYNTHESIS OF NON-LINEAR FILTERS [J].
BUCY, RS ;
SENNE, KD .
AUTOMATICA, 1971, 7 (03) :287-&
[5]   Online state-space modeling using recurrent multilayer perceptrons with unscented Kalman filter [J].
Choi, J ;
Yeap, TH ;
Bouchard, M .
NEURAL PROCESSING LETTERS, 2005, 22 (01) :69-84
[6]   FINDING STRUCTURE IN TIME [J].
ELMAN, JL .
COGNITIVE SCIENCE, 1990, 14 (02) :179-211
[7]   A new extension of the Kalman filter to nonlinear systems [J].
Julier, SJ ;
Uhlmann, JK .
SIGNAL PROCESSING, SENSOR FUSION, AND TARGET RECOGNITION VI, 1997, 3068 :182-193
[8]   A nonlinear filtering algorithm based on an approximation of the conditional distribution [J].
Kushner, HJ ;
Budhiraja, AS .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2000, 45 (03) :580-585
[9]  
LUNDSTEDT H, 2002, GEOPYS RES LETT, V29
[10]   Training recurrent neurocontrollers for robustness with derivative-free Kalman filter [J].
Prokhorov, Danil V. .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2006, 17 (06) :1606-1616