Latent Autoregressive Gaussian Processes Models for Robust System Identification

被引:14
作者
Mattos, Cesar Lincoln C. [1 ]
Damianou, Andreas [2 ,3 ]
Barreto, Guilherme A. [1 ]
Lawrence, Neil D. [2 ,3 ]
机构
[1] Univ Fed Ceara, Dept Teleinformat Engn, Ctr Technol, Campus Pici, Fortaleza, Ceara, Brazil
[2] Univ Sheffield, Dept Comp Sci, Sheffield, S Yorkshire, England
[3] Univ Sheffield, SITraN, Sheffield, S Yorkshire, England
关键词
Modelling and system identification; dynamic modelling; Gaussian process; outliers; autoregressive models;
D O I
10.1016/j.ifacol.2016.07.353
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We introduce GP-RLARX, a novel Gaussian Process (GP) model for robust, system identification. Our approach draws inspiration front nonlinear autoregressive modeling with exogenous inputs (NARX) and it encapsulates a novel and powerful structure referred to as latent autoregression. This structure accounts for the feedback of uncertain values during training and provides a natural framework for free simulation prediction. By using a Student-t likelihood, GP-RLARX can be used in scenarios where the estimation data contain non-Gaussian noise in the form of outliers. Further, a variational approximation scheme is developed to jointly optimize all the hyperparameters of the model from available estimation data. We perform experiments with five widely used artificial benchmarking datasets with different levels of outlier contamination and compare GP-RLARX with the standard GP-NARX model and its robust variant, GP-tVB. GP-RLARX is found to outperform the competing him by a relatively wide margin, indicating that our latent autoregressive structure is more suitable for robust system identification. (C) 2016, IFAC (International Federation of Automatic Control) Hosting by Elsevier Ltd. All rights reserved.
引用
收藏
页码:1121 / 1126
页数:6
相关论文
共 23 条
[1]  
[Anonymous], 2011, ADV NEURAL INFORM PR, DOI DOI 10.5555/2986459.2986609
[2]  
[Anonymous], 2014, Advances in Neural Information Processing Systems
[3]   Dynamical systems identification using Gaussian process models with incorporated local models [J].
Azman, K. ;
Kocijan, J. .
ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2011, 24 (02) :398-408
[4]  
Billings SA, 2013, NONLINEAR SYSTEM IDENTIFICATION: NARMAX METHODS IN THE TIME, FREQUENCY, AND SPATIO-TEMPORAL DOMAINS, P1, DOI 10.1002/9781118535561
[5]  
Bishop Christopher M., 2006, Pattern Recognition and Machine Learning, V4
[6]  
Damianou A., 2015, Deep gaussian processes and variational propagation of uncertainty
[7]  
Frigola R, 2013, IEEE DECIS CONTR P, P5371, DOI 10.1109/CDC.2013.6760734
[8]  
Girard Agathe., 2002, ADV NEURAL INFORM PR, V15, P529
[9]   An introduction to variational methods for graphical models [J].
Jordan, MI ;
Ghahramani, Z ;
Jaakkola, TS ;
Saul, LK .
MACHINE LEARNING, 1999, 37 (02) :183-233
[10]   Dynamic systems identification with Gaussian processes [J].
Kocijan, J ;
Girard, A ;
Banko, B ;
Murray-Smith, R .
MATHEMATICAL AND COMPUTER MODELLING OF DYNAMICAL SYSTEMS, 2005, 11 (04) :411-424