Online Modeling With Tunable RBF Network

被引:55
作者
Chen, Hao [1 ]
Gong, Yu [2 ]
Hong, Xia [1 ]
机构
[1] Univ Reading, Sch Syst Engn, Reading RG6 6UR, West Berkshire, England
[2] Univ Loughborough, Sch Elect Elect & Syst Engn, Loughborough LE11 3TU, Leics, England
基金
英国工程与自然科学研究理事会;
关键词
Multi-innovation recursive least square (MRLS); nonlinear; nonstationary; online modeling; quantum particle swarm optimization (QPSO); radial basis function (RBF); NONLINEAR-SYSTEM IDENTIFICATION; PARTICLE SWARM OPTIMIZATION; EXTREME LEARNING-MACHINE; NEURAL-NETWORK; ALGORITHM; REGRESSION; DECOMPOSITION; SELECTION;
D O I
10.1109/TSMCB.2012.2218804
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a novel online modeling algorithm for nonlinear and nonstationary systems using a radial basis function (RBF) neural network with a fixed number of hidden nodes. Each of the RBF basis functions has a tunable center vector and an adjustable diagonal covariance matrix. A multi-innovation recursive least square (MRLS) algorithm is applied to update the weights of RBF online, while themodeling performance is monitored. When the modeling residual of the RBF network becomes large in spite of the weight adaptation, a node identified as insignificant is replaced with a new node, for which the tunable center vector and diagonal covariance matrix are optimized using the quantum particle swarm optimization (QPSO) algorithm. The major contribution is to combine the MRLS weight adaptation and QPSO node structure optimization in an innovative way so that it can track well the local characteristic in the nonstationary system with a very sparse model. Simulation results show that the proposed algorithm has significantly better performance than existing approaches.
引用
收藏
页码:935 / 947
页数:13
相关论文
共 49 条
[1]  
[Anonymous], 1999, SYSTEM IDENTIFICATIO
[2]  
Birgmeier M, 1995, 1995 IEEE INTERNATIONAL CONFERENCE ON NEURAL NETWORKS PROCEEDINGS, VOLS 1-6, P259, DOI 10.1109/ICNN.1995.488105
[3]  
Box G.E. P., 1990, TIME SERIES ANAL
[4]   Clustering-based symmetric radial basis function beamforming [J].
Chen, S. ;
Labib, K. ;
Hanzo, L. .
IEEE SIGNAL PROCESSING LETTERS, 2007, 14 (09) :589-592
[5]   Regularized orthogonal least squares algorithm for constructing radial basis function networks [J].
Chen, S ;
Chng, ES ;
Alkadhimi, K .
INTERNATIONAL JOURNAL OF CONTROL, 1996, 64 (05) :829-837
[6]   RECURSIVE HYBRID ALGORITHM FOR NONLINEAR-SYSTEM IDENTIFICATION USING RADIAL BASIS FUNCTION NETWORKS [J].
CHEN, S ;
BILLINGS, SA ;
GRANT, PM .
INTERNATIONAL JOURNAL OF CONTROL, 1992, 55 (05) :1051-1070
[7]   Sparse kernel density construction using orthogonal forward regression with leave-one-out test score and local regularization [J].
Chen, S ;
Hong, X ;
Harris, CJ .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (04) :1708-1717
[8]   A Tunable Radial Basis Function Model for Nonlinear System Identification Using Particle Swarm Optimisation [J].
Chen, S. ;
Hong, X. ;
Luk, B. L. ;
Harris, C. J. .
PROCEEDINGS OF THE 48TH IEEE CONFERENCE ON DECISION AND CONTROL, 2009 HELD JOINTLY WITH THE 2009 28TH CHINESE CONTROL CONFERENCE (CDC/CCC 2009), 2009, :6762-6767
[9]   Sparse mzodeling using orthogonal forward regression with PRESS statistic and regularization [J].
Chen, S ;
Hong, X ;
Harris, CJ ;
Sharkey, PM .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2004, 34 (02) :898-911
[10]   Particle Swarm Optimization Aided Orthogonal Forward Regression for Unified Data Modeling [J].
Chen, Sheng ;
Hong, Xia ;
Harris, Chris J. .
IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION, 2010, 14 (04) :477-499