A novel efficient two-phase algorithm for training interpolation radial basis function networks

被引:7
作者
Hoang Xuan Huan
Dang Thi Thu Hien
Huu Tue Huynh
机构
[1] Vietnam Natl Univ, Coll Technol, Fac Elect & telecommun, Hanoi, Vietnam
[2] Vietnam Natl Univ, Coll Technol, Fac Informat Technol, Hanoi, Vietnam
[3] Univ Laval, Dept Elect & Comp Engn, Quebec City, PQ, Canada
关键词
radial basis functions; width parameters; output weights; contraction transformation; fixed point;
D O I
10.1016/j.sigpro.2007.05.001
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Interpolation radial basis function (RBF) networks have been widely used in various applications. The output layer weights are usually determined by minimizing the sum-of-squares error or by directly solving interpolation equations. When the number of interpolation nodes is large, these methods are time consuming, difficult to control the balance between the convergence rate and the generality, and difficult to reach a high accuracy. In this paper, we propose a two-phase algorithm for training interpolation RBF networks with bell-shaped basis functions. In the first phase, the width parameters of basis functions are determined by taking into account the tradeoff between the error and the convergence rate. Then, the output layer weights are determined by finding the fixed point of a given contraction transformation. The running time of this new algorithm is relatively short and the balance between the convergence rate and the generality is easily controlled by adjusting the involved parameters, while the error is made as small as desired. Also, its running time can be further enhanced thanks to the possibility to parallelize the proposed algorithm. Finally, its efficiency is illustrated by simulations. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:2708 / 2717
页数:10
相关论文
共 15 条
[1]   LEARNING WITHOUT LOCAL MINIMA IN RADIAL BASIS FUNCTION NETWORKS [J].
BIANCHINI, M ;
FRASCONI, P ;
GORI, M .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (03) :749-756
[2]  
Blanzieri E., 2003, DIT03023 U TRENT
[3]  
Broomhead D. S., 1988, Complex Systems, V2, P321
[4]  
Collatz L, 1966, FUNCTIONAL ANAL NUME
[5]   Layered Neural Networks with Gaussian Hidden Units as Universal Approximations [J].
Hartman, Eric J. ;
Keeler, James D. ;
Kowalski, Jacek M. .
NEURAL COMPUTATION, 1990, 2 (02) :210-215
[6]  
Haykin S., 1999, Neural networks: a comprehensive foundation, V2nd ed.
[7]  
Huan H. X., 2005, P VIETN NAT WORKSH S, P314
[8]  
Looney C. G., 1997, PATTERN RECOGNITION
[9]   INTERPOLATION OF SCATTERED DATA - DISTANCE MATRICES AND CONDITIONALLY POSITIVE DEFINITE FUNCTIONS [J].
MICCHELLI, CA .
CONSTRUCTIVE APPROXIMATION, 1986, 2 (01) :11-22
[10]  
MITHCHELL TM, 1997, MACHINE LEARNING