Regularization for the Kernel Recursive Least Squares CMAC

被引:0
作者
Laufer, C. [1 ]
Coghill, G. [1 ]
机构
[1] Univ Auckland, Elect & Elect Engn Dept, Auckland 1, New Zealand
来源
2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN) | 2012年
关键词
ALGORITHM;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The Cerebellar Model Articulation Controller (CMAC) neural network is an associative memory that is biologically inspired by the cerebellum, which is found in the brains of animals. In recent works, the kernel recursive least squares CMAC (KRLS-CMAC) was proposed as a superior alternative to the standard CMAC as it converges faster, does not require tuning of a learning rate parameter, and is much better at modeling. The KRLS-CMAC however, still suffered from the learning interference problem. Learning interference was addressed in the standard CMAC by regularization. Previous works have also applied regularization to kernelized CMACs, however they were not computationally feasible for large resolutions and dimensionalities. This paper brings the regularization technique to the KRLS-CMAC in a way that allows it to be used efficiently in multiple dimensions with infinite resolution kernel functions.
引用
收藏
页数:8
相关论文
共 12 条
[1]  
[Anonymous], 2020, SAR, DOI [DOI 10.1115/1.3426922, DOI 10.12000/JR20018]
[2]   THE INTERPOLATION CAPABILITIES OF THE BINARY CMAC [J].
BROWN, M ;
HARRIS, CJ ;
PARKS, PC .
NEURAL NETWORKS, 1993, 6 (03) :429-440
[3]   The kernel recursive least-squares algorithm [J].
Engel, Y ;
Mannor, S ;
Meir, R .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2004, 52 (08) :2275-2285
[4]  
Hiroaki Gomi M. K, 1990, P 29 C DEC CONTR HON
[5]   Kernel CMAC with improved capability [J].
Horvath, Gabor ;
Szabo, Tamas .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2007, 37 (01) :124-138
[6]  
Horváth G, 2009, LECT NOTES COMPUT SC, V5768, P698, DOI 10.1007/978-3-642-04274-4_72
[7]  
Laufer C, 2011, INT J MACHINE LEARNI, V1, P20
[8]  
Parks P. C., 1991, 1 IFAC S DES METH CO, P777
[9]   A learning algorithm of CMAC based on RLS [J].
Qin, T ;
Chen, ZH ;
Zhang, HT ;
Li, SF ;
Xiang, W ;
Li, M .
NEURAL PROCESSING LETTERS, 2004, 19 (01) :49-61
[10]  
SMITH RL, 1998, THESIS U AUCKLAND AU