Tikhonov training of the CMAC neural network

被引:6
|
作者
Weruaga, Luis [1 ]
Kieslinger, Barbara
机构
[1] Austrian Acad Sci, Commiss Sci Visualizat, A-1220 Vienna, Austria
[2] Ctr Social Innovat, A-1150 Vienna, Austria
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2006年 / 17卷 / 03期
关键词
cerebellar model articulation controller (CMAC); generalization; overfitting; Tikhonov regularization;
D O I
10.1109/TNN.2006.872348
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The architecture of the cerebellar model articulation controller (CMAC) presents a rigid compromise between learning and generalization. In the presence of a sparse training dataset, this limitation manifestly causes overfitting, a drawback that is not overcome by current training algorithms. This paper proposes a novel training framework founded on the Tikhonov regularization, which relates to the minimization of the power of the sigma-order derivative. This smoothness criterion yields to an internal cell-interaction mechanism that increases the generalization beyond the degree hardcoded in the CMAC architecture while preserving the potential CMAC learning capabilities. The resulting training mechanism, which proves to be simple and computationally efficient, is deduced from a rigorous theoretical study. The performance of the new training framework is validated against comparative benchmarks from the DELVE environment.
引用
收藏
页码:613 / 622
页数:10
相关论文
共 50 条
  • [1] Active training on the CMAC neural network
    Weruaga, L
    2004 IEEE INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, VOLS 1-4, PROCEEDINGS, 2004, : 855 - 860
  • [2] On the training of a multi-resolution CMAC neural network
    Menozzi, A
    Chow, MY
    IECON '97 - PROCEEDINGS OF THE 23RD INTERNATIONAL CONFERENCE ON INDUSTRIAL ELECTRONICS, CONTROL, AND INSTRUMENTATION, VOLS. 1-4, 1997, : 1130 - 1135
  • [3] On the training of a multi-resolution CMAC neural network
    Menozzi, Alberico
    Chow, Mo-Yuen
    IECON Proceedings (Industrial Electronics Conference), 1997, 3 : 1130 - 1135
  • [4] On the training of a multi-resolution CMAC neural network
    Menozzi, A
    Chow, MY
    ISIE '97 - PROCEEDINGS OF THE IEEE INTERNATIONAL SYMPOSIUM ON INDUSTRIAL ELECTRONICS, VOLS 1-3, 1997, : 1201 - 1205
  • [5] Eigenanalysis of CMAC neural network
    Zhang, CS
    ADVANCES IN NEURAL NETWORKS - ISNN 2005, PT 1, PROCEEDINGS, 2005, 3496 : 75 - 80
  • [6] Fuzzy CMAC neural network
    Deng, Zhidong
    Sun, Zengqi
    Zhang, Zaixing
    Zidonghua Xuebao/Acta Automatica Sinica, 1995, 21 (03): : 288 - 294
  • [7] Fuzzy CMAC neural network
    Northeastern Univ, Shenyang, China
    Zidonghua Xuebao, 2 (173-178):
  • [8] Inverse training scheme for MS_CMAC neural network to handle random training data
    Jan, Jiun-Chi
    Chen, Chih-Ming
    Hsiao, Liang-Hao
    NEUROCOMPUTING, 2006, 70 (1-3) : 502 - 512
  • [9] Improved CMAC neural network algorithm
    Liu, Hui
    Xu, Xiaoming
    Zhang, Zhongjun
    Zidonghua Xuebao/Acta Automatica Sinica, 1997, 23 (04): : 482 - 488
  • [10] A New Improved CMAC Neural Network
    Ge, Yingqi
    Luo, Xiaoping
    Du, Pengying
    2010 CHINESE CONTROL AND DECISION CONFERENCE, VOLS 1-5, 2010, : 3271 - +