Training extreme learning machine via regularized correntropy criterion

被引:45
作者
Xing, Hong-Jie [1 ]
Wang, Xin-Mei [2 ]
机构
[1] Hebei Univ, Coll Math & Comp Sci, Key Lab Machine Learning & Computat Intelligence, Baoding 071002, Peoples R China
[2] Hebei Univ, Coll Math & Comp Sci, Baoding 071002, Peoples R China
基金
中国国家自然科学基金;
关键词
Extreme learning machine; Correntropy; Regularization term; Half-quadratic optimization; FUZZY DECISION TREES; CLASSIFICATION; RECOGNITION; NETWORK; MODEL;
D O I
10.1007/s00521-012-1184-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a regularized correntropy criterion (RCC) for extreme learning machine (ELM) is proposed to deal with the training set with noises or outliers. In RCC, the Gaussian kernel function is utilized to substitute Euclidean norm of the mean square error (MSE) criterion. Replacing MSE by RCC can enhance the anti-noise ability of ELM. Moreover, the optimal weights connecting the hidden and output layers together with the optimal bias terms can be promptly obtained by the half-quadratic (HQ) optimization technique with an iterative manner. Experimental results on the four synthetic data sets and the fourteen benchmark data sets demonstrate that the proposed method is superior to the traditional ELM and the regularized ELM both trained by the MSE criterion.
引用
收藏
页码:1977 / 1986
页数:10
相关论文
共 39 条
  • [1] [Anonymous], 1971, Generalized Inverses of Matrices and its Applications
  • [2] [Anonymous], 1983, MATRIX COMPUTATION
  • [3] Boyd S., 2004, CONVEX OPTIMIZATION, VFirst, DOI DOI 10.1017/CBO9780511804441
  • [4] Self-Adaptive Evolutionary Extreme Learning Machine
    Cao, Jiuwen
    Lin, Zhiping
    Huang, Guang-Bin
    [J]. NEURAL PROCESSING LETTERS, 2012, 36 (03) : 285 - 305
  • [5] Handwritten character recognition using wavelet energy and extreme learning machine
    Chacko, Binu P.
    Krishnan, V. R. Vimal
    Raju, G.
    Anto, P. Babu
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2012, 3 (02) : 149 - 161
  • [6] Fast automatic two-stage nonlinear model identification based on the extreme learning machine
    Deng, Jing
    Li, Kang
    Irwin, George W.
    [J]. NEUROCOMPUTING, 2011, 74 (16) : 2422 - 2429
  • [7] Frank A., 2010, UCI machine learning repository, V213
  • [8] He R, 2012, P IEEE INT C COMP VI
  • [9] A Regularized Correntropy Framework for Robust Pattern Recognition
    He, Ran
    Zheng, Wei-Shi
    Hu, Bao-Gang
    Kong, Xiang-Wei
    [J]. NEURAL COMPUTATION, 2011, 23 (08) : 2074 - 2100
  • [10] Robust Principal Component Analysis Based on Maximum Correntropy Criterion
    He, Ran
    Hu, Bao-Gang
    Zheng, Wei-Shi
    Kong, Xiang-Wei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2011, 20 (06) : 1485 - 1494