Dynamic ensemble extreme learning machine based on sample entropy

被引:115
作者
Zhai, Jun-hai [1 ]
Xu, Hong-yu [1 ]
Wang, Xi-zhao [1 ]
机构
[1] Hebei Univ, Coll Math & Comp Sci, Key Lab Machine Learning & Computat Intelligence, Baoding 071002, Hebei, Peoples R China
基金
中国国家自然科学基金;
关键词
Extreme learning machine; Dynamic ensemble; AdaBoost; Bagging; Sample entropy; NETWORK; CLASSIFIERS;
D O I
10.1007/s00500-012-0824-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extreme learning machine (ELM) as a new learning algorithm has been proposed for single-hidden layer feed-forward neural networks, ELM can overcome many drawbacks in the traditional gradient-based learning algorithm such as local minimal, improper learning rate, and low learning speed by randomly selecting input weights and hidden layer bias. However, ELM suffers from instability and over-fitting, especially on large datasets. In this paper, a dynamic ensemble extreme learning machine based on sample entropy is proposed, which can alleviate to some extent the problems of instability and over-fitting, and increase the prediction accuracy. The experimental results show that the proposed approach is robust and efficient.
引用
收藏
页码:1493 / 1502
页数:10
相关论文
共 37 条
  • [1] [Anonymous], 2002, Matrices: Theory and Applications
  • [2] Multiple classifier systems for robust classifier design in adversarial environments
    Biggio, Battista
    Fumera, Giorgio
    Roli, Fabio
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2010, 1 (1-4) : 27 - 41
  • [3] Breiman L, 1996, MACH LEARN, V24, P123, DOI 10.1023/A:1018054314350
  • [4] Brown G., 2005, Information Fusion, V6, P5, DOI 10.1016/j.inffus.2004.04.004
  • [5] Handwritten character recognition using wavelet energy and extreme learning machine
    Chacko, Binu P.
    Krishnan, V. R. Vimal
    Raju, G.
    Anto, P. Babu
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2012, 3 (02) : 149 - 161
  • [6] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [7] Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning
    Feng, Guorui
    Huang, Guang-Bin
    Lin, Qingping
    Gay, Robert
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (08): : 1352 - 1357
  • [8] A decision-theoretic generalization of on-line learning and an application to boosting
    Freund, Y
    Schapire, RE
    [J]. JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 1997, 55 (01) : 119 - 139
  • [9] Gaitang Wang, 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE 2010), P54, DOI 10.1109/ICACTE.2010.5579726
  • [10] NEURAL NETWORK ENSEMBLES
    HANSEN, LK
    SALAMON, P
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (10) : 993 - 1001