Dynamic ensemble extreme learning machine based on sample entropy

被引:115
作者
Zhai, Jun-hai [1 ]
Xu, Hong-yu [1 ]
Wang, Xi-zhao [1 ]
机构
[1] Hebei Univ, Coll Math & Comp Sci, Key Lab Machine Learning & Computat Intelligence, Baoding 071002, Hebei, Peoples R China
基金
中国国家自然科学基金;
关键词
Extreme learning machine; Dynamic ensemble; AdaBoost; Bagging; Sample entropy; NETWORK; CLASSIFIERS;
D O I
10.1007/s00500-012-0824-6
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extreme learning machine (ELM) as a new learning algorithm has been proposed for single-hidden layer feed-forward neural networks, ELM can overcome many drawbacks in the traditional gradient-based learning algorithm such as local minimal, improper learning rate, and low learning speed by randomly selecting input weights and hidden layer bias. However, ELM suffers from instability and over-fitting, especially on large datasets. In this paper, a dynamic ensemble extreme learning machine based on sample entropy is proposed, which can alleviate to some extent the problems of instability and over-fitting, and increase the prediction accuracy. The experimental results show that the proposed approach is robust and efficient.
引用
收藏
页码:1493 / 1502
页数:10
相关论文
共 37 条
[1]  
[Anonymous], 2002, Matrices: Theory and Applications
[2]   Multiple classifier systems for robust classifier design in adversarial environments [J].
Biggio, Battista ;
Fumera, Giorgio ;
Roli, Fabio .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2010, 1 (1-4) :27-41
[3]  
Breiman L, 1996, MACH LEARN, V24, P123, DOI 10.1023/A:1018054314350
[4]  
Brown G., 2005, Information Fusion, V6, P5, DOI 10.1016/j.inffus.2004.04.004
[5]   Handwritten character recognition using wavelet energy and extreme learning machine [J].
Chacko, Binu P. ;
Krishnan, V. R. Vimal ;
Raju, G. ;
Anto, P. Babu .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2012, 3 (02) :149-161
[6]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[7]   Error Minimized Extreme Learning Machine With Growth of Hidden Nodes and Incremental Learning [J].
Feng, Guorui ;
Huang, Guang-Bin ;
Lin, Qingping ;
Gay, Robert .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2009, 20 (08) :1352-1357
[8]   A decision-theoretic generalization of on-line learning and an application to boosting [J].
Freund, Y ;
Schapire, RE .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 1997, 55 (01) :119-139
[9]  
Gaitang Wang, 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering (ICACTE 2010), P54, DOI 10.1109/ICACTE.2010.5579726
[10]   NEURAL NETWORK ENSEMBLES [J].
HANSEN, LK ;
SALAMON, P .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1990, 12 (10) :993-1001