Extreme learning machine: algorithm, theory and applications

被引:425
作者
Ding, Shifei [1 ,2 ]
Zhao, Han [1 ]
Zhang, Yanan [1 ]
Xu, Xinzheng [1 ]
Nie, Ru [1 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Peoples R China
[2] Chinese Acad Sci, Inst Comp Technol, Key Lab Intelligent Informat Proc, Beijing 100190, Peoples R China
关键词
Extreme learning machine (ELM); Single-hidden layer feedforward neural networks (SLFNs); Local minimum; Over-fitting; Least-squares; NEURAL-NETWORK; RULE EXTRACTION; FUNCTION APPROXIMATION; SELECTION;
D O I
10.1007/s10462-013-9405-z
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Extreme learning machine (ELM) is a new learning algorithm for the single hidden layer feedforward neural networks. Compared with the conventional neural network learning algorithm it overcomes the slow training speed and over-fitting problems. ELM is based on empirical risk minimization theory and its learning process needs only a single iteration. The algorithm avoids multiple iterations and local minimization. It has been used in various fields and applications because of better generalization ability, robustness, and controllability and fast learning rate. In this paper, we make a review of ELM latest research progress about the algorithms, theory and applications. It first analyzes the theory and the algorithm ideas of ELM, then tracking describes the latest progress of ELM in recent years, including the model and specific applications of ELM, finally points out the research and development prospects of ELM in the future.
引用
收藏
页码:103 / 115
页数:13
相关论文
共 50 条
[1]  
[Anonymous], 2003, The Handbook of Brain Theory and Neural Networks
[2]  
[Anonymous], COMPUT ENG DES
[3]  
[Anonymous], MODERN DATA ANAL INF
[4]  
[Anonymous], ACTA PHYS SINICA
[5]  
[Anonymous], 1995, CONVOLUTIONAL NETWOR
[6]  
[Anonymous], ACTA PHYS SINICA
[7]   Learning Deep Architectures for AI [J].
Bengio, Yoshua .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2009, 2 (01) :1-127
[8]  
[常玉清 CHANG Yuqing], 2007, [系统仿真学报, Journal of System Simulation], V19, P5587
[9]   Ordinal extreme learning machine [J].
Deng, Wan-Yu ;
Zheng, Qing-Hua ;
Lian, Shiguo ;
Chen, Lin ;
Wang, Xin .
NEUROCOMPUTING, 2010, 74 (1-3) :447-456
[10]  
Deng Wan-Yu, 2010, Chinese Journal of Computers, V33, P279, DOI 10.3724/SP.J.1016.2010.00279