On the kernel Extreme Learning Machine speedup

被引:29
作者
Iosifidis, Alexandros [1 ]
Gabbouj, Moncef [1 ]
机构
[1] Tampere Univ Technol, Dept Signal Proc, FIN-33720 Tampere, Finland
关键词
Kernel extreme learning machine; Nystrom approximation; Graph-based regularization; NYSTROM METHOD;
D O I
10.1016/j.patrec.2015.09.015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we describe an approximate method for reducing the time and memory complexities of the kernel Extreme Learning Machine variants. We show that, by adopting a Nystrom-based kernel ELM matrix approximation, we can define an ELM space exploiting properties of the kernel ELM space that can be subsequently used to apply several optimization schemes proposed in the literature for ELM network training. The resulted ELM network can achieve good performance, which is comparable to that of its standard kernel ELM counterpart, while overcoming the time and memory restrictions on kernel ELM algorithms that render their application in large-scale learning problems prohibitive. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:205 / 210
页数:6
相关论文
共 37 条
[1]  
[Anonymous], 1996, Tech. Rep. CUCS-006-96
[2]  
Arthur D, 2007, PROCEEDINGS OF THE EIGHTEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P1027
[3]  
Bache K, 2013, UCI machine learning repository
[4]  
Broomhead D. S., 1988, Complex Systems, V2, P321
[5]   Graph Regularized Nonnegative Matrix Factorization for Data Representation [J].
Cai, Deng ;
He, Xiaofei ;
Han, Jiawei ;
Huang, Thomas S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2011, 33 (08) :1548-1560
[6]   A rapid supervised learning neural network for function interpolation and approximation [J].
Chen, CLP .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1996, 7 (05) :1220-1230
[7]  
Drineas P, 2005, J MACH LEARN RES, V6, P2153
[8]  
Fletcher R., 1981, Practical Methods of Optimization, V2
[9]  
Frenay B., 2010, P 18 EUR S ART NEUR
[10]   Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions [J].
Halko, N. ;
Martinsson, P. G. ;
Tropp, J. A. .
SIAM REVIEW, 2011, 53 (02) :217-288