Approximate kernel extreme learning machine for large scale data classification

被引:37
作者
Iosifidis, Alexandros [1 ,2 ]
Tefas, Anastasios [1 ]
Pitas, Ioannis [1 ,3 ]
机构
[1] Aristotle Univ Thessaloniki, Dept Informat, Thessaloniki, Greece
[2] Tampere Univ Technol, Dept Signal Proc, FIN-33101 Tampere, Finland
[3] Univ Bristol, Dept Elect & Elect Engn, Bristol BS8 1TH, Avon, England
关键词
Extreme Learning Machine; Large Scale Learning; Facial Image Classification; FEEDFORWARD NETWORKS; MATRIX;
D O I
10.1016/j.neucom.2016.09.023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose an approximation scheme of the Kernel Extreme Learning Machine algorithm for Single-hidden Layer Feedforward Neural network training that can be used for large scale classification problems. The Approximate Kernel Extreme Learning Machine is able to scale well in both computational cost and memory, while achieving good generalization performance. Regularized versions and extensions in order to exploit the total and within-class variance of the training data in the feature space are also proposed. Extensive experimental evaluation in medium-scale and large-scale classification problems denotes that the proposed approach is able to operate extremely fast in both the training and test phases and to provide satisfactory performance, outperforming relating classification schemes. (C) 2016 Elsevier B.V. All rights reserved.
引用
收藏
页码:210 / 220
页数:11
相关论文
共 50 条
[1]  
Achilioptas D., 2002, ADV NEURAL INF PROCE
[2]   Face description with local binary patterns:: Application to face recognition [J].
Ahonen, Timo ;
Hadid, Abdenour ;
Pietikainen, Matti .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) :2037-2041
[3]  
Argyriou A, 2009, J MACH LEARN RES, V10, P2507
[4]   Sparse Extreme Learning Machine for Classification [J].
Bai, Zuo ;
Huang, Guang-Bin ;
Wang, Danwei ;
Wang, Han ;
Westover, M. Brandon .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (10) :1858-1870
[5]   The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network [J].
Bartlett, PL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (02) :525-536
[6]  
Belabbas M., 2009, P NATL ACAD SCI US, V106
[7]  
Cao J., 2014, IEEE C IND EL APPL
[8]  
Chitta R., 2011, INT C KNOWL DISC DAT
[9]  
DEVIJVER PA, 1982, PATTERN RECOGNITION
[10]  
Drineas P, 2005, J MACH LEARN RES, V6, P2153