Manifold learning in local tangent space via extreme learning machine

被引:18
作者
Wang, Qian [1 ,2 ]
Wang, Weiguo [2 ]
Nian, Rui [1 ]
He, Bo [1 ]
Shen, Yue [1 ]
Bjork, Kaj-Mikael [3 ]
Lendasse, Amaury [3 ,4 ,5 ]
机构
[1] Ocean Univ China, Coll Informat Sci & Engn, Qingdao 266100, Peoples R China
[2] Ocean Univ China, Sch Math Sci, Qingdao 266100, Peoples R China
[3] Arcada Univ Appl Sci, Helsinki 00550, Finland
[4] Univ Iowa, Dept Mech & Ind Engn, Iowa City, IA 52242 USA
[5] Univ Iowa, Iowa Informat Initiat, Iowa City, IA 52242 USA
关键词
Extreme learning machine; Manifold learning; Local tangent space alignment; High-dimensional space; DIMENSIONALITY REDUCTION; NEURAL-NETWORKS; CLASSIFICATION; ALGORITHM; ELM; RECOGNITION; APPROXIMATION; REGRESSION; EIGENMAPS; FRAMEWORK;
D O I
10.1016/j.neucom.2015.03.116
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a fast manifold learning strategy to estimate the underlying geometrical distribution and develop the relevant mathematical criterion on the basis of the extreme learning machine (ELM) in the high-dimensional space. The local tangent space alignment (LTSA) method has been used to perform the manifold production and the single hidden layer feedforward network (SLFN) is established via ELM to simulate the low-dimensional representation process. The scheme of the ELM ensemble then combines the individual SLFN for the model selection, where the manifold regularization mechanism has been brought into ELM to preserve the local geometrical structure of LTSA. Some developments have been done to evaluate the inherent representation embedding in the ELM learning. The simulation results have shown the excellent performance in the accuracy and efficiency of the developed approach. (C) 2015 Elsevier B.V. All rights reserved.
引用
收藏
页码:18 / 30
页数:13
相关论文
共 40 条
[1]  
[Anonymous], P 18 EUR S ART NEUR
[2]   The sample complexity of pattern classification with neural networks: The size of the weights is more important than the size of the network [J].
Bartlett, PL .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (02) :525-536
[3]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[4]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[5]  
Cao J.W., 2015, MULTIMED TO IN PRESS
[6]  
Cao JW, 2014, C IND ELECT APPL, P1163, DOI 10.1109/ICIEA.2014.6931341
[7]   Bayesian signal detection with compressed measurements [J].
Cao, Jiuwen ;
Lin, Zhiping .
INFORMATION SCIENCES, 2014, 289 :241-253
[8]   Protein Sequence Classification with Improved Extreme Learning Machine Algorithms [J].
Cao, Jiuwen ;
Xiong, Lianglin .
BIOMED RESEARCH INTERNATIONAL, 2014, 2014
[9]   Extreme Learning Machines for Intrusion Detection [J].
Cheng, Chi ;
Tay, Wee Peng ;
Huang, Guang-Bin .
2012 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2012,
[10]   Circular-ELM for the reduced-reference assessment of perceived image quality [J].
Decherchi, Sergio ;
Gastaldo, Paolo ;
Zunino, Rodolfo ;
Cambria, Erik ;
Redi, Judith .
NEUROCOMPUTING, 2013, 102 :78-89