Matrix exponential based semi-supervised discriminant embedding for image classification

被引:32
作者
Dornaika, F. [1 ,2 ]
El Traboulsi, Y. [1 ]
机构
[1] Univ Basque Country, UPV EHU, San Sebastian, Spain
[2] Basque Fdn Sci, Ikerbasque, Bilbao, Spain
关键词
Graph-based semi-supervised learning; Small-sample-size (SSS) problem; Matrix exponential; Semi-supervised discriminant embedding (SDE); Distance diffusion mapping; Feature extraction; Image classification; NONLINEAR DIMENSIONALITY REDUCTION;
D O I
10.1016/j.patcog.2016.07.029
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Semi-supervised Discriminant Embedding (SDE) is the semi-supervised extension of Local Discriminant Embedding (LDE). Since this type of methods is in general dealing with high dimensional data, the small sample -size (SSS) problem very often occurs. This problem occurs when the number of available samples is less than the sample dimension. The classic solution to this problem is to reduce the dimension of the original data so that the reduced number of features is less than the number of samples. This can be achieved by using Principle Component Analysis for example. Thus, SDE needs either a dimensionality reduction or an explicit matrix regularization, with the shortcomings both techniques may suffer from. In this paper, we propose an exponential version of SDE (ESDE). In addition to overcoming the SSS problem, the latter emphasizes the discrimination property by enlarging distances between samples that belong to different classes. The experiments made on seven benchmark datasets show the superiority of our method over SDE and many state-of-the-art semi-supervised embedding methods. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:92 / 103
页数:12
相关论文
共 40 条
[1]   COMPUTING THE ACTION OF THE MATRIX EXPONENTIAL, WITH AN APPLICATION TO EXPONENTIAL INTEGRATORS [J].
Al-Mohy, Awad H. ;
Higham, Nicholas J. .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 2011, 33 (02) :488-511
[2]  
[Anonymous], 2005, P ICML WORKSHOP LEAR
[3]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[4]  
Cai D, 2007, IEEE C COMP VIS ICCV, V11, P1, DOI DOI 10.1109/CVPR.2007.383054
[5]  
Chapelle O, 2006, SEMISUPERVISED LEARN, V2
[6]  
Chen HT, 2005, IEEE I CONF COMP VIS, P1371
[7]  
de Sousa Celso Andre R., 2013, Machine Learning and Knowledge Discovery in Databases. European Conference, ECML PKDD 2013. Proceedings: LNCS 8190, P160, DOI 10.1007/978-3-642-40994-3_11
[8]  
Dornaika F., 2015, IEEE T CYBERNETICS, V46, P2006
[9]   Exponential Local Discriminant Embedding and Its Application to Face Recognition [J].
Dornaika, Fadi ;
Bosaghzadeh, Alireza .
IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (03) :921-934
[10]   Kernel flexible manifold embedding for pattern classification [J].
El Traboulsi, Y. ;
Dornaika, F. ;
Assoum, A. .
NEUROCOMPUTING, 2015, 167 :517-527