Component-based global k-NN classifier for small sample size problems

被引:16
作者
Zhang, Nan [1 ]
Yang, Jian [1 ]
Qian, Jian-jun [1 ]
机构
[1] Nanjing Univ Sci & Technol, Sch Comp Sci & Technol, Nanjing 210094, Jiangsu, Peoples R China
关键词
k-NN classifier; LRC; SRC; Tikhonov regularization; Pattern classification; NEAREST-NEIGHBOR CLASSIFIERS; FACE-RECOGNITION; RIDGE-REGRESSION; SIGNAL RECOVERY;
D O I
10.1016/j.patrec.2012.05.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The classical k-NN classifier has been widely used in pattern recognition. However, it does not take into account the structural information of local samples. This paper presents a novel classifier named component-based global k-NN classifier (CG-k-NN), which takes advantage of the structural information of the local neighbors for enhancing the classification performance. We choose k nearest neighbors of a given testing sample globally at first, and then use these neighbors to represent the testing sample via ridge regression. In the further step, we construct the component image of each class by using the intra-class images from the k nearest neighbors and the corresponding representation coefficients. Finally, the testing sample is assigned to the class that minimizes reconstruction residual. The proposed method CG-k-NN is evaluated using the ORL, FERET, AR face image database and PolyU palmprint databases. The experiment results demonstrate that our method is more efficient and effective than the state-of-the-art methods such as sparse representation based classifier (SRC) and linear regression based classifier (LRC). (c) 2012 Elsevier B.V. All rights reserved.
引用
收藏
页码:1689 / 1694
页数:6
相关论文
共 30 条
[1]  
[Anonymous], 1977, NEW YORK
[2]  
[Anonymous], TECHNOMETRICS
[3]  
[Anonymous], 2008, PRIMAL DUAL PURSUIT
[4]  
[Anonymous], P IEEE
[5]   Dynamic Updating for l1 Minimization [J].
Asif, M. Salman ;
Romberg, Justin .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2010, 4 (02) :421-434
[6]   Eigenfaces vs. Fisherfaces: Recognition using class specific linear projection [J].
Belhumeur, PN ;
Hespanha, JP ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1997, 19 (07) :711-720
[7]   Near-optimal signal recovery from random projections: Universal encoding strategies? [J].
Candes, Emmanuel J. ;
Tao, Terence .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2006, 52 (12) :5406-5425
[8]   Stable signal recovery from incomplete and inaccurate measurements [J].
Candes, Emmanuel J. ;
Romberg, Justin K. ;
Tao, Terence .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2006, 59 (08) :1207-1223
[9]  
Chen SSB, 2001, SIAM REV, V43, P129, DOI [10.1137/S003614450037906X, 10.1137/S1064827596304010]
[10]   Discriminant waveletfaces and nearest feature classifiers for face recognition [J].
Chien, JT ;
Wu, CC .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (12) :1644-1649