Improved pseudo nearest neighbor classification

被引:53
作者
Gou, Jianping [1 ]
Zhan, Yongzhao [1 ]
Rao, Yunbo [2 ]
Shen, Xiangjun [1 ]
Wang, Xiaoming [3 ]
He, Wu [4 ]
机构
[1] Jiangsu Univ, Sch Comp Sci & Telecommun Engn, Zhenjiang 212013, Jiangsu, Peoples R China
[2] Univ Elect Sci & Technol China, Sch Informat & Software Engn, Chengdu 610054, Peoples R China
[3] Xihua Univ, Sch Math & Comp Engn, Chengdu 610039, Sichuan, Peoples R China
[4] Sichuan Normal Univ, Digital Media Coll, Chengdu 610068, Sichuan, Peoples R China
基金
美国国家科学基金会;
关键词
k-Nearest neighbor rule; Pseudo nearest neighbor rule; Local mean vector; Pattern classification; Local mean-based pseudo nearest neighbor rule; STATISTICAL COMPARISONS; RULE; CLASSIFIERS; ALGORITHMS;
D O I
10.1016/j.knosys.2014.07.020
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
k-Nearest neighbor (KNN) rule is a very simple and powerful classification algorithm. In this article, we propose a new KNN-based classifier, called the local mean-based pseudo nearest neighbor (LMPNN) rule. It is motivated by the local mean-based k-nearest neighbor (LMKNN) rule and the pseudo nearest neighbor (PNN) rule, with the aim of improving the classification performance. In the proposed LMPNN, the k nearest neighbors from each class are searched as the class prototypes, and then the local mean vectors of the neighbors are yielded. Subsequently, we attempt to find the local mean-based pseudo nearest neighbor per class by employing the categorical k local mean vectors, and classify the unknown query patten according to the distances between the query and the pseudo nearest neighbors To assess the classification performance of the proposed LMPNN, it is compared with the competing classifiers, such as LMKNN and PNN, in terms of the classification error on thirty-two real UCI data sets, four artificial data sets and three image data sets. The comprehensively experimental results suggest that the proposed LMPNN classifier is a promising algorithm in pattern recognition. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:361 / 375
页数:15
相关论文
共 47 条
[11]   Local feature weighting in nearest prototype classification [J].
Fernandez, Fernando ;
Isasi, Pedro .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2008, 19 (01) :40-53
[12]  
Fukunaga K, 1990, INTRO STAT PATTERN R, V2nd
[13]   Prototype Selection for Nearest Neighbor Classification: Taxonomy and Empirical Study [J].
Garcia, Salvador ;
Derrac, Joaquin ;
Ramon Cano, Jose ;
Herrera, Francisco .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (03) :417-435
[14]  
García S, 2008, J MACH LEARN RES, V9, P2677
[15]   A Local Mean-Based k-Nearest Centroid Neighbor Classifier [J].
Gou, Jianping ;
Yi, Zhang ;
Du, Lan ;
Xiong, Taisong .
COMPUTER JOURNAL, 2012, 55 (09) :1058-1071
[16]   A Novel Weighted Voting for K-Nearest Neighbor Rule [J].
Gou, Jianping ;
Xiong, Taisong ;
Kuang, Yin .
JOURNAL OF COMPUTERS, 2011, 6 (05) :833-840
[17]   Discriminant adaptive nearest neighbor classification [J].
Hastie, T ;
Tibshirani, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (06) :607-616
[18]   A FUZZY K-NEAREST NEIGHBOR ALGORITHM [J].
KELLER, JM ;
GRAY, MR ;
GIVENS, JA .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS, 1985, 15 (04) :580-585
[19]   Combining classifiers using nearest decision prototypes [J].
Kheradpisheh, Saeed Reza ;
Behjati-Ardakani, Fatemeh ;
Ebrahimpour, Reza .
APPLIED SOFT COMPUTING, 2013, 13 (12) :4570-4578
[20]   The nearest neighbor algorithm of local probability centers [J].
Li, Boyu ;
Chen, Yun Wen ;
Chen, Yan Qiu .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2008, 38 (01) :141-154