A new general nearest neighbor classification based on the mutual neighborhood information

被引:41
作者
Pan, Zhibin [1 ]
Wang, Yidi [1 ]
Ku, Weiping [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Peoples R China
关键词
Nearest neighbor classification; K-nearest neighbor rule; Small training sample size; Neighborhood selection method; Mutual neighborhood information; STATISTICAL COMPARISONS; CLASSIFIERS; ALGORITHMS; RULE;
D O I
10.1016/j.knosys.2017.01.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The nearest neighbor (NN) rule is effective for many applications in pattern classification, such as the famous k-nearest neighbor (kNN) classifier. However, NN-based classifiers perform a one-sided classification by finding the nearest neighbors simply according to the neighborhood of the testing sample. In this paper, we propose a new selection method of nearest neighbors based on a two-sided mode, called general nearest neighbor (GNN) rule. The mutual neighborhood information of both testing sample and training sample is considered, then the overlapping of the above neighborhoods is used to decide the general nearest neighbors of the testing sample. To verify the effectiveness of the GNN rule in pattern classification, a k-general nearest neighbor (kGNN) classifier is proposed by applying the k-neighborhood information of each sample to find the general nearest neighbors. Extensive experiments on twenty real-world datasets from UCI and KEEL repository and two Gaussian artificial datasets of the I-I and Ness dataset prove that the kGNN classifier outperforms the kNN classifier and seven other state-of-the-art NN-based classifiers, particularly in the situations of small training sample size. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:142 / 152
页数:11
相关论文
共 37 条
[21]   A new belief-based K-nearest neighbor classification method [J].
Liu, Zhun-ga ;
Pan, Quan ;
Dezert, Jean .
PATTERN RECOGNITION, 2013, 46 (03) :834-844
[22]   A local mean-based nonparametric classifier [J].
Mitani, Y ;
Hamamoto, Y .
PATTERN RECOGNITION LETTERS, 2006, 27 (10) :1151-1159
[23]   Nearest neighbour group-based classification [J].
Samsudin, Noor A. ;
Bradley, Andrew P. .
PATTERN RECOGNITION, 2010, 43 (10) :3458-3467
[24]   On the use of neighbourhood-based non-parametric classifiers [J].
Sanchez, JS ;
Pla, F ;
Ferri, FJ .
PATTERN RECOGNITION LETTERS, 1997, 18 (11-13) :1179-1186
[25]   Fuzzy-rough nearest neighbor algorithms in classification [J].
Sarkar, Manish .
FUZZY SETS AND SYSTEMS, 2007, 158 (19) :2134-2152
[26]   BIBLIOGRAPHY ON ESTIMATION OF MISCLASSIFICATION [J].
TOUSSAINT, GT .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1974, 20 (04) :472-479
[28]   CONVERGENCE OF NEAREST NEIGHBOR RULE [J].
WAGNER, TJ .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1971, 17 (05) :566-+
[29]   Neighborhood size selection in the k-nearest-neighbor rule using statistical confidence [J].
Wang, JG ;
Neskovic, P ;
Cooper, LN .
PATTERN RECOGNITION, 2006, 39 (03) :417-423
[30]  
Weinberger KQ, 2009, J MACH LEARN RES, V10, P207