A new general nearest neighbor classification based on the mutual neighborhood information

被引:41
作者
Pan, Zhibin [1 ]
Wang, Yidi [1 ]
Ku, Weiping [1 ]
机构
[1] Xi An Jiao Tong Univ, Sch Elect & Informat Engn, Xian 710049, Peoples R China
关键词
Nearest neighbor classification; K-nearest neighbor rule; Small training sample size; Neighborhood selection method; Mutual neighborhood information; STATISTICAL COMPARISONS; CLASSIFIERS; ALGORITHMS; RULE;
D O I
10.1016/j.knosys.2017.01.021
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The nearest neighbor (NN) rule is effective for many applications in pattern classification, such as the famous k-nearest neighbor (kNN) classifier. However, NN-based classifiers perform a one-sided classification by finding the nearest neighbors simply according to the neighborhood of the testing sample. In this paper, we propose a new selection method of nearest neighbors based on a two-sided mode, called general nearest neighbor (GNN) rule. The mutual neighborhood information of both testing sample and training sample is considered, then the overlapping of the above neighborhoods is used to decide the general nearest neighbors of the testing sample. To verify the effectiveness of the GNN rule in pattern classification, a k-general nearest neighbor (kGNN) classifier is proposed by applying the k-neighborhood information of each sample to find the general nearest neighbors. Extensive experiments on twenty real-world datasets from UCI and KEEL repository and two Gaussian artificial datasets of the I-I and Ness dataset prove that the kGNN classifier outperforms the kNN classifier and seven other state-of-the-art NN-based classifiers, particularly in the situations of small training sample size. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:142 / 152
页数:11
相关论文
共 37 条
[1]  
Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
[2]  
[Anonymous], 1990, Introduction to statistical pattern recognition
[3]  
[Anonymous], IEEE T NEURAL NETW L, DOI [10.1109/TNNLS.2016.2527796, DOI 10.1109/TNNLS.2016.2527796]
[4]  
BAILEY T, 1978, IEEE T SYST MAN CYB, V8, P311
[5]  
Bhattacharya G., 2015, P 2015 INT C MAN
[6]   NEAREST NEIGHBOR PATTERN CLASSIFICATION [J].
COVER, TM ;
HART, PE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) :21-+
[7]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[8]   Locally adaptive metric nearest-neighbor classification [J].
Domeniconi, C ;
Peng, J ;
Gunopulos, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (09) :1281-1285
[9]  
DUDANI SA, 1976, IEEE T SYST MAN CYB, V6, P327
[10]   A novel two-level nearest neighbor classification algorithm using an adaptive distance metric [J].
Gao, Yunlong ;
Pan, Jinyan ;
Ji, Guoli ;
Yang, Zijiang .
KNOWLEDGE-BASED SYSTEMS, 2012, 26 :103-110