A new locally adaptive K-nearest centroid neighbor classification based on the average distance

被引:3
作者
Wang, Benqiang [1 ]
Zhang, Shunxiang [1 ]
机构
[1] Anhui Univ Sci & Technol, Huainan 232001, Peoples R China
关键词
K-nearest neighbor; k-nearest centroid neighbor; average distance; adaptive k value;
D O I
10.1080/09540091.2022.2088695
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The classification performance of a k-nearest neighbour (KNN) method is dependent on the choice of the k neighbours of a query. However, it is difficult to optimise the performance of KNN by choosing appropriate neighbours and an appropriate value of k. Moreover, the performance of KNN suffers from the use of a simple majority voting method. To address these three issues, we propose a new locally adaptive k-nearest centroid neighbour classification based on the average distance (AD-LAKNCN) in this paper. First, the k neighbours of the query based on the nearest centroid neighbour (NCN) are found, and the discrimination classes with different k values are derived from the number and distribution of each class of neighbours considered in the query. Then, based on the distribution information in the discrimination class for each k, the adaptive k and the final classification result are obtained. The experimental results based on 24 real-world datasets show that the new method achieves better classification performance than nine other state-of-the-art KNN algorithms.
引用
收藏
页码:2084 / 2107
页数:24
相关论文
共 29 条
[1]  
Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
[2]  
[Anonymous], Learning When Data Sets are Imbalanced and When Costs are Unequal and Unknown
[3]   A new definition of neighborhood of a point in multi-dimensional space [J].
Chaudhuri, BB .
PATTERN RECOGNITION LETTERS, 1996, 17 (01) :11-17
[4]   NEAREST NEIGHBOR PATTERN CLASSIFICATION [J].
COVER, TM ;
HART, PE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) :21-+
[5]  
Dua D, 2017, UCI MACHINE LEARNING
[6]  
DUDANI SA, 1976, IEEE T SYST MAN CYB, V6, P327
[7]  
Gou J., 2012, J Inform Comput Sci, V9, P1429
[8]   A representation coefficient-based k-nearest centroid neighbor classifier [J].
Gou, Jianping ;
Sun, Liyuan ;
Du, Lan ;
Ma, Hongxing ;
Xiong, Taisong ;
Ou, Weihua ;
Zhan, Yongzhao .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 194
[9]   A Local Mean Representation-based K-Nearest Neighbor Classifier [J].
Gou, Jianping ;
Qiu, Wenmo ;
Yi, Zhang ;
Xu, Yong ;
Mao, Qirong ;
Zhan, Yongzhao .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2019, 10 (03)
[10]   A generalized mean distance-based k-nearest neighbor classifier [J].
Gou, Jianping ;
Ma, Hongxing ;
Ou, Weihua ;
Zeng, Shaoning ;
Rao, Yunbo ;
Yang, Hebiao .
EXPERT SYSTEMS WITH APPLICATIONS, 2019, 115 :356-372