Adaptive three-way KNN classifier using density-based granular balls

被引:6
作者
Yang, Jie [1 ,2 ]
Kuang, Juncheng [1 ]
Wang, Guoyin [1 ]
Zhang, Qinghua [1 ]
Liu, Yanmin [2 ]
Liu, Qun [1 ]
Xia, Deyou [1 ]
Li, Shuai [1 ]
Wang, Xiaoqi [1 ]
Wu, Di [1 ,3 ]
机构
[1] Chongqing Univ Posts & Telecommun, Chongqing Key Lab Computat Intelligence, Chongqing 400065, Peoples R China
[2] Zunyi Normal Univ, Sch Informat Engn, Zunyi 563002, Peoples R China
[3] Southwest Univ, Coll Comp & Informat Sci, Chongqing 400715, Peoples R China
基金
美国国家科学基金会;
关键词
Granular ball computing; KNN; Density peak clustering; Fuzziness; Three-way decision; ATTRIBUTE REDUCTION; SET; DECISION;
D O I
10.1016/j.ins.2024.120858
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The granular ball k-nearest neighbors (GBKNN) algorithm improves the efficiency and robustness of traditional k-nearest neighbors (KNN) by replacing point input with granular ball. However, in the generation process of granular balls by GBKNN, there may be unbalanced distribution of data points existed in some granular balls, which will cause more classification errors. In addition, the fixed value of k in GBKNN may also reduce the accuracy of classification. In order to address these issues, an adaptive three-way KNN classifier using density-based granular balls is proposed. Firstly, an improved density-based granular ball computing using density peak clustering is presented. This method introduces a refined threshold to subdivide the granular balls. Secondly, a data-driven neighborhood is defined to search the optimal k value and a density-based granular ball KNN (DBGBKNN) algorithm is proposed. Thirdly, by considering the fuzziness of the testing set in the classification process, the density-based granular ball KNN with three-way decision (DBGBKNN-3WD) is constructed. Finally, experimental results verify that DBGBKNN-3WD achieves high comprehensive score and low time complexity while maintaining less fuzziness loss than other algorithms.
引用
收藏
页数:18
相关论文
共 46 条
[1]   Matrix-based method for solving decision domains of neighbourhood multigranulation decision-theoretic rough sets [J].
Chen, Jiajun ;
Yu, Shuhao ;
Wei, Wenjie ;
Ma, Yan .
CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2022, 7 (02) :313-327
[2]   Granular ball guided selector for attribute reduction [J].
Chen, Yan ;
Wang, Pingxin ;
Yang, Xibei ;
Mi, Jusheng ;
Liu, Dun .
KNOWLEDGE-BASED SYSTEMS, 2021, 229
[3]   NEAREST NEIGHBOR PATTERN CLASSIFICATION [J].
COVER, TM ;
HART, PE .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1967, 13 (01) :21-+
[4]   DEVIATION OPTIMAL LEARNING USING GREEDY Q-AGGREGATION [J].
Dai, Dong ;
Rigollet, Philippe ;
Zhang, Tong .
ANNALS OF STATISTICS, 2012, 40 (03) :1878-1905
[5]   Regret-Theoretic Multiattribute Decision-Making Model Using Three-Way Framework in Multiscale Information Systems [J].
Deng, Jiang ;
Zhan, Jianming ;
Xu, Zeshui ;
Herrera-Viedma, Enrique .
IEEE TRANSACTIONS ON CYBERNETICS, 2023, 53 (06) :3988-4001
[6]   Electrical load forecasting: A deep learning approach based on K-nearest neighbors [J].
Dong, Yunxuan ;
Ma, Xuejiao ;
Fu, Tonglin .
APPLIED SOFT COMPUTING, 2021, 99
[7]   M3W: Multistep Three-Way Clustering [J].
Du, Mingjing ;
Zhao, Jingqi ;
Sun, Jiarui ;
Dong, Yongquan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (04) :5627-5640
[8]   A novel cluster validity index based on augmented non-shared nearest neighbors [J].
Duan, Xinjie ;
Ma, Yan ;
Zhou, Yuqing ;
Huang, Hui ;
Wang, Bin .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 223
[9]   A representation coefficient-based k-nearest centroid neighbor classifier [J].
Gou, Jianping ;
Sun, Liyuan ;
Du, Lan ;
Ma, Hongxing ;
Xiong, Taisong ;
Ou, Weihua ;
Zhan, Yongzhao .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 194
[10]   Attribute reduction based on overlap degree and k-nearest-neighbor rough sets in decision information systems [J].
Hu, Meng ;
Tsang, Eric C. C. ;
Guo, Yanting ;
Chen, Degang ;
Xu, Weihua .
INFORMATION SCIENCES, 2022, 584 :301-324