AFNFS: Adaptive fuzzy neighborhood-based feature selection with adaptive synthetic over-sampling for imbalanced data

被引:29
作者
Sun, Lin [1 ,3 ]
Li, Mengmeng [1 ]
Ding, Weiping [2 ]
Zhang, En [1 ]
Mu, Xiaoxia [1 ]
Xu, Jiucheng [1 ]
机构
[1] Henan Normal Univ, Coll Comp & Informat Engn, Xinxiang 453007, Peoples R China
[2] Nantong Univ, Sch Informat Sci & Technol, Nantong 226019, Peoples R China
[3] Engn Lab Intelligence Business & Internet Things H, Xinxiang 453007, Peoples R China
基金
中国国家自然科学基金;
关键词
Imbalanced data classification; Feature selection; Adaptive fuzzy neighborhood; Fuzzy neighborhood rough sets; Over-sampling; MUTUAL INFORMATION; ROUGH SETS; CLASSIFICATION;
D O I
10.1016/j.ins.2022.08.118
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The classification efficiency of majority classes for imbalanced data is so concerned in real -world applications. Almost fuzzy neighborhood radius still needs to be manually set and many entropy measures may ignore the boundary region of data, these limitations will result in the poor classification effect. To address these limitations, this paper designs a novel adaptive fuzzy neighborhood-based feature selection method for imbalanced data with adaptive synthetic over-sampling. First, the closeness is defined according to the vari-ance distance between the samples of the minority class, the pair set of neighboring sam-ples is designed, and then an improved adaptive synthetic over-sampling model is presented for constructing balanced decision systems consisting of the synthetic samples and original samples. Second, an adaptive fuzzy neighborhood radius is developed when using the data margins of all homogeneous and heterogeneous samples. Then the adaptive fuzzy neighborhood granule and upper and lower approximations are defined to construct a new FNRS model. Thus, approximate accuracy and roughness are presented to measure the uncertainty from the fuzzy and rough perspectives for imbalanced data. Third, by com-bining the roughness with adaptive fuzzy neighborhood entropy, adaptive fuzzy neighbor-hood joint entropy is constructed to evaluate the uncertainty in fuzzy neighborhood decision systems from two viewpoints of algebra and information. Then the reduced set and the significance of the feature are further developed. Finally, this improved adaptive synthetic over-sampling algorithm is designed to aim to build this balanced decision sys-tem, and an adaptive fuzzy neighborhood-based feature selection algorithm with the tol-erance parameter is developed to achieve an optimal feature subset. Experiments on 26 imbalanced datasets demonstrate that the constructed algorithms compared to the other related algorithms are effective.(c) 2022 Elsevier Inc. All rights reserved.
引用
收藏
页码:724 / 744
页数:21
相关论文
共 50 条
[1]  
Batista GE., 2004, ACM SIGKDD EXPLOR NE, V6, P20, DOI [DOI 10.1145/1007730.1007735, 10.1145/1007730.1007735, 10.1145/1007730.1007735.2]
[2]   A rough-granular approach to the imbalanced data classification problem [J].
Borowska, K. ;
Stepaniuk, J. .
APPLIED SOFT COMPUTING, 2019, 83
[3]  
Brown G, 2012, J MACH LEARN RES, V13, P27
[4]   Weighted Data Gravitation Classification for Standard and Imbalanced Data [J].
Cano, Alberto ;
Zafra, Amelia ;
Ventura, Sebastian .
IEEE TRANSACTIONS ON CYBERNETICS, 2013, 43 (06) :1672-1687
[5]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[6]   Feature selection for imbalanced data based on neighborhood rough sets [J].
Chen, Hongmei ;
Li, Tianrui ;
Fan, Xin ;
Luo, Chuan .
INFORMATION SCIENCES, 2019, 483 :1-20
[7]  
[陈祥焰 Chen Xiangyan], 2019, [模式识别与人工智能, Pattern Recognition and Artificial Intelligence], V32, P726
[8]   Granular ball guided selector for attribute reduction [J].
Chen, Yan ;
Wang, Pingxin ;
Yang, Xibei ;
Mi, Jusheng ;
Liu, Dun .
KNOWLEDGE-BASED SYSTEMS, 2021, 229
[9]   Gene selection for tumor classification using neighborhood rough sets and entropy measures [J].
Chen, Yumin ;
Zhang, Zunjun ;
Zheng, Jianzhong ;
Ma, Ying ;
Xue, Yu .
JOURNAL OF BIOMEDICAL INFORMATICS, 2017, 67 :59-68
[10]   Multigranulation Supertrust Model for Attribute Reduction [J].
Ding, Weiping ;
Pedrycz, Witold ;
Triguero, Isaac ;
Cao, Zehong ;
Lin, Chin-Teng .
IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2021, 29 (06) :1395-1408