Feature selection for imbalanced data based on neighborhood rough sets

被引:133
作者
Chen, Hongmei [1 ]
Li, Tianrui [1 ]
Fan, Xin [1 ]
Luo, Chuan [2 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Sichuan, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
基金
美国国家科学基金会;
关键词
Rough set theory; Feature selection; Imbalanced data; Discernibility matrix; ATTRIBUTE REDUCTION; DATA CLASSIFICATION; DECISION TREE; ENSEMBLE; COMBINATION; SMOTE;
D O I
10.1016/j.ins.2019.01.041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Feature selection is a meaningful aspect of data mining that aims to select more relevant data features and provide more concise and explicit data descriptions. It is beneficial for constructing an effective learning model and reducing the consumption of memory and time. In real-life applications, imbalanced data are ubiquitous, such as those in medical diagnoses, intrusion detection, and credit ratings. In recent years, feature selection for imbalanced data has attracted increasing research attention. Neighborhood rough set theory has been effectively applied to feature selection when dealing with mixed types of data. In this study, we propose an approach for feature selection for imbalanced data employing neighborhood rough set theory. The significance of features is defined by carefully studying the upper and lower boundary regions. The uneven distribution of the classes is considered during the definition of the feature significance. A discernibility-matrix-based feature selection method, which is a key method in rough set theory, is used; then, a novel algorithm for feature selection (RSFSAID) is proposed. The uncertainty of feature selection resulting from different parameters is investigated, and a particle swarm optimization algorithm is used to determine the optimized parameters in the algorithm. Extensive experiments are performed with public datasets to evaluate the proposed method. Experimental results show that the RSFSAID algorithm can improve the classification performance of imbalanced data compared to four other algorithms. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:1 / 20
页数:20
相关论文
共 50 条
[11]   Uncertainty measurement for incomplete interval-valued information systems based on α-weak similarity [J].
Dai, Jianhua ;
Wei, Bingjie ;
Zhang, Xiaohong ;
Zhang, Qilai .
KNOWLEDGE-BASED SYSTEMS, 2017, 136 :159-171
[12]  
Dua D., 2017, UCI Machine Learning Repository
[14]   BAdaCost: Multi-class Boosting with Costs [J].
Fernandez-Baldera, Antonio ;
Buenaposada, Jose M. ;
Baumela, Luis .
PATTERN RECOGNITION, 2018, 79 :467-479
[15]   Stable variable selection of class-imbalanced data with precision-recall criterion [J].
Fu, Guang-Hui ;
Xu, Feng ;
Zhang, Bing-Yang ;
Yi, Lun-Zhao .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2017, 171 :241-250
[16]   Dynamic ensemble selection for multi-class imbalanced datasets [J].
Garcia, Salvador ;
Zhang, Zhong-Liang ;
Altalhi, Abdulrahman ;
Alshomrani, Saleh ;
Herrera, Francisco .
INFORMATION SCIENCES, 2018, 445 :22-37
[17]   Improving multiclass pattern recognition by the combination of two strategies [J].
García-Pedrajas, N ;
Ortiz-Boyer, D .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (06) :1001-1006
[18]   High dimensional data classification and feature selection using support vector machines [J].
Ghaddar, Bissan ;
Naoum-Sawaya, Joe .
EUROPEAN JOURNAL OF OPERATIONAL RESEARCH, 2018, 265 (03) :993-1004
[19]   Imbalanced TSK Fuzzy Classifier by Cross-Class Bayesian Fuzzy Clustering and Imbalance Learning [J].
Gu, Xiaoqing ;
Chung, Fu-Lai ;
Ishibuchi, Hisao ;
Wang, Shitong .
IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2017, 47 (08) :2005-2020
[20]  
Han J, 2012, MOR KAUF D, P1