Feature selection for imbalanced data based on neighborhood rough sets

被引:133
作者
Chen, Hongmei [1 ]
Li, Tianrui [1 ]
Fan, Xin [1 ]
Luo, Chuan [2 ]
机构
[1] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Sichuan, Peoples R China
[2] Sichuan Univ, Coll Comp Sci, Chengdu 610065, Sichuan, Peoples R China
基金
美国国家科学基金会;
关键词
Rough set theory; Feature selection; Imbalanced data; Discernibility matrix; ATTRIBUTE REDUCTION; DATA CLASSIFICATION; DECISION TREE; ENSEMBLE; COMBINATION; SMOTE;
D O I
10.1016/j.ins.2019.01.041
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Feature selection is a meaningful aspect of data mining that aims to select more relevant data features and provide more concise and explicit data descriptions. It is beneficial for constructing an effective learning model and reducing the consumption of memory and time. In real-life applications, imbalanced data are ubiquitous, such as those in medical diagnoses, intrusion detection, and credit ratings. In recent years, feature selection for imbalanced data has attracted increasing research attention. Neighborhood rough set theory has been effectively applied to feature selection when dealing with mixed types of data. In this study, we propose an approach for feature selection for imbalanced data employing neighborhood rough set theory. The significance of features is defined by carefully studying the upper and lower boundary regions. The uneven distribution of the classes is considered during the definition of the feature significance. A discernibility-matrix-based feature selection method, which is a key method in rough set theory, is used; then, a novel algorithm for feature selection (RSFSAID) is proposed. The uncertainty of feature selection resulting from different parameters is investigated, and a particle swarm optimization algorithm is used to determine the optimized parameters in the algorithm. Extensive experiments are performed with public datasets to evaluate the proposed method. Experimental results show that the RSFSAID algorithm can improve the classification performance of imbalanced data compared to four other algorithms. (C) 2019 Elsevier Inc. All rights reserved.
引用
收藏
页码:1 / 20
页数:20
相关论文
共 50 条
  • [1] To Combat Multi-Class Imbalanced Problems by Means of Over-Sampling Techniques
    Abdi, Lida
    Hashemi, Sattar
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (01) : 238 - 251
  • [2] Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
  • [3] [Anonymous], 2016, THE WEKA WORKBENCH
  • [4] The study of under- and over-sampling methods' utility in analysis of highly imbalanced data on osteoporosis
    Bach, M.
    Werner, A.
    Zywiec, J.
    Pluskiewicz, W.
    [J]. INFORMATION SCIENCES, 2017, 384 : 174 - 190
  • [5] MWMOTE-Majority Weighted Minority Oversampling Technique for Imbalanced Data Set Learning
    Barua, Sukarna
    Islam, Md. Monirul
    Yao, Xin
    Murase, Kazuyuki
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (02) : 405 - 425
  • [6] SMOTE: Synthetic minority over-sampling technique
    Chawla, Nitesh V.
    Bowyer, Kevin W.
    Hall, Lawrence O.
    Kegelmeyer, W. Philip
    [J]. 2002, American Association for Artificial Intelligence (16)
  • [7] Attribute Reduction for Heterogeneous Data Based on the Combination of Classical and Fuzzy Rough Set Models
    Chen, Degang
    Yang, Yanyan
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2014, 22 (05) : 1325 - 1334
  • [8] Information granulation based data mining approach for classifying imbalanced data
    Chen, Mu-Chen
    Chen, Long-Sheng
    Hsu, Chun-Chin
    Zeng, Wei-Rong
    [J]. INFORMATION SCIENCES, 2008, 178 (16) : 3214 - 3227
  • [9] Machine learning based mobile malware detection using highly imbalanced network traffic
    Chen, Zhenxiang
    Yan, Qiben
    Han, Hongbo
    Wang, Shanshan
    Peng, Lizhi
    Wang, Lin
    Yang, Bo
    [J]. INFORMATION SCIENCES, 2018, 433 : 346 - 364
  • [10] Maximal-Discernibility-Pair-Based Approach to Attribute Reduction in Fuzzy Rough Sets
    Dai, Jianhua
    Hu, Hu
    Wu, Wei-Zhi
    Qian, Yuhua
    Huang, Debiao
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2018, 26 (04) : 2174 - 2187