Class-specific extreme learning machine for handling binary class imbalance problem

被引:63
作者
Raghuwanshi, Bhagat Singh [1 ]
Shukla, Sanyam [1 ]
机构
[1] Maulana Azad Natl Inst Technol, Bhopal 462003, Madhya Pradesh, India
关键词
Extreme learning machine; Class-specific extreme learning machine; Class imbalance problem; Classification; DATA SETS; CLASSIFICATION; ALGORITHMS; ENGINES; TRENDS;
D O I
10.1016/j.neunet.2018.05.011
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Imbalance problem occurs when the majority class instances outnumber the minority class instances. Conventional extreme learning machine (ELM) treats all instances with same importance leading to the prediction accuracy biased towards the majority class. To overcome this inherent drawback, many variants of ELM have been proposed like Weighted ELM, class-specific cost regulation ELM (CCR-ELM) etc. to handle the class imbalance problem effectively. This work proposes class-specific extreme learning machine (CS-ELM), a variant of ELM for handling binary class imbalance problem more effectively. This work differs from weighted ELM as it does not require assigning weights to the training instances. The proposed work also has lower computational complexity compared to weighted ELM. This work uses class-specific regularization parameters. CCR-ELM also uses class-specific regularization parameters. In CCR-ELM the computation of regularization parameters does not consider class distribution and class overlap. This work uses class-specific regularization parameters which are computed using class distribution. This work also differ from CCR-ELM in the computation of the output weight, beta. The proposed work has lower computational overhead compared to CCR-ELM. The proposed work is evaluated using benchmark real world imbalanced datasets downloaded from the KEEL dataset repository. The results show that the proposed work has better performance than weighted ELM, CCR-ELM, EFSVM, FSVM, SVM for class imbalance learning. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:206 / 217
页数:12
相关论文
共 35 条
  • [1] Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
  • [2] [Anonymous], IMBALANCED LEARNING
  • [3] [Anonymous], 2003, HP INVENT
  • [4] FSVM-CIL: Fuzzy Support Vector Machines for Class Imbalance Learning
    Batuwita, Rukshan
    Palade, Vasile
    [J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS, 2010, 18 (03) : 558 - 571
  • [5] The use of the area under the roc curve in the evaluation of machine learning algorithms
    Bradley, AP
    [J]. PATTERN RECOGNITION, 1997, 30 (07) : 1145 - 1159
  • [6] An experimental comparison of classification algorithms for imbalanced credit scoring data sets
    Brown, Iain
    Mues, Christophe
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2012, 39 (03) : 3446 - 3453
  • [7] Demsar J, 2006, J MACH LEARN RES, V7, P1
  • [8] Regularized Extreme Learning Machine
    Deng, Wanyu
    Zheng, Qinghua
    Chen, Lin
    [J]. 2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, 2009, : 389 - 395
  • [9] Entropy-based fuzzy support vector machine for imbalanced datasets
    Fan, Qi
    Wang, Zhe
    Li, Dongdong
    Gao, Daqi
    Zha, Hongyuan
    [J]. KNOWLEDGE-BASED SYSTEMS, 2017, 115 : 87 - 99
  • [10] Learning from Imbalanced Data
    He, Haibo
    Garcia, Edwardo A.
    [J]. IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (09) : 1263 - 1284