Generalized class-specific kernelized extreme learning machine for multiclass imbalanced learning

被引:24
作者
Raghuwanshi, Bhagat Singh [1 ]
Shukla, Sanyam [1 ]
机构
[1] Maulana Azad Natl Inst Technol MANIT, Dept Comp Sci & Engn, Bhopal 462003, Madhya Pradesh, India
关键词
Kernelized extreme learning machine; Generalized class-specific kernelized; extreme learning machine; Multiclass imbalanced learning; Classification; ROC CURVE; CLASSIFICATION; FRAUD; AREA;
D O I
10.1016/j.eswa.2018.12.024
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Class imbalanced learning is a well-known issue, which exists in real-world applications. Datasets that have skewed class distribution raise hindrance to the traditional learning algorithms. Traditional classifiers give the same importance to all the samples, which leads to the prediction biased towards the majority classes. To solve this intrinsic deficiency, numerous strategies have been proposed such as weighted extreme learning machine (WELM), weighted support vector machine (WSVM), class-specific extreme learning machine (CS-ELM) and class-specific kernelized extreme learning machine (CSKELM). This work focuses on multiclass imbalance problems, which are more difficult compared to the binary class imbalance problems. Kernelized extreme learning machine (KELM) yields better results compared to the traditional extreme learning machine (ELM), which uses random input parameters. This work presents a generalized CSKELM (GCSKELM), the extension of our recently proposed CSKELM, which addresses the multiclass imbalanced problems more effectively. The proposed GCSKELM can be applied directly to solve the multiclass imbalanced problems. GCSKELM with Gaussian kernel function avoids the non-optimal hidden node problem associated with CS-ELM and other existing variants of ELM. The proposed work also has less computational cost in contrast with kernelized WELM (KWELM) for multiclass imbalanced learning. This work employs class-specific regularization parameters, which are determined by employing class proportion. The extensive experimental analysis shows that the proposed work obtains promising generalization performance in contrast with the other state-of-the-art imbalanced learning methods. (C) 2018 Elsevier Ltd. All rights reserved.
引用
收藏
页码:244 / 255
页数:12
相关论文
共 43 条
[11]  
Dua D., 2017, Uci machine learning repository
[12]   A dynamic over-sampling procedure based on sensitivity for multi-class problems [J].
Fernandez-Navarro, Francisco ;
Hervas-Martinez, Cesar ;
Antonio Gutierrez, Pedro .
PATTERN RECOGNITION, 2011, 44 (08) :1821-1833
[13]   An experimental comparison of performance measures for classification [J].
Ferri, C. ;
Hernandez-Orallo, J. ;
Modroiu, R. .
PATTERN RECOGNITION LETTERS, 2009, 30 (01) :27-38
[14]   Learning from class-imbalanced data: Review of methods and applications [J].
Guo Haixiang ;
Li Yijing ;
Shang, Jennifer ;
Gu Mingyun ;
Huang Yuanyue ;
Bing, Gong .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 73 :220-239
[15]   Learning from Imbalanced Data [J].
He, Haibo ;
Garcia, Edwardo A. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (09) :1263-1284
[16]   A simple generalisation of the area under the ROC curve for multiple class classification problems [J].
Hand, DJ ;
Till, RJ .
MACHINE LEARNING, 2001, 45 (02) :171-186
[17]   Extreme learning machine: Theory and applications [J].
Huang, Guang-Bin ;
Zhu, Qin-Yu ;
Siew, Chee-Kheong .
NEUROCOMPUTING, 2006, 70 (1-3) :489-501
[18]   Extreme Learning Machine for Regression and Multiclass Classification [J].
Huang, Guang-Bin ;
Zhou, Hongming ;
Ding, Xiaojian ;
Zhang, Rui .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS, 2012, 42 (02) :513-529
[19]   On the kernel Extreme Learning Machine speedup [J].
Iosifidis, Alexandros ;
Gabbouj, Moncef .
PATTERN RECOGNITION LETTERS, 2015, 68 :205-210
[20]   On the kernel Extreme Learning Machine classifier [J].
Iosifidis, Alexandros ;
Tefas, Anastastios ;
Pitas, Ioannis .
PATTERN RECOGNITION LETTERS, 2015, 54 :11-17