Kernel based online learning for imbalance multiclass classification

被引:50
作者
Ding, Shuya [1 ]
Mirza, Bilal [2 ]
Lin, Zhiping [1 ]
Cao, Jiuwen [3 ]
Lai, Xiaoping [3 ]
Nguyen, Tam V. [4 ]
Sepulveda, Jose [2 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
[2] Singapore Polytech, Dept Technol Innovat & Enterprise, Singapore 139651, Singapore
[3] Hangzhou Dianzi Univ, Key Lab IOT & Informat Fus Technol Zhejiang, Hangzhou 310018, Zhejiang, Peoples R China
[4] Univ Dayton, Dept Comp Sci, Dayton, OH 45469 USA
关键词
Class imbalance; Extreme learning machine (ELM); Kernel learning; Multiclass; Online learning; MACHINE; ENSEMBLE;
D O I
10.1016/j.neucom.2017.02.102
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a weighted online sequential extreme learning machine with kernels (WOSELMK) for class imbalance learning (CIL). The existing online sequential extreme learning machine (OSELM) methods for CIL use random feature mapping. WOS-ELMK is the first OS-ELM method which uses kernel mapping for online class imbalance learning. The kernel mapping avoids the non-optimal hidden node problem associated with weighted OS-ELM (WOS-ELM) and other existing OS-ELM methods for CIL. WOS-ELMK tackles both the binary class and multiclass imbalance problems in one-by-one as well as chunk-by-chunk learning modes. For imbalanced big data streams, a fixed size window scheme is also implemented for WOS-ELMK. We empirically show that WOS-ELMK obtains superior performance in general than some recently proposed CIL approaches on 17 binary class and 8 multiclass imbalanced datasets. (C) 2017 Published by Elsevier B.V.
引用
收藏
页码:139 / 148
页数:10
相关论文
共 36 条
[1]   Excavation Equipment Recognition Based on Novel Acoustic Statistical Features [J].
Cao, Jiuwen ;
Wang, Wei ;
Wang, Jianzhong ;
Wang, Ruirong .
IEEE TRANSACTIONS ON CYBERNETICS, 2017, 47 (12) :4392-4404
[2]   Extreme learning machine and adaptive sparse representation for image classification [J].
Cao, Jiuwen ;
Zhang, Kai ;
Luo, Minxia ;
Yin, Chun ;
Lai, Xiaoping .
NEURAL NETWORKS, 2016, 81 :91-102
[3]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[4]  
Chongsheng Zhang, 2012, Advances in Knowledge Discovery and Data Mining. Proceedings 16th Pacific-Asia Conference (PAKDD 2012), P254, DOI 10.1007/978-3-642-30217-6_22
[5]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[6]   Incremental Learning of Concept Drift from Streaming Imbalanced Data [J].
Ditzler, Gregory ;
Polikar, Robi .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (10) :2283-2301
[7]  
Frank A., 2010, Machine Learning Repository
[8]   Adaptive weighted imbalance learning with application to abnormal activity recognition [J].
Gao, Xingyu ;
Chen, Zhenyu ;
Tang, Sheng ;
Zhang, Yongdong ;
Li, Jintao .
NEUROCOMPUTING, 2016, 173 :1927-1935
[9]   Learning from Imbalanced Data [J].
He, Haibo ;
Garcia, Edwardo A. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (09) :1263-1284
[10]   Learning from streaming data with concept drift and imbalance: an overview [J].
Hoens, T. Ryan ;
Polikar, Robi ;
Chawla, Nitesh V. .
PROGRESS IN ARTIFICIAL INTELLIGENCE, 2012, 1 (01) :89-101