Class-specific cost regulation extreme learning machine for imbalanced classification

被引:115
作者
Xiao, Wendong [1 ,2 ]
Zhang, Jie [1 ,2 ]
Li, Yanjiao [1 ,2 ]
Zhang, Sen [1 ,2 ]
Yang, Weidong [1 ,2 ]
机构
[1] Univ Sci & Technol Beijing, Sch Automat & Elect Engn, Beijing 100083, Peoples R China
[2] Minist Educ, Key Lab Adv Control Iron & Steel Proc, Beijing 100083, Peoples R China
基金
中国国家自然科学基金;
关键词
Extreme learning machine; Imbalanced data distribution; Class-specific cost regulation extreme; learning machine; Blast furnace status diagnosis; BLAST-FURNACE; RECOGNITION; REGRESSION;
D O I
10.1016/j.neucom.2016.09.120
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Due to its much faster speed and better generalization performance, extreme learning machine (ELM) has attracted much attention as an effective learning approach. However, ELM rarely involves strategies for imbalanced data distributions which may exist in many fields. Existing approaches for imbalance learning only consider the effect of the number of the class samples ignoring the dispersion degree of the data, and may lead to the suboptimal learning results. In this paper, we will propose a novel ELM, class-specific cost regulation extreme learning machine (CCR-ELM), together with its kernel based extension, for binary and multiclass classification problems with imbalanced data distributions. CCR-ELM introduces class-specific regulation cost for misclassification of each class in the performance index as the tradeoff of structural risk and empirical risk. The performance of CCR-ELM is verified using a number of benchmark datasets and the real blast furnace status diagnosis problem. Experimental results show that CCR-ELM can achieve better performance for classification problems with imbalanced data distributions than the original ELM and existing ELM imbalance learning approach, and the kernel based CCR-ELM can improve the performance further. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:70 / 82
页数:13
相关论文
共 39 条
[1]  
[Anonymous], 2002, Matrices: Theory and Applications
[2]  
[Anonymous], 1971, Generalized Inverses of Matrices and its Applications
[3]   Landmark recognition with compact BoW histogram and ensemble ELM [J].
Cao, Jiuwen ;
Chen, Tao ;
Fan, Jiayuan .
MULTIMEDIA TOOLS AND APPLICATIONS, 2016, 75 (05) :2839-2857
[4]   Landmark recognition with sparse representation classification and extreme learning machine [J].
Cao, Jiuwen ;
Zhao, Yanfei ;
Lai, Xiaoping ;
Ong, Marcus Eng Hock ;
Yin, Chun ;
Koh, Zhi Xiong ;
Liu, Nan .
JOURNAL OF THE FRANKLIN INSTITUTE-ENGINEERING AND APPLIED MATHEMATICS, 2015, 352 (10) :4528-4545
[5]   An introduction to ROC analysis [J].
Fawcett, Tom .
PATTERN RECOGNITION LETTERS, 2006, 27 (08) :861-874
[6]   Hierarchical fuzzy rule based classification systems with genetic rule selection for imbalanced data-sets [J].
Fernandez, Alberto ;
del Jesus, Maria Jose ;
Herrera, Francisco .
INTERNATIONAL JOURNAL OF APPROXIMATE REASONING, 2009, 50 (03) :561-577
[7]   Learning from Imbalanced Data [J].
He, Haibo ;
Garcia, Edwardo A. .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (09) :1263-1284
[8]   A hierarchical structure of extreme learning machine (HELM) for high-dimensional datasets with noise [J].
He, Yan-Lin ;
Geng, Zhi-Qiang ;
Xu, Yuan ;
Zhu, Qun-Xiong .
NEUROCOMPUTING, 2014, 128 :407-414
[9]   APPROXIMATION CAPABILITIES OF MULTILAYER FEEDFORWARD NETWORKS [J].
HORNIK, K .
NEURAL NETWORKS, 1991, 4 (02) :251-257
[10]   Semi-Supervised and Unsupervised Extreme Learning Machines [J].
Huang, Gao ;
Song, Shiji ;
Gupta, Jatinder N. D. ;
Wu, Cheng .
IEEE TRANSACTIONS ON CYBERNETICS, 2014, 44 (12) :2405-2417