Active learning with extreme learning machine for online imbalanced multiclass classification

被引:14
作者
Qin, Jiongming [1 ]
Wang, Cong [1 ]
Zou, Qinhong [1 ]
Sun, Yubin [1 ]
Chen, Bin [1 ]
机构
[1] Southwest Univ, Coll Elect & Informat Engn, Chongqing Key Lab Nonlinear Circuits & Intelligen, Chongqing 400715, Peoples R China
关键词
Active learning; Extreme learning machine; Multiclass imbalanced classification; Query strategy; Class incremental; ALGORITHM; ELM; REGRESSION; ACCURATE; ENSEMBLE; NETWORK;
D O I
10.1016/j.knosys.2021.107385
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Active learning (AL) can significantly reduce the cost of labeling instances. Extreme learning machine (ELM) has low computational cost, extremely fast training speed and strong generalization ability. Previous studies have shown that the combination of them can generate efficient learning models. Nevertheless, these researches did not focus on multiclass imbalanced data. Cold start may occur and the performance of classifier is also reduced due to the imbalanced distribution of categories. Moreover, there is no framework for processing stream-based data. To address these problems, an improved framework called AL for class incremental and weighted sequential ELM (AI-WSELM) is proposed in this paper, and its advantages are as follows: (1) similarity query and margin sampling were used to alleviate cold start and select uncertain instances, respectively, (2) an improved weighting strategy was used to tackle stream-based multiclass imbalanced distribution, (3) a class incremental mechanism was added to deal with new categories appeared in the subsequent batches, and (4) AI-WSELM greatly reduced the cost of labeling samples when ensuring classification performance. The simulation results show that the proposed model has satisfactory performance compared to the existing ELMs and the other related algorithms, which indicates the feasibility and effectiveness of AI-WSELM. (C) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页数:15
相关论文
共 41 条
[1]  
Abuassba AOM, 2017, TSINGHUA SCI TECHNOL, V22, P691
[2]  
Alcalá-Fdez J, 2011, J MULT-VALUED LOG S, V17, P255
[3]  
[Anonymous], 2010, Tech. Rep. 1648
[4]   Uncertainty Based Under-Sampling for Learning Naive Bayes Classifiers Under Imbalanced Data Sets [J].
Aridas, Christos K. ;
Karlos, Stamatis ;
Kanas, Vasileios G. ;
Fazakis, Nikos ;
Kotsiantis, Sotiris B. .
IEEE ACCESS, 2020, 8 :2122-2133
[5]   A Two-Layer Nonlinear Combination Method for Short-Term Wind Speed Prediction Based on ELM, ENN, and LSTM [J].
Chen, Min-Rong ;
Zeng, Guo-Qiang ;
Lu, Kang-Di ;
Weng, Jian .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (04) :6997-7010
[6]   Kernel based online learning for imbalance multiclass classification [J].
Ding, Shuya ;
Mirza, Bilal ;
Lin, Zhiping ;
Cao, Jiuwen ;
Lai, Xiaoping ;
Nguyen, Tam V. ;
Sepulveda, Jose .
NEUROCOMPUTING, 2018, 277 :139-148
[7]  
Dua D., 2017, UCI machine learning repository
[8]  
Enhui Zheng, 2013, Advanced Data Mining and Applications. 9th International Conference, ADMA 2013. Proceedings: LNCS 8347, P478, DOI 10.1007/978-3-642-53917-6_43
[9]   Statistical active learning in multilayer perceptrons [J].
Fukumizu, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (01) :17-26
[10]   A nonlinear hybrid wind speed forecasting model using LSTM network, hysteretic ELM and Differential Evolution algorithm [J].
Hu, Ya-Lan ;
Chen, Liang .
ENERGY CONVERSION AND MANAGEMENT, 2018, 173 :123-142