Meta-cognitive online sequential extreme learning machine for imbalanced and concept-drifting data classification

被引:78
作者
Mirza, Bilal [1 ]
Lin, Zhiping [1 ]
机构
[1] Nanyang Technol Univ, Sch Elect & Elect Engn, Singapore 639798, Singapore
关键词
Multi-class imbalance; Concept drift; Extreme learning machine; Meta-cognition; Sequential learning; NETWORK; ALGORITHM; ENSEMBLE;
D O I
10.1016/j.neunet.2016.04.008
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, a meta-cognitive online sequential extreme learning machine (MOS-ELM) is proposed for class imbalance and concept drift learning. In MOS-ELM, meta-cognition is used to self-regulate the learning by selecting suitable learning strategies for class imbalance and concept drift problems. MOS-ELM is the first sequential learning method to alleviate the imbalance problem for both binary class and multi-class data streams with concept drift. In MOS-ELM, a new adaptive window approach is proposed for concept drift learning. A single output update equation is also proposed which unifies various application specific OS-ELM methods. The performance of MOS-ELM is evaluated under different conditions and compared with methods each specific to some of the conditions. On most of the datasets in comparison, MOS-ELM outperforms the competing methods. (C) 2016 Elsevier Ltd. All rights reserved.
引用
收藏
页码:79 / 94
页数:16
相关论文
共 42 条
[1]   Meta-cognitive Neural Network for classification problems in a sequential learning framework [J].
Babu, G. Sateesh ;
Suresh, S. .
NEUROCOMPUTING, 2012, 81 :86-96
[2]   Sequential Projection-Based Metacognitive Learning in a Radial Basis Function Network for Classification Problems [J].
Babu, Giduthuri Sateesh ;
Suresh, Sundaram .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (02) :194-206
[3]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[4]   Towards incremental learning of nonstationary imbalanced data stream: a multiple selectively recursive approach [J].
Chen, Sheng ;
He, Haibo .
EVOLVING SYSTEMS, 2011, 2 (01) :35-50
[5]  
Chu F, 2004, LECT NOTES ARTIF INT, V3056, P282
[6]   Metacognition in computation: A selected research review [J].
Cox, MT .
ARTIFICIAL INTELLIGENCE, 2005, 169 (02) :104-141
[7]  
Demsar J, 2006, J MACH LEARN RES, V7, P1
[8]  
Ditzler Gregory, 2010, Proceedings of the 2010 20th International Conference on Pattern Recognition (ICPR 2010), P2997, DOI 10.1109/ICPR.2010.734
[9]  
Ditzler G., BENCHMARK DATASETS E
[10]   Incremental Learning of Concept Drift from Streaming Imbalanced Data [J].
Ditzler, Gregory ;
Polikar, Robi .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (10) :2283-2301