Dynamic extreme learning machine for data stream classification

被引:87
作者
Xu, Shuliang [1 ]
Wang, Junhong [1 ,2 ]
机构
[1] Shanxi Univ, Sch Comp & Informat Technol, Taiyuan 030006, Peoples R China
[2] Minist Educ, Key Lab Computat Intelligence & Chinese Informat, Taiyuan 030006, Peoples R China
基金
中国国家自然科学基金;
关键词
Data stream; Classification; Concept drift; Extreme learning machine; Online learning; CONCEPT DRIFT; ENSEMBLE; IMBALANCE;
D O I
10.1016/j.neucom.2016.12.078
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In our society, many fields have produced a large number of data streams. How to mining the interesting knowledge and patterns from continuous data stream becomes a problem which we have to solve. Different from conventional classification algorithms, data stream classification algorithms have to adjust their classification models with the change of data stream because of concept drift. However, conventional classification models will keep stable once models are trained. To solve the problem, a dynamic extreme learning machine for data stream classification (DELM) is proposed. DELM utilizes online learning mechanism to train ELM as basic classifier and trains a double hidden layer structure to improve the performance of ELM. When an alert about concept drift is set, more hidden layer nodes are added into ELM to improve the generalization ability of classifier. If the value measuring concept drift reaches the upper limit or the accuracy of ELM is in a low level, the current classifier will be deleted, and the algorithm will use new data to train a new classifier so as to learn new concept. The experimental results showed DELM could improve the accuracy of classification result, and can adapt to new concept in a short time. (C) 2017 Elsevier B.V. All rights reserved.
引用
收藏
页码:433 / 449
页数:17
相关论文
共 58 条
  • [1] [Anonymous], 2013, MATRIX ANAL APPL
  • [2] [Anonymous], 2016, IEEE T NEUR NET LEAR
  • [3] Paired Learners for Concept Drift
    Bach, Stephen H.
    Maloof, Marcus A.
    [J]. ICDM 2008: EIGHTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2008, : 23 - 32
  • [4] Bifet A, 2010, J MACH LEARN RES, V11, P1601
  • [5] Bifet A, 2009, LECT NOTES COMPUT SC, V5772, P249, DOI 10.1007/978-3-642-03915-7_22
  • [6] Reacting to Different Types of Concept Drift: The Accuracy Updated Ensemble Algorithm
    Brzezinski, Dariusz
    Stefanowski, Jerzy
    [J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2014, 25 (01) : 81 - 94
  • [7] Regularized Extreme Learning Machine
    Deng, Wanyu
    Zheng, Qinghua
    Chen, Lin
    [J]. 2009 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, 2009, : 389 - 395
  • [8] A wavelet extreme learning machine
    Ding, Shifei
    Zhang, Jian
    Xu, Xinzheng
    Zhang, Yanan
    [J]. NEURAL COMPUTING & APPLICATIONS, 2016, 27 (04) : 1033 - 1040
  • [9] Domingos P., 2000, Proceedings. KDD-2000. Sixth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, P71, DOI 10.1145/347090.347107
  • [10] An adaptive ensemble classifier for mining concept drifting data streams
    Farid, Dewan Md.
    Zhang, Li
    Hossain, Alamgir
    Rahman, Chowdhury Mofizur
    Strachan, Rebecca
    Sexton, Graham
    Dahal, Keshav
    [J]. EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (15) : 5895 - 5906