MINAS: multiclass learning algorithm for novelty detection in data streams

被引:62
作者
de Faria, Elaine Ribeiro [1 ]
de Leon Ferreira Carvalho, Andre Carlos Ponce [2 ]
Gama, Joao [3 ]
机构
[1] Univ Fed Uberlandia, Fac Comp Sci, Av Engenheiro Dinz 1178,CP 593, BR-38400 Uberlandia, MG, Brazil
[2] Univ Sao Paulo, Inst Math & Comp Sci, Sao Carlos, SP, Brazil
[3] Univ Porto, Lab Artificial Intelligence & Decis Support LIAAD, Rua Campo Alegre 823, P-4100 Oporto, Portugal
基金
巴西圣保罗研究基金会;
关键词
Novelty detection; Data streams; Multiclass classification; Concept evolution; CLASSIFICATION;
D O I
10.1007/s10618-015-0433-y
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data stream mining is an emergent research area that aims at extracting knowledge from large amounts of continuously generated data. Novelty detection (ND) is a classification task that assesses if one or a set of examples differ significantly from the previously seen examples. This is an important task for data stream, as new concepts may appear, disappear or evolve over time. Most of the works found in the ND literature presents it as a binary classification task. In several data stream real life problems, ND must be treated as a multiclass task, in which, the known concept is composed by one or more classes and different new classes may appear. This work proposes MINAS, an algorithm for ND in data streams. MINAS deals with ND as a multiclass task. In the initial training phase, MINAS builds a decision model based on a labeled data set. In the online phase, new examples are classified using this model, or marked as unknown. Groups of unknown examples can be used later to create valid novelty patterns (NP), which are added to the current model. The decision model is updated as new data come over the stream in order to reflect changes in the known classes and allow the addition of NP. This work also presents a set of experiments carried out comparing MINAS and the main novelty detection algorithms found in the literature, using artificial and real data sets. The experimental results show the potential of the proposed algorithm.
引用
收藏
页码:640 / 680
页数:41
相关论文
共 23 条
[1]  
Aggarwal CC, 2003, P 2003 VLDB C, V29, P81, DOI DOI 10.1016/B978-012722442-8/50016-1
[2]  
Al-Khateeb T. M., 2012, 2012 IEEE 5th International Conference on Cloud Computing (CLOUD), P694, DOI 10.1109/CLOUD.2012.127
[3]   Stream Classification with Recurring and Novel Class Detection using Class-Based Ensemble [J].
Al-Khateeb, Tahseen ;
Masud, Mohammad M. ;
Khan, Latifur ;
Aggarwal, Charu ;
Han, Jiawei ;
Thuraisingham, Bhavani .
12TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM 2012), 2012, :31-40
[4]  
[Anonymous], ENG APP ARTIFICIAL I
[5]  
Bifet A, 2010, JMLR WORKSH CONF PRO, V11, P44
[6]  
Faria E.R., 2013, Proceedings of the 28th Annual ACM Symposium on Applied Computing, P795, DOI DOI 10.1145/2480362.2480515
[7]   Evaluation Methodology for Multiclass Novelty Detection Algorithms [J].
Faria, Elaine R. ;
Goncalves, Isabel J. C. R. ;
Gama, Joao ;
Carvalho, Andre C. P. L. F. .
2013 BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS), 2013, :19-25
[8]  
Farid D. M., 2012, 2012 7th International Conference on Electrical & Computer Engineering (ICECE), P630, DOI 10.1109/ICECE.2012.6471629
[9]   An adaptive ensemble classifier for mining concept drifting data streams [J].
Farid, Dewan Md. ;
Zhang, Li ;
Hossain, Alamgir ;
Rahman, Chowdhury Mofizur ;
Strachan, Rebecca ;
Sexton, Graham ;
Dahal, Keshav .
EXPERT SYSTEMS WITH APPLICATIONS, 2013, 40 (15) :5895-5906
[10]  
Frank A., 2010, UCI MACHINE LEARNING