RDDM: Reactive drift detection method

被引:116
作者
Barros, Roberto S. M. [1 ]
Cabral, Danilo R. L. [1 ]
Goncalves, Paulo M., Jr. [2 ]
Santos, Silas G. T. C. [1 ]
机构
[1] Univ Fed Pernambuco, Ctr Informat, Cidade Univ, BR-50740560 Recife, PE, Brazil
[2] Inst Fed Educ Ciencia & Tecnol Pernambuco, Cidade Univ, BR-50740540 Recife, PE, Brazil
关键词
Concept drift; Drift detection methods; Data stream; Online learning; ONLINE;
D O I
10.1016/j.eswa.2017.08.023
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Concept drift detectors are online learning software that mostly attempt to estimate the drift positions in data streams in order to modify the base classifier after these changes and improve accuracy. This is very important in applications such as the detection of anomalies in TCP/IP traffic and/or frauds in financial transactions. Drift Detection Method (DDM) is a simple, efficient, well-known method whose performance is often impaired when the concepts are very long. This article proposes the Reactive Drift Detection Method (RDDM), which is based on DDM and, among other modifications, discards older instances of very long concepts aiming to detect drifts earlier, improving the final accuracy. Experiments run in MOA, using abrupt and gradual concept drift versions of different dataset generators and sizes (48 artificial datasets in total), as well as three real-world datasets, suggest RDDM beats the accuracy results of DDM, ECDD, and STEPD in most scenarios. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:344 / 355
页数:12
相关论文
共 35 条
[1]   DATABASE MINING - A PERFORMANCE PERSPECTIVE [J].
AGRAWAL, R ;
IMIELINSKI, T ;
SWAMI, A .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1993, 5 (06) :914-925
[2]  
[Anonymous], THESIS
[3]  
[Anonymous], 2015, P IEEE INT JOINT C N
[4]   Paired Learners for Concept Drift [J].
Bach, Stephen H. ;
Maloof, Marcus A. .
ICDM 2008: EIGHTH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, PROCEEDINGS, 2008, :23-32
[5]  
Baena-Garcia M., 2006, 4 INT WORKSHOP KNOWL, V6, P77
[6]  
Bifet Albert, 2013, Machine Learning and Knowledge Discovery in Databases. European Conference, ECML PKDD 2013. Proceedings: LNCS 8188, P465, DOI 10.1007/978-3-642-40988-2_30
[7]  
Bifet A, 2010, LECT NOTES ARTIF INT, V6321, P135, DOI 10.1007/978-3-642-15880-3_15
[8]  
Bifet A, 2010, J MACH LEARN RES, V11, P1601
[9]  
Bifet A, 2009, KDD-09: 15TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, P139
[10]  
Bifet A, 2007, PROCEEDINGS OF THE SEVENTH SIAM INTERNATIONAL CONFERENCE ON DATA MINING, P443