Strategies for data stream mining method applied in anomaly detection

被引:13
|
作者
Sun, Ruxia [1 ]
Zhang, Sun [1 ]
Yin, Chunyong [1 ]
Wang, Jin [2 ,3 ]
Min, Seungwook [4 ]
机构
[1] Nanjing Univ Informat Sci & Technol, Jiangsu Collaborat Innovat Ctr Atmospher Environm, Jiangsu Engn Ctr Network Monitoring, Sch Comp & Software, Nanjing, Jiangsu, Peoples R China
[2] Nanjing Univ Posts & Telecommun, Minist Educ, Key Lab Broadband Wireless Commun & Sensor Networ, Nanjing, Jiangsu, Peoples R China
[3] Yangzhou Univ, Coll Informat Engn, Yangzhou, Jiangsu, Peoples R China
[4] Sangmyung Univ, Dept Comp Sci, Seoul, South Korea
基金
中国国家自然科学基金;
关键词
Anomaly detection; Data stream; Clustering; Concept drift; DETECTION SYSTEM; ALGORITHMS;
D O I
10.1007/s10586-018-2835-2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Anomaly detection, which is a method of intrusion detection, detects anomaly behaviors and protects network security. Data mining technology has been integrated to improve the performance of anomaly detection and some algorithms have been improved for anomaly detection field. We think that most data mining algorithms are analyzed on static data sets and ignore the influence of dynamic data streams. Data stream is the potentially unbounded, ordered sequence of data objects which arrive over time. The entire data objects cannot be stored and they need to be handled in one-time scanning. The data distribution of data stream may change over time and this phenomenon is called concept drift. The properties of data stream make analysis method different from the method based on data set and the analysis model is required to be updated immediately when concept drift occurs. In this paper, we summarize the characteristics of data stream, compare the difference between data stream and data set, discuss the problems of data stream mining and propose some corresponding strategies.
引用
收藏
页码:399 / 408
页数:10
相关论文
共 50 条
  • [31] An Outlier mining-based method for anomaly detection
    Wu, Nannan
    Shi, Liang
    Jiang, Qingshan
    Weng, Fangfei
    2007 INTERNATIONAL WORKSHOP ON ANTI-COUNTERFEITING, SECURITY, AND IDENTIFICATION, 2007, : 152 - +
  • [32] Data stream mining architecture for network intrusion detection
    Chu, NCN
    Williams, A
    Alhajj, R
    Barker, K
    PROCEEDINGS OF THE 2004 IEEE INTERNATIONAL CONFERENCE ON INFORMATION REUSE AND INTEGRATION (IRI-2004), 2004, : 363 - 368
  • [33] Adaptive Spike Detection for Resilient Data Stream Mining
    Clayton School of Information Technology, Monash University, Clayton, VIC 3800, Australia
    不详
    不详
    Conf. Res. Pract. Inf. Technol. Ser., 2007, (181-188):
  • [34] Anomaly detection in large-scale data stream networks
    Duc-Son Pham
    Venkatesh, Svetha
    Lazarescu, Mihai
    Budhaditya, Saha
    DATA MINING AND KNOWLEDGE DISCOVERY, 2014, 28 (01) : 145 - 189
  • [35] An algorithm for data stream speed anomaly detection based on RCSW
    Zhan, Y. (zhanying@zjvtit.edu.cn), 2012, Chinese Institute of Electronics (40):
  • [36] Data Stream Clustering for Online Anomaly Detection in Cloud Applications
    Sauvanaud, Carla
    Silvestre, Guthemberg
    Kaaniche, Mohamed
    Kanoun, Karama
    2015 ELEVENTH EUROPEAN DEPENDABLE COMPUTING CONFERENCE (EDCC), 2015, : 120 - 131
  • [37] Anomaly detection in large-scale data stream networks
    Duc-Son Pham
    Svetha Venkatesh
    Mihai Lazarescu
    Saha Budhaditya
    Data Mining and Knowledge Discovery, 2014, 28 : 145 - 189
  • [38] An anomaly detection scheme for data stream in cold chain logistics
    Xie, Zhibo
    Long, Heng
    Ling, Chengyi
    Zhou, Yingjun
    Luo, Yan
    PLOS ONE, 2025, 20 (03):
  • [39] A data mining method applied to a metallurgical process
    Saxen, Henrik
    Pettersson, Frank
    2007 IEEE SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DATA MINING, VOLS 1 AND 2, 2007, : 368 - 375
  • [40] Data Stream Mining Applied to Maximum Wind Forecasting in the Canary Islands
    Sanchez-Medina, Javier J.
    Antonio Guerra-Montenegro, Juan
    Sanchez-Rodriguez, David
    Alonso-Gonzalez, Itziar G.
    Navarro-Mesa, Juan L.
    SENSORS, 2019, 19 (10)