Anomaly detection method for sensor network data streams based on sliding window sampling and optimized clustering

被引：12
|
作者：
Lin, Ling [1 ,2 ]
Su, Jinshan [1 ]
机构：
[1] Yili Normal Univ, Elect & Informat Engn Coll, Yining 835000, Xinjiang, Peoples R China
[2] Nanjing Univ, Collaborat Innovat Ctr Novel Software Technol & I, State Key Lab Novel Software Technol, Nanjing 210025, Jiangsu, Peoples R China
来源：
SAFETY SCIENCE | 2019年 / 118卷
关键词：
Data stream sampling; Dimension cluster; Maximum entropy principle; Clustering; Anomaly detection;
D O I：
10.1016/j.ssci.2019.04.047
中图分类号：
T [工业技术];
学科分类号：
08 ;
摘要：
When detecting abnormal data in the sensor network data stream, it is necessary to accurately obtain the source of the abnormal data. The traditional data stream clustering algorithm has the disadvantages of large clustering information loss and low accuracy. Therefore, this paper proposes a sensor network data stream anomaly detection method based on optimized clustering. Firstly, the proposed sampling algorithm is used to sample the data stream. The sampling result is used as a sample set. Use dynamic data histogram to divide the data dimension into different dimension groups, calculate the maximum entropy division dimension space cluster of each dimension, and aggregate the data of the same dimension cluster into the micro cluster. The abnormality detection of the data stream is realized by comparing the information entropy size of the micro cluster and its distribution characteristics. The experimental results show that the proposed algorithm can improve the accuracy and effectiveness of data stream anomaly detection.
引用
收藏
页码：70 / 75
页数：6
相关论文
共 50 条
  • [1] Density and sliding window-based clustering over evolving data streams
    Yu, Yanwei
    Zhao, Jindong
    Zhang, Yonggang
    Wen, Changci
    ICIC Express Letters, Part B: Applications, 2015, 6 (08): : 2275 - 2283
  • [2] Clustering Heterogeneous Data Streams with Uncertainty over Sliding Window
    Hentech, Houda
    Gouider, Mohammed Salah
    Farhat, Amine
    MODEL AND DATA ENGINEERING, MEDI 2013, 2013, 8216 : 162 - 175
  • [3] Anomaly detection of large scale network based on data streams
    Research Center of Computer Network and Information Security Technology, Harbin Institute of Technology, Harbin 150001, China
    Tongxin Xuebao, 2006, 2 (1-8):
  • [4] A clustering approach for sampling data streams in sensor networks
    Alzennyr da Silva
    Raja Chiky
    Georges Hébrail
    Knowledge and Information Systems, 2012, 32 : 1 - 23
  • [5] A clustering approach for sampling data streams in sensor networks
    da Silva, Alzennyr
    Chiky, Raja
    Hebrail, Georges
    KNOWLEDGE AND INFORMATION SYSTEMS, 2012, 32 (01) : 1 - 23
  • [6] A performance evaluation of data streams sampling algorithms over a sliding window
    El Sibai, Rayane
    Chabchoub, Yousra
    Demerjian, Jacques
    Chiky, Raja
    Barbar, Kablan
    2018 IEEE MIDDLE EAST AND NORTH AFRICA COMMUNICATIONS CONFERENCE (MENACOMM), 2018, : 211 - 216
  • [7] Adaptive Anomaly Detection on Network Data Streams
    Riddle-Workman, Elizabeth
    Evangelou, Marina
    Adams, Niall M.
    2018 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SECURITY INFORMATICS (ISI), 2018, : 19 - 24
  • [8] Approximate data mining for sliding window based data streams
    Yin, Kuo-Cheng
    Hsieh, Yu-Lung
    Yang, Don-Lin
    Journal of Computers, 2012, 23 (02): : 1 - 13
  • [9] Effective Anomaly Detection in Sensor Networks Data Streams
    Budhaditya, Saha
    Pham, Duc-Son
    Lazarescu, Mihai
    Venkatesh, Svetha
    2009 9TH IEEE INTERNATIONAL CONFERENCE ON DATA MINING, 2009, : 722 - 727
  • [10] An anomaly detection data recognition algorithm of portable gas sensor for calibration in mine IoT based on sliding time window
    Wang, Gang
    Wang, Cheng
    2019 11TH INTERNATIONAL CONFERENCE ON WIRELESS COMMUNICATIONS AND SIGNAL PROCESSING (WCSP), 2019,
12345