Anomaly Detection Algorithm Based on Subspace Local Density Estimation

被引:8
|
作者
Zhang, Chunkai [1 ]
Yin, Ao [1 ]
机构
[1] Harbin Inst Technol, Sch Comp Sci & Technol, Shenzhen, Peoples R China
关键词
3; Sigma; Anomaly Detection; Confidence Interval; Ensemble; Random Subspace; OUTLIER DETECTION; FOREST;
D O I
10.4018/IJWSR.2019070103
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, the authors propose a novel anomaly detection algorithm based on subspace local density estimation. The key insight of the proposed algorithm is to build multiple trident trees, which can implement the process of building subspace and local density estimation. Each trident tree (T-tree) is constructed recursively by splitting the data outside of 3 sigma into the left or right subtree and splitting the remaining data into the middle subtree. Each node in trident tree records the number of instances that falls on this node, so each trident tree can be used as a local density estimator. The density of each instance is the average of all trident tree evaluation instance densities, and it can be used as the anomaly score of instances. Since each trident tree is constructed according to 3 sigma principle, it can obtain good anomaly detection results without a large tree height. Theoretical analysis and experimental results show that the proposed algorithm is effective and efficient.
引用
收藏
页码:44 / 58
页数:15
相关论文
共 50 条
  • [1] Privacy preserving anomaly detection based on local density estimation
    Zhang, Chunkai
    Yin, Ao
    Zuo, Wei
    Chen, Yingyang
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2020, 17 (04) : 3478 - 3497
  • [2] Anomaly Detection Using Local Kernel Density Estimation and Context-Based Regression
    Hu, Weiming
    Gao, Jun
    Li, Bing
    Wu, Ou
    Du, Junping
    Maybank, Stephen
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2020, 32 (02) : 218 - 233
  • [3] Efficient Algorithms for Local Density Based Anomaly Detection
    Sinha, Ankita
    Jana, Prasanta K.
    DISTRIBUTED COMPUTING AND INTERNET TECHNOLOGY (ICDCIT 2018), 2018, 10722 : 336 - 342
  • [4] Anomaly detection method based on fast local subspace classifier
    Shibuya, Hisae
    Maeda, Shunji
    IEEJ Transactions on Electronics, Information and Systems, 2014, 134 (05) : 643 - 650
  • [5] Anomaly Detection Method Based on Fast Local Subspace Classifier
    Shibuya, Hisae
    Maeda, Shunji
    ELECTRONICS AND COMMUNICATIONS IN JAPAN, 2016, 99 (01) : 32 - 41
  • [6] A Novel Anomaly Detection Algorithm Based on Trident Tree
    Zhang, Chunkai
    Yin, Ao
    Deng, Yepeng
    Tian, Panbo
    Wang, Xuan
    Dong, Lifeng
    CLOUD COMPUTING - CLOUD 2018, 2018, 10967 : 295 - 306
  • [7] A Hyperspectral Imagery Anomaly Detection Algorithm Based on Local Three-Dimensional Orthogonal Subspace Projection
    Zhang, Xing
    Wen, Gongjian
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXI, 2015, 9643
  • [8] An Integrated Model Based on O-GAN and Density Estimation for Anomaly Detection
    Liu, Shuo
    Xu, Liwen
    IEEE ACCESS, 2020, 8 : 204471 - 204482
  • [9] AN OPTIMIZED DENSITY-BASED ALGORITHM FOR ANOMALY DETECTION IN HIGH DIMENSIONAL DATASETS
    Hashmi, Adeel Shiraz
    Doja, Mohammad Najmud
    Ahmad, Tanvir
    SCALABLE COMPUTING-PRACTICE AND EXPERIENCE, 2018, 19 (01): : 69 - 77
  • [10] Proximity-based density description with regularized reconstruction algorithm for anomaly detection
    Yu, Jaehong
    Do, Hyungrok
    INFORMATION SCIENCES, 2024, 654