Incremental Isolation Forest to Handle Concept Drift in Anomaly Detection

被引:0
|
作者
Ahlawat, Nidhi [1 ]
Awekar, Amit [1 ]
机构
[1] Indian Inst Technol Guwahati, Gauhati, India
关键词
anomaly detection; incremental algorithm; isolation forest;
D O I
10.1145/3632410.3632486
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Isolation Forest (iForest) is a well-known model for anomaly detection task. It works by identifying regions corresponding to existing anomalies in the data. With the arrival of new data, concept drift can occur in two ways. First, anomalies can occur in the new regions of the feature space. Second, existing anomalies can become normal with the addition of new data. We observe that the performance of Isolation Forest severely degrades in both these scenarios. Current works fail to tune the existing Isolation Forest to adapt to the concept drift. We propose Incremental Isolation Forest to quickly update the existing Isolation Forest in response to the arrival of new data. Initial experimental results using three real-world datasets indicate that our approach achieves significant time savings with minimal loss in anomaly detection performance.
引用
收藏
页码:582 / 583
页数:2
相关论文
共 50 条
  • [1] Parallel and incremental credit card fraud detection model to handle concept drift and data imbalance
    Akila Somasundaram
    Srinivasulu Reddy
    Neural Computing and Applications, 2019, 31 : 3 - 14
  • [2] Parallel and incremental credit card fraud detection model to handle concept drift and data imbalance
    Somasundaram, Akila
    Reddy, Srinivasulu
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (Suppl 1): : 3 - 14
  • [3] Dynamic Road Anomaly Detection: Harnessing Smartphone Accelerometer Data with Incremental Concept Drift Detection and Classification
    Ferjani, Imen
    Alsaif, Suleiman Ali
    Sensors, 2024, 24 (24)
  • [4] Autoencoder-based Anomaly Detection in Streaming Data with Incremental Learning and Concept Drift Adaptation
    Li, Jin
    Malialis, Kleanthis
    Polycarpou, Marios M.
    2023 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN, 2023,
  • [5] Concept Drift Detection Based on Anomaly Analysis
    Liu, Anjin
    Zhang, Guangquan
    Lu, Jie
    NEURAL INFORMATION PROCESSING (ICONIP 2014), PT I, 2014, 8834 : 263 - 270
  • [6] Concept drift detection based on anomaly analysis
    Liu, Anjin
    Zhang, Guangquan
    Lu, Jie
    Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 2014, 8834 : 263 - 270
  • [7] Concept Drift and Anomaly Detection in Graph Streams
    Zambon, Daniele
    Alippi, Cesare
    Livi, Lorenzo
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2018, 29 (11) : 5592 - 5605
  • [8] Addressing Concept Drift in IoT Anomaly Detection: Drift Detection, Interpretation, and Adaptation
    Xu, Lijuan
    Han, Ziyu
    Zhao, Dawei
    Li, Xin
    Yu, Fuqiang
    Chen, Chuan
    IEEE TRANSACTIONS ON SUSTAINABLE COMPUTING, 2024, 9 (06): : 913 - 924
  • [9] Generalized isolation forest for anomaly detection
    Lesouple, Julien
    Baudoin, Cedric
    Spigai, Marc
    Tourneret, Jean-Yves
    PATTERN RECOGNITION LETTERS, 2021, 149 : 109 - 119
  • [10] Anomaly Detection with Generalized Isolation Forest
    Downey, Brett E.
    Leung, Carson K.
    Pazdor, Adam G. M.
    Petrillo, Ryan A. L.
    Popov, Denys
    Schneider, Benjamin R.
    ADVANCED INFORMATION NETWORKING AND APPLICATIONS, VOL 2, AINA 2024, 2024, 200 : 356 - 368