ARES: Locally Adaptive Reconstruction-Based Anomaly Scoring

被引:0
|
作者
Goodge, Adam [1 ,3 ]
Hooi, Bryan [1 ,2 ]
Ng, See Kiong [1 ,2 ]
Ng, Wee Siong [3 ]
机构
[1] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[2] Natl Univ Singapore, Inst Data Sci, Singapore, Singapore
[3] ASTAR, Inst Infocomm Res, Singapore, Singapore
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I | 2023年 / 13713卷
关键词
Anomaly detection; Machine learning; Unsupervised learning;
D O I
10.1007/978-3-031-26387-3_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
How can we detect anomalies: that is, samples that significantly differ from a given set of high-dimensional data, such as images or sensor data? This is a practical problem with numerous applications and is also relevant to the goal of making learning algorithms more robust to unexpected inputs. Autoencoders are a popular approach, partly due to their simplicity and their ability to perform dimension reduction. However, the anomaly scoring function is not adaptive to the natural variation in reconstruction error across the range of normal samples, which hinders their ability to detect real anomalies. In this paper, we empirically demonstrate the importance of local adaptivity for anomaly scoring in experiments with real data. We then propose our novel Adaptive Reconstruction Error-based Scoring approach, which adapts its scoring based on the local behaviour of reconstruction error over the latent space. We show that this improves anomaly detection performance over relevant baselines in a wide variety of benchmark datasets.
引用
收藏
页码:193 / 208
页数:16
相关论文
共 50 条
  • [31] Human readable network troubleshooting based on anomaly detection and feature scoring
    Navarro, Jose M.
    Huet, Alexis
    Rossi, Dario
    Computer Networks, 2022, 219
  • [32] Vehicle Trajectory Anomaly Detection Based on Reconstruction Error
    Li, Chaoneng
    Feng, Guanwen
    Jia, Yiran
    Li, Yunan
    Ji, Jian
    Miao, Qiguang
    INTERNATIONAL JOURNAL OF DATA WAREHOUSING AND MINING, 2023, 19 (02)
  • [33] Unsupervised Anomaly Detection for Medical Images Based on Multi-Hierarchical Feature Reconstruction
    Shen, Xiaobo
    Ge, Xianlei
    Wang, Wenming
    IEEE ACCESS, 2024, 12 : 151395 - 151402
  • [34] Anomaly detection method for hyperspectral imagery based on locally linear fitting
    Dai Wei
    Wen Gongjian
    Zhang Xing
    PROCEEDINGS OF 2015 IEEE 12TH INTERNATIONAL CONFERENCE ON ELECTRONIC MEASUREMENT & INSTRUMENTS (ICEMI), VOL. 3, 2015, : 1178 - 1182
  • [35] Anomaly Detection for Hyperspectral Images Based on Robust Locally Linear Embedding
    Li Ma
    Melba M. Crawford
    Jinwen Tian
    Journal of Infrared, Millimeter, and Terahertz Waves, 2010, 31 : 753 - 762
  • [36] Anomaly Detection for Hyperspectral Images Based on Robust Locally Linear Embedding
    Ma, Li
    Crawford, Melba M.
    Tian, Jinwen
    JOURNAL OF INFRARED MILLIMETER AND TERAHERTZ WAVES, 2010, 31 (06) : 753 - 762
  • [37] Blind Concealment from Reconstruction-based Attack Detectors for Industrial Control Systems via Backdoor Attacks
    Walita, Tim
    Erba, Alessandro
    Castellanos, John H.
    Tippenhauer, Nils Ole
    PROCEEDINGS OF THE 9TH ACM CYBER-PHYSICAL SYSTEM SECURITY WORKSHOP, CPSS 2023, 2023, : 36 - 47
  • [38] Adaptive Range-based Anomaly Detection in Drone-assisted Cellular Networks
    Boucetta, Cherifa
    Nour, Boubakr
    Hammami, Seif Eddine
    Moungla, Hassine
    Afifi, Hossam
    2019 15TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2019, : 1239 - 1244
  • [39] Adaptive anomaly detection system based on machine learning algorithms in an industrial control environment
    Vavra, Jan
    Hromada, Martin
    Lukas, Ludek
    Dworzecki, Jacek
    INTERNATIONAL JOURNAL OF CRITICAL INFRASTRUCTURE PROTECTION, 2021, 34 (34)
  • [40] Anomaly detection for image data based on data distribution and reconstruction
    Luo, Yixin
    Ma, Yangling
    APPLIED INTELLIGENCE, 2023, 53 (19) : 22500 - 22510