ARES: Locally Adaptive Reconstruction-Based Anomaly Scoring

被引:0
|
作者
Goodge, Adam [1 ,3 ]
Hooi, Bryan [1 ,2 ]
Ng, See Kiong [1 ,2 ]
Ng, Wee Siong [3 ]
机构
[1] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[2] Natl Univ Singapore, Inst Data Sci, Singapore, Singapore
[3] ASTAR, Inst Infocomm Res, Singapore, Singapore
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I | 2023年 / 13713卷
关键词
Anomaly detection; Machine learning; Unsupervised learning;
D O I
10.1007/978-3-031-26387-3_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
How can we detect anomalies: that is, samples that significantly differ from a given set of high-dimensional data, such as images or sensor data? This is a practical problem with numerous applications and is also relevant to the goal of making learning algorithms more robust to unexpected inputs. Autoencoders are a popular approach, partly due to their simplicity and their ability to perform dimension reduction. However, the anomaly scoring function is not adaptive to the natural variation in reconstruction error across the range of normal samples, which hinders their ability to detect real anomalies. In this paper, we empirically demonstrate the importance of local adaptivity for anomaly scoring in experiments with real data. We then propose our novel Adaptive Reconstruction Error-based Scoring approach, which adapts its scoring based on the local behaviour of reconstruction error over the latent space. We show that this improves anomaly detection performance over relevant baselines in a wide variety of benchmark datasets.
引用
收藏
页码:193 / 208
页数:16
相关论文
共 50 条
  • [41] Anomaly detection for image data based on data distribution and reconstruction
    Yixin Luo
    Yangling Ma
    Applied Intelligence, 2023, 53 : 22500 - 22510
  • [42] Reconstruction Error based Anomaly Detection Defects Using GAN
    Choi H.
    Seo K.
    Transactions of the Korean Institute of Electrical Engineers, 2021, 70 (04) : 679 - 683
  • [43] Sparsity divergence index based on locally linear embedding for hyperspectral anomaly detection
    Zhang, Lili
    Zhao, Chunhui
    JOURNAL OF APPLIED REMOTE SENSING, 2016, 10
  • [44] Hyperspectral Anomaly Detection Method Based on Adaptive Background Extraction
    Li, Min
    Li, Puhuang
    Xu, Haiyan
    IEEE ACCESS, 2020, 8 : 35446 - 35454
  • [45] An adaptive smartphone anomaly detection model based on data mining
    Hu, Xue Li
    Zhang, Lian Cheng
    Wang, Zhen Xing
    EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2018,
  • [46] An adaptive smartphone anomaly detection model based on data mining
    Xue Li Hu
    Lian Cheng Zhang
    Zhen Xing Wang
    EURASIP Journal on Wireless Communications and Networking, 2018
  • [47] Anomaly detection of process unit based on LSTM time series reconstruction
    Dou S.
    Zhang G.
    Xiong Z.
    Huagong Xuebao/CIESC Journal, 2019, 70 (02): : 481 - 486
  • [48] Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection
    Sus, Wiktor
    Nawrocki, Piotr
    JOURNAL OF GRID COMPUTING, 2024, 22 (02)
  • [49] An Adversarial Training Framework Based on Unsupervised Feature Reconstruction Constraints for Crystalline Silicon Solar Cells Anomaly Detection
    Zhu, Ning
    Wang, Jing
    Zhang, Ying
    Wang, Huan
    Han, Te
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2024, 73
  • [50] An Adaptive Immune Based Anomaly Detection Algorithm For Smart WSN Deployments
    Salvato, M.
    De Vito, S.
    Guerra, S.
    Buonanno, A.
    Fattoruso, G.
    Di Francia, G.
    2015 18TH AISEM ANNUAL CONFERENCE, 2015,