ARES: Locally Adaptive Reconstruction-Based Anomaly Scoring

被引:0
|
作者
Goodge, Adam [1 ,3 ]
Hooi, Bryan [1 ,2 ]
Ng, See Kiong [1 ,2 ]
Ng, Wee Siong [3 ]
机构
[1] Natl Univ Singapore, Sch Comp, Singapore, Singapore
[2] Natl Univ Singapore, Inst Data Sci, Singapore, Singapore
[3] ASTAR, Inst Infocomm Res, Singapore, Singapore
来源
MACHINE LEARNING AND KNOWLEDGE DISCOVERY IN DATABASES, ECML PKDD 2022, PT I | 2023年 / 13713卷
关键词
Anomaly detection; Machine learning; Unsupervised learning;
D O I
10.1007/978-3-031-26387-3_12
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
How can we detect anomalies: that is, samples that significantly differ from a given set of high-dimensional data, such as images or sensor data? This is a practical problem with numerous applications and is also relevant to the goal of making learning algorithms more robust to unexpected inputs. Autoencoders are a popular approach, partly due to their simplicity and their ability to perform dimension reduction. However, the anomaly scoring function is not adaptive to the natural variation in reconstruction error across the range of normal samples, which hinders their ability to detect real anomalies. In this paper, we empirically demonstrate the importance of local adaptivity for anomaly scoring in experiments with real data. We then propose our novel Adaptive Reconstruction Error-based Scoring approach, which adapts its scoring based on the local behaviour of reconstruction error over the latent space. We show that this improves anomaly detection performance over relevant baselines in a wide variety of benchmark datasets.
引用
收藏
页码:193 / 208
页数:16
相关论文
共 50 条
  • [21] Practical autoencoder based anomaly detection by using vector reconstruction error
    Hasan Torabi
    Seyedeh Leili Mirtaheri
    Sergio Greco
    Cybersecurity, 6
  • [22] Practical autoencoder based anomaly detection by using vector reconstruction error
    Torabi, Hasan
    Mirtaheri, Seyedeh Leili
    Greco, Sergio
    CYBERSECURITY, 2023, 6 (01)
  • [23] Hierarchical Feature Fusion based Reconstruction Network for Unsupervised Anomaly Detection
    Zhao, Binjie
    Nie, Jiahao
    Guan, Siwei
    Wang, Han
    He, Zhiwei
    Gao, Mingyu
    2022 IEEE 27TH INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2022,
  • [24] A Category-Specific Dictionary Learning Method Tailored for Reconstruction-Based Feature Coding
    Xu, Ye
    Duan, Lihua
    Yu, Xiaodong
    Wang, Tian
    Shi, Yingzhong
    IEEE ACCESS, 2020, 8 : 167236 - 167251
  • [25] AdapSyn: Anomaly detection based on triplet training with adaptive anomaly synthesis
    Zhou, Shijie
    Lin, Chunyu
    Chen, Zisong
    Guo, Baoqing
    Zhao, Yao
    DISPLAYS, 2025, 86
  • [26] An Adaptive Anomaly Detection Algorithm Based on CFSFDP
    Ren, Weiwu
    Di, Xiaoqiang
    Du, Zhanwei
    Zhao, Jianping
    CMC-COMPUTERS MATERIALS & CONTINUA, 2021, 68 (02): : 2057 - 2073
  • [27] Improving Deep Learning Based Anomaly Detection on Multivariate Time Series Through Separated Anomaly Scoring
    Lundstrom, Adam
    O'Nils, Mattias
    Qureshi, Faisal Z.
    Jantsch, Axel
    IEEE ACCESS, 2022, 10 : 108194 - 108204
  • [28] ASE: Anomaly scoring based ensemble learning for highly imbalanced datasets
    Liang, Xiayu
    Gao, Ying
    Xu, Shanrong
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 238
  • [29] Anomaly detection based on doubly-kernelized scoring and matrix kernels
    Hirose S.
    Kozu T.
    2016, Japanese Society for Artificial Intelligence (31)
  • [30] Unsupervised Anomaly Detection of Industrial Images Based on Dual Generator Reconstruction Networks
    Gu, Cong
    Ren, Siyv
    Duan, Qiqiang
    INFORMATION TECHNOLOGY AND CONTROL, 2024, 53 (02): : 331 - 341