One-class anomaly detection via novelty normalization

被引:6
作者
Wu, Jhih-Ciang [1 ,2 ]
Lu, Sherman [1 ]
Fuh, Chiou-Shann [2 ]
Liu, Tyng-Luh [1 ]
机构
[1] Acad Sinica, Inst Informat Sci, Taipei 115, Taiwan
[2] Natl Taiwan Univ, Dept Comp Sci & Informat Engn, Taipei 106, Taiwan
关键词
Deep learning; Anomaly detection; Unsupervised learning; Convolutional neural network;
D O I
10.1016/j.cviu.2021.103226
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection is an important task in many real-world applications, such as within cybersecurity and surveillance. As with most data these days, the size and dimensionality of the data within these fields are constantly growing, which makes it essential to develop an approach that can both accurately and efficiently identify anomalies within these datasets. In this paper, we address the problem of one-class anomaly detection, where after training on a singular class, we try to determine whether or not inputs belong to that said class. Most of the currently existing methods have limitations in which the criterion of the novel class relies solely on the reconstruction error term. We attempt to break away from this restriction by proposing the use of an autoencoder network with a normalization term. We pair this with an additive novelty scoring module during the training procedure as a way to determine the difference between a given image and our determined normal class, therefore improving the efficiency of our model. We evaluate our model on MNIST, CIFAR-10, and Fashion-MNIST, three popular datasets for image classification, and compare the results against other various state-of-the-art models to determine the efficacy of our efforts. Our model not only outperforms the existing methods, but it also gives us a narrower range of AUCs for the tested classes, suggesting a stark improvement in both accuracy and precision. Moreover, we discover that introducing this "Novelty Normalization"concept into our model allows us to expand its usage into multiclass scenarios without a steep drop in accuracy.
引用
收藏
页数:7
相关论文
共 39 条
[1]   Latent Space Autoregression for Novelty Detection [J].
Abati, Davide ;
Porrello, Angelo ;
Calderara, Simone ;
Cucchiara, Rita .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :481-490
[2]  
Amer M., 2013, P ACM SIGKDD WORKSH, P8, DOI DOI 10.1145/2500853.2500857
[3]  
[Anonymous], 2010, MNIST HANDWRITTEN DI
[4]  
[Anonymous], 2017, Master's Thesis
[5]   Unsupervised Learning [J].
Barlow, H. B. .
NEURAL COMPUTATION, 1989, 1 (03) :295-311
[6]  
Bergman L., 2020, International Con-ference on Learning Representations
[7]  
Bishop C.M., 2006, Pattern Recognition and Machine Learning, DOI DOI 10.1007/978-0-387-45528-0
[8]  
Chalapathy R., 2019, ARXIV190103407
[9]   ArcFace: Additive Angular Margin Loss for Deep Face Recognition [J].
Deng, Jiankang ;
Guo, Jia ;
Xue, Niannan ;
Zafeiriou, Stefanos .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :4685-4694
[10]  
Doretto Gianfranco, 2018, ADV NEUR IN, V31