Developing a generic framework for anomaly detection

被引:19
作者
Fatemifar, Soroush [1 ]
Awais, Muhammad [1 ]
Akbari, Ali [1 ]
Kittler, Josef [1 ]
机构
[1] Univ Surrey, Ctr Vis Speech & Signal Proc, Guildford, Surrey, England
基金
英国工程与自然科学研究理事会;
关键词
Anomaly detection; One-class classification; Score normalisation; Face spoofing detection; Convolutional neural network;
D O I
10.1016/j.patcog.2021.108500
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The fusion of one-class classifiers (OCCs) has been shown to exhibit promising performance in a variety of machine learning applications. The ability to assess the similarity or correlation between the output of various OCCs is an important prerequisite for building of a meaningful OCCs ensemble. However, this aspect of the OCC fusion problem has been mostly ignored so far. In this paper, we propose a new method of constructing a fusion of OCCs with three contributions: (a) As a key contribution, enabling an OCC ensemble design using exclusively non anomalous samples, we propose a novel fitness function to evaluate the competency of OCCs without requiring samples from the anomalous class; (b) As a minor, but impactful contribution, we investigate alternative forms of score normalisation of OCCs, and identify a novel two-sided normalisation method as the best in coping with long tail non anomalous data distributions; (c) In the context of building our proposed OCC fusion system based on the weighted averaging approach, we find that the weights optimised using a particle swarm optimisation algorithm produce the most effective solution. We evaluate the merits of the proposed method on 15 benchmarking datasets from different application domains including medical, anti-spam and face spoofing detection. The comparison of the proposed approach with state-of-the-art methods alongside the statistical analysis confirm the effectiveness of the proposed model. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:14
相关论文
共 50 条
[41]   An anomaly detection framework for dynamic systems using a Bayesian hierarchical framework [J].
Moghaddass, Ramin ;
Sheng, Shuangwen .
APPLIED ENERGY, 2019, 240 :561-582
[42]   A VIDEO ANALYTICS FRAMEWORK FOR AMORPHOUS AND UNSTRUCTURED ANOMALY DETECTION [J].
Mueller, Martin ;
Karasev, Peter ;
Kolesov, Ivan ;
Tannenbaum, Allen .
2011 18TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2011,
[43]   Anomaly Detection Framework for SFC Integrity in NFV Environments [J].
Bondan, Lucas ;
Wauters, Tim ;
Volckaert, Bruno ;
De Turck, Filip ;
Granville, Lisandro Zambenedetti .
2017 IEEE CONFERENCE ON NETWORK SOFTWARIZATION (IEEE NETSOFT), 2017,
[44]   Anomaly Detection Framework for Tracing Problems in Radio Networks [J].
Turkka, Jussi ;
Ristaniemi, Tapani ;
David, Gil ;
Averbuch, Amir .
PROCEEDINGS OF THE TENTH INTERNATIONAL CONFERENCE ON NETWORKS (ICN 2011), 2011, :317-321
[45]   An Anomaly Detection Framework Based on Autoencoder and Nearest Neighbor [J].
Guo, Jia ;
Liu, Guannan ;
Zuo, Yuan ;
Wu, Junjie .
2018 15TH INTERNATIONAL CONFERENCE ON SERVICE SYSTEMS AND SERVICE MANAGEMENT (ICSSSM), 2018,
[46]   A framework for anomaly detection and classification in Multiple IoT scenarios [J].
Cauteruccio, Francesco ;
Cinelli, Luca ;
Corradini, Enrico ;
Terracina, Giorgio ;
Ursino, Domenico ;
Virgili, Luca ;
Savaglio, Claudio ;
Liotta, Antonio ;
Fortino, Giancarlo .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 114 :322-335
[47]   Web Anomaly Misuse Intrusion Detection Framework for SQL Injection Detection [J].
Salama, Shaimaa Ezzat ;
Marie, Mohamed I. ;
El-Fangary, Laila M. ;
Helmy, Yehia K. .
INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2012, 3 (03) :123-129
[48]   Probabilistic framework of visual anomaly detection for unbalanced data [J].
Wang, Yongxiong ;
Li, Xuan ;
Ding, Xueming .
NEUROCOMPUTING, 2016, 201 :12-18
[49]   Discriminative Autoencoding Framework for Simple and Efficient Anomaly Detection [J].
Mao, Sheng ;
Guo, Jiansheng ;
Li, Zhengxin .
IEEE ACCESS, 2019, 7 :140618-140630
[50]   Multifaceted anomaly detection framework for leachate monitoring in landfills [J].
Liu, Rong ;
Jiang, Shiyu ;
Ou, Jian ;
Kouadio, Kouao Laurent ;
Xiong, Bo .
JOURNAL OF ENVIRONMENTAL MANAGEMENT, 2024, 368