Supervised Anomaly Detection via Conditional Generative Adversarial Network and Ensemble Active Learning

被引:22
作者
Chen, Zhi [1 ]
Duan, Jiang [1 ]
Kang, Li [1 ]
Qiu, Guoping [2 ,3 ]
机构
[1] Southwestern Univ Finance & Econ, Blockchain Res Ctr China, Sch Comp & Artificial Intelligence, Chengdu 611130, Sichuan, Peoples R China
[2] Shenzhen Univ, Shenzhen Inst Artificial intelligence & Robot Soc, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Guangdong Provi, Peoples R China
[3] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England
基金
中国国家自然科学基金;
关键词
Detectors; Anomaly detection; Generative adversarial networks; Ensemble learning; Training; Generators; Task analysis; conditional generative adversarial network; deep learning; ensemble active learning; ensemble of anomaly detectors; outlier detection;
D O I
10.1109/TPAMI.2022.3225476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection has wide applications in machine intelligence but is still a difficult unsolved problem. Major challenges include the rarity of labeled anomalies and it is a class highly imbalanced problem. Traditional unsupervised anomaly detectors are suboptimal while supervised models can easily make biased predictions towards normal data. In this paper, we present a new supervised anomaly detector through introducing the novel Ensemble Active Learning Generative Adversarial Network (EAL-GAN). EAL-GAN is a conditional GAN having a unique one generator versus multiple discriminators architecture where anomaly detection is implemented by an auxiliary classifier of the discriminator. In addition to using the conditional GAN to generate class balanced supplementary training data, an innovative ensemble learning loss function ensuring each discriminator makes up for the deficiencies of the others is designed to overcome the class imbalanced problem, and an active learning algorithm is introduced to significantly reduce the cost of labeling real-world data. We present extensive experimental results to demonstrate that the new anomaly detector consistently outperforms a variety of SOTA methods by significant margins.
引用
收藏
页码:7781 / 7798
页数:18
相关论文
共 82 条
[41]   Distributed Anomaly Detection Using Minimum Volume Elliptical Principal Component Analysis [J].
O'Reilly, Colin ;
Gluhak, Alexander ;
Imran, Muhammad Ali .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (09) :2320-2333
[42]   Adaptive Anomaly Detection with Kernel Eigenspace Splitting and Merging [J].
O'Reilly, Colin ;
Gluhak, Alexander ;
Imran, Muhammad Ali .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (01) :3-16
[43]  
Odena A, 2017, PR MACH LEARN RES, V70
[44]   BIER - Boosting Independent Embeddings Robustly [J].
Opitz, Michael ;
Waltner, Georg ;
Possegger, Horst ;
Bischof, Horst .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :5199-5208
[45]  
Pang G., 2016, P 25 INT JOINT C ART, P1902
[46]   Toward Deep Supervised Anomaly Detection: Reinforcement Learning from Partially Labeled Anomaly Data [J].
Pang, Guansong ;
van den Hengel, Anton ;
Shen, Chunhua ;
Cao, Longbing .
KDD '21: PROCEEDINGS OF THE 27TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2021, :1298-1308
[47]   Heterogeneous Univariate Outlier Ensembles in Multidimensional Data [J].
Pang, Guansong ;
Cao, Longbing .
ACM TRANSACTIONS ON KNOWLEDGE DISCOVERY FROM DATA, 2020, 14 (06)
[48]   Deep Anomaly Detection with Deviation Networks [J].
Pang, Guansong ;
Shen, Chunhua ;
van den Hengel, Anton .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :353-362
[49]   Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detection [J].
Pang, Guansong ;
Cao, Longbing ;
Chen, Ling ;
Liu, Huan .
KDD'18: PROCEEDINGS OF THE 24TH ACM SIGKDD INTERNATIONAL CONFERENCE ON KNOWLEDGE DISCOVERY & DATA MINING, 2018, :2041-2050
[50]  
Pham N., 2012, ACM SIGKDD INT C KNO, P877, DOI 10.1145/2339530.2339669