Supervised Anomaly Detection via Conditional Generative Adversarial Network and Ensemble Active Learning

被引:22
作者
Chen, Zhi [1 ]
Duan, Jiang [1 ]
Kang, Li [1 ]
Qiu, Guoping [2 ,3 ]
机构
[1] Southwestern Univ Finance & Econ, Blockchain Res Ctr China, Sch Comp & Artificial Intelligence, Chengdu 611130, Sichuan, Peoples R China
[2] Shenzhen Univ, Shenzhen Inst Artificial intelligence & Robot Soc, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Guangdong Provi, Peoples R China
[3] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England
基金
中国国家自然科学基金;
关键词
Detectors; Anomaly detection; Generative adversarial networks; Ensemble learning; Training; Generators; Task analysis; conditional generative adversarial network; deep learning; ensemble active learning; ensemble of anomaly detectors; outlier detection;
D O I
10.1109/TPAMI.2022.3225476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection has wide applications in machine intelligence but is still a difficult unsolved problem. Major challenges include the rarity of labeled anomalies and it is a class highly imbalanced problem. Traditional unsupervised anomaly detectors are suboptimal while supervised models can easily make biased predictions towards normal data. In this paper, we present a new supervised anomaly detector through introducing the novel Ensemble Active Learning Generative Adversarial Network (EAL-GAN). EAL-GAN is a conditional GAN having a unique one generator versus multiple discriminators architecture where anomaly detection is implemented by an auxiliary classifier of the discriminator. In addition to using the conditional GAN to generate class balanced supplementary training data, an innovative ensemble learning loss function ensuring each discriminator makes up for the deficiencies of the others is designed to overcome the class imbalanced problem, and an active learning algorithm is introduced to significantly reduce the cost of labeling real-world data. We present extensive experimental results to demonstrate that the new anomaly detector consistently outperforms a variety of SOTA methods by significant margins.
引用
收藏
页码:7781 / 7798
页数:18
相关论文
共 82 条
[1]  
Abe N., 2006, P 12 ACM SIGKDD INT, V2006, P504, DOI DOI 10.1145/1150402.1150459
[2]   Semi-Supervised Discriminative Classification Robust to Sample-Outliers and Feature-Noises [J].
Adeli, Ehsan ;
Thung, Kim-Han ;
An, Le ;
Wu, Guorong ;
Shi, Feng ;
Wang, Tao ;
Shen, Dinggang .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (02) :515-522
[3]  
Aggarwal C. C., 2017, Outlier Analysis, DOI DOI 10.1007/978-3-319-47578-3
[4]  
Aggarwal U, 2020, IEEE WINT CONF APPL, P1417, DOI 10.1109/WACV45572.2020.9093475
[5]  
Angiulli F., 2002, Principles of Data Mining and Knowledge Discovery. 6th European Conference, PKDD 2002. Proceedings (Lecture Notes in Artificial Intelligence Vol.2431), P15
[6]  
Attenberg J, 2013, IMBALANCED LEARNING: FOUNDATIONS, ALGORITHMS, AND APPLICATIONS, P101
[7]   Detecting Regions of Maximal Divergence for Spatio-Temporal Anomaly Detection [J].
Barz, Bjorn ;
Rodner, Erik ;
Garcia, Yanira Guanche ;
Denzler, Joachim .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (05) :1088-1101
[8]  
Bhattacharya Aditya R, 2019, BMVC, P121
[9]   Outlier Detection for Robust Multi-Dimensional Scaling [J].
Blouvshtein, Leonid ;
Cohen-Or, Daniel .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2019, 41 (09) :2273-2279
[10]   LOF: Identifying density-based local outliers [J].
Breunig, MM ;
Kriegel, HP ;
Ng, RT ;
Sander, J .
SIGMOD RECORD, 2000, 29 (02) :93-104