Supervised Anomaly Detection via Conditional Generative Adversarial Network and Ensemble Active Learning

被引:22
作者
Chen, Zhi [1 ]
Duan, Jiang [1 ]
Kang, Li [1 ]
Qiu, Guoping [2 ,3 ]
机构
[1] Southwestern Univ Finance & Econ, Blockchain Res Ctr China, Sch Comp & Artificial Intelligence, Chengdu 611130, Sichuan, Peoples R China
[2] Shenzhen Univ, Shenzhen Inst Artificial intelligence & Robot Soc, Coll Elect & Informat Engn, Guangdong Key Lab Intelligent Informat Proc, Shenzhen 518060, Guangdong Provi, Peoples R China
[3] Univ Nottingham, Sch Comp Sci, Nottingham NG8 1BB, England
基金
中国国家自然科学基金;
关键词
Detectors; Anomaly detection; Generative adversarial networks; Ensemble learning; Training; Generators; Task analysis; conditional generative adversarial network; deep learning; ensemble active learning; ensemble of anomaly detectors; outlier detection;
D O I
10.1109/TPAMI.2022.3225476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Anomaly detection has wide applications in machine intelligence but is still a difficult unsolved problem. Major challenges include the rarity of labeled anomalies and it is a class highly imbalanced problem. Traditional unsupervised anomaly detectors are suboptimal while supervised models can easily make biased predictions towards normal data. In this paper, we present a new supervised anomaly detector through introducing the novel Ensemble Active Learning Generative Adversarial Network (EAL-GAN). EAL-GAN is a conditional GAN having a unique one generator versus multiple discriminators architecture where anomaly detection is implemented by an auxiliary classifier of the discriminator. In addition to using the conditional GAN to generate class balanced supplementary training data, an innovative ensemble learning loss function ensuring each discriminator makes up for the deficiencies of the others is designed to overcome the class imbalanced problem, and an active learning algorithm is introduced to significantly reduce the cost of labeling real-world data. We present extensive experimental results to demonstrate that the new anomaly detector consistently outperforms a variety of SOTA methods by significant margins.
引用
收藏
页码:7781 / 7798
页数:18
相关论文
共 82 条
[11]  
Brock Andrew, 2019, 7 INT C LEARN REPR I
[12]   SMOTE: Synthetic minority over-sampling technique [J].
Chawla, Nitesh V. ;
Bowyer, Kevin W. ;
Hall, Lawrence O. ;
Kegelmeyer, W. Philip .
2002, American Association for Artificial Intelligence (16)
[13]   VaB-AL: Incorporating Class Imbalance and Difficulty with Variational Bayes for Active Learning [J].
Choi, Jongwon ;
Yi, Kwang Moo ;
Kim, Jihoon ;
Choo, Jinho ;
Kim, Byoungjip ;
Chang, Jinyeop ;
Gwon, Youngjune ;
Chang, Hyung Jin .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :6745-6754
[14]  
Donahue Jeff, 2017, Proceedings of the 5th International Conference on Learning Representations, ICLR 2017-Conference Track Proceedings
[16]   Fundamental Technologies in Modern Speech Recognition [J].
Furui, Sadaoki ;
Deng, Li ;
Gales, Mark ;
Ney, Hermann ;
Tokuda, Keiichi .
IEEE SIGNAL PROCESSING MAGAZINE, 2012, 29 (06) :16-17
[17]   Outlier Detection for Temporal Data: A Survey [J].
Gupta, Manish ;
Gao, Jing ;
Aggarwal, Charu C. ;
Han, Jiawei .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (09) :2250-2267
[18]   Context-Aware Query Selection for Active Learning in Event Recognition [J].
Hasan, Mahmudul ;
Paul, Sujoy ;
Mourikis, Anastasios, I ;
Roy-Chowdhury, Amit K. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2020, 42 (03) :554-567
[19]   Discovering cluster-based local outliers [J].
He, ZY ;
Xu, XF ;
Deng, SC .
PATTERN RECOGNITION LETTERS, 2003, 24 (9-10) :1641-1650
[20]  
Hollander M., 2014, NONPARAMETRIC STAT M