Detecting Anomalies in Videos using Perception Generative Adversarial Network

被引:6
作者
Fan, Yaxiang [1 ,2 ]
Wen, Gongjian [2 ]
Xiao, Fei [1 ]
Qiu, Shaohua [1 ,2 ]
Li, Deren [3 ]
机构
[1] Naval Univ Engn, Natl Key Lab Sci & Technol Vessel Integrated Powe, Wuhan 430033, Peoples R China
[2] Natl Univ Def Technol, Sci & Technol Automat Target Recognit Lab ATR, Changsha 410073, Peoples R China
[3] Wuhan Univ, State Key Lab Informat Engn Surveying, Mapping & Remote Sensing, Wuhan 430071, Hubei, Peoples R China
关键词
Unsupervised anomaly detection; Video surveillance; Deep learning; Generative adversarial networks; Perception loss; Two-stream network; ONLINE; LOCALIZATION;
D O I
10.1007/s00034-021-01820-8
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper presents a novel end-to-end unsupervised deep learning approach for video anomaly detection. We propose to utilize the Perception Generative Adversarial Net (Perception-GAN), which is trained using the initial portion of the video. The generator of the perceptual-GAN learns how to generate events similar to the normal events, while the discriminator of the perceptual-GAN learns how to distinguish the abnormal events from the normal events. At testing time, only the discriminator is used to solve our discriminative task (abnormality detection). Through combining the generative adversarial loss and the proposed perceptual adversarial loss, these two networks can be trained alternately to solve the anomaly detection task. A two-stream networks framework and an update strategy is employed to improve the detection result. We test our approach on three popular benchmarks and the experimental results verify the superiority of our method compared to the state of the arts.
引用
收藏
页码:994 / 1018
页数:25
相关论文
共 50 条
  • [21] Complementary Photoplethysmogram Synthesis From Electrocardiogram Using Generative Adversarial Network
    Shin, Heean
    Sun, Sukkyu
    Lee, Joonnyong
    Kim, Hee Chan
    IEEE ACCESS, 2021, 9 (09): : 70639 - 70649
  • [22] Enhancing network intrusion detection performance using generative adversarial networks
    Zhao, Xinxing
    Fok, Kar Wai
    Thing, Vrizlynn L. L.
    COMPUTERS & SECURITY, 2024, 145
  • [23] Image Clustering Using an Augmented Generative Adversarial Network and Information Maximization
    Ntelemis, Foivos
    Jin, Yaochu
    Thomas, Spencer A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (12) : 7461 - 7474
  • [24] Automatic Hemorrhage Detection From Color Doppler Ultrasound Using a Generative Adversarial Network (GAN)-Based Anomaly Detection Method
    Mitra, Jhimli
    Qiu, Jianwei
    MacDonald, Michael
    Venugopal, Prem
    Wallace, Kirk
    Abdou, Hossam
    Richmond, Michael
    Elansary, Noha
    Edwards, Joseph
    Patel, Neerav
    Morrison, Jonathan
    Marinelli, Luca
    IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE, 2022, 10
  • [25] Transforming the Emotion in Speech using a Generative Adversarial Network
    Yasuda, Kenji
    Orihara, Ryohei
    Sei, Yuichi
    Tahara, Yasuyuki
    Ohsuga, Akihiko
    PROCEEDINGS OF THE 11TH INTERNATIONAL CONFERENCE ON AGENTS AND ARTIFICIAL INTELLIGENCE (ICAART), VOL 2, 2019, : 427 - 434
  • [26] Spatiotemporal Reflectance Fusion Using a Generative Adversarial Network
    Shang, Cheng
    Li, Xinyan
    Yin, Zhixiang
    Li, Xiaodong
    Wang, Lihui
    Zhang, Yihang
    Du, Yun
    Ling, Feng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [27] Video quality assessment using generative adversarial network
    Voronin, V.
    Franc, V
    Zelensky, A.
    Agaian, S.
    MOBILE MULTIMEDIA/IMAGE PROCESSING, SECURITY, AND APPLICATIONS 2019, 2019, 10993
  • [28] Uncovering Vein Pattern using Generative Adversarial Network
    Ma, Gehua
    Wang, Biao
    Tang, Chaoying
    ELEVENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2019), 2019, 11179
  • [29] Detection of Phishing websites using Generative Adversarial Network
    Robic-Butez, Pierrick
    Win, Thu Yein
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 3216 - 3221
  • [30] Speech Enhancement Using Generative Adversarial Network (GAN)
    Huq, Mahmudul
    Maskeliunas, Rytis
    HYBRID INTELLIGENT SYSTEMS, HIS 2021, 2022, 420 : 273 - 282