Abnormal Event Detection and Localization via Adversarial Event Prediction

被引:63
作者
Yu, Jongmin [1 ]
Lee, Younkwan [2 ]
Yow, Kin Choong [3 ]
Jeon, Moongu [2 ]
Pedrycz, Witold [4 ,5 ,6 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Inst IT Convergence, Daejeon 34141, South Korea
[2] Gwangju Inst Sci & Technol GIST, Sch Elect Engn & Comp Sci, Gwangju 61005, South Korea
[3] Univ Regina, Fac Engn & Appl Sci, Regina, SK S4S 0A2, Canada
[4] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[5] Polish Acad Sci, Syst Res Inst, PL-00901 Warsaw, Poland
[6] King Abdulaziz Univ, Dept Elect & Comp Engn, Fac Engn, Jeddah 21589, Saudi Arabia
基金
新加坡国家研究基金会;
关键词
Predictive models; Computational modeling; Feature extraction; Training; Event detection; Learning systems; Adaptive optics; Abnormal event detection (AED); adversarial event prediction (AEP); adversarial learning; event prediction;
D O I
10.1109/TNNLS.2021.3053563
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present adversarial event prediction (AEP), a novel approach to detecting abnormal events through an event prediction setting. Given normal event samples, AEP derives the prediction model, which can discover the correlation between the present and future of events in the training step. In obtaining the prediction model, we propose adversarial learning for the past and future of events. The proposed adversarial learning enforces AEP to learn the representation for predicting future events and restricts the representation learning for the past of events. By exploiting the proposed adversarial learning, AEP can produce the discriminative model to detect an anomaly of events without complementary information, such as optical flow and explicit abnormal event samples in the training step. We demonstrate the efficiency of AEP for detecting anomalies of events using the UCSD-Ped, CUHK Avenue, Subway, and UCF-Crime data sets. Experiments include the performance analysis depending on hyperparameter settings and the comparison with existing state-of-the-art methods. The experimental results show that the proposed adversarial learning can assist in deriving a better model for normal events on AEP, and AEP trained by the proposed adversarial learning can surpass the existing state-of-the-art methods.
引用
收藏
页码:3572 / 3586
页数:15
相关论文
共 78 条
  • [1] Robust real-time unusual event detection using multiple fixed-location monitors
    Adam, Amit
    Rivlin, Ehud
    Shimshoni, Ilan
    Reinitz, David
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (03) : 555 - 560
  • [2] Deep Attention Neural Tensor Network for Visual Question Answering
    Bai, Yalong
    Fu, Jianlong
    Zhao, Tiejun
    Mei, Tao
    [J]. COMPUTER VISION - ECCV 2018, PT XII, 2018, 11216 : 21 - 37
  • [3] Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset
    Carreira, Joao
    Zisserman, Andrew
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 4724 - 4733
  • [4] Beyond triplet loss: a deep quadruplet network for person re-identification
    Chen, Weihua
    Chen, Xiaotang
    Zhang, Jianguo
    Huang, Kaiqi
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 1320 - 1329
  • [5] Abnormal Event Detection in Videos Using Spatiotemporal Autoencoder
    Chong, Yong Shean
    Tay, Yong Haur
    [J]. ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 : 189 - 196
  • [6] Sparse Coding Guided Spatiotemporal Feature Learning for Abnormal Event Detection in Large Videos
    Chu, Wenqing
    Xue, Hongyang
    Yao, Chengwei
    Cai, Deng
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (01) : 246 - 255
  • [7] Sparse Reconstruction Cost for Abnormal Event Detection
    Cong, Yang
    Yuan, Junsong
    Liu, Ji
    [J]. 2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, : 1807 - +
  • [8] Abnormal event detection in crowded scenes using sparse representation
    Cong, Yang
    Yuan, Junsong
    Liu, Ji
    [J]. PATTERN RECOGNITION, 2013, 46 (07) : 1851 - 1864
  • [9] Diba A., 2016, ARXIV160808851
  • [10] Du DW, 2013, IEEE INT CON MULTI