Abnormal Event Detection and Localization via Adversarial Event Prediction

被引:63
作者
Yu, Jongmin [1 ]
Lee, Younkwan [2 ]
Yow, Kin Choong [3 ]
Jeon, Moongu [2 ]
Pedrycz, Witold [4 ,5 ,6 ]
机构
[1] Korea Adv Inst Sci & Technol KAIST, Inst IT Convergence, Daejeon 34141, South Korea
[2] Gwangju Inst Sci & Technol GIST, Sch Elect Engn & Comp Sci, Gwangju 61005, South Korea
[3] Univ Regina, Fac Engn & Appl Sci, Regina, SK S4S 0A2, Canada
[4] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[5] Polish Acad Sci, Syst Res Inst, PL-00901 Warsaw, Poland
[6] King Abdulaziz Univ, Dept Elect & Comp Engn, Fac Engn, Jeddah 21589, Saudi Arabia
基金
新加坡国家研究基金会;
关键词
Predictive models; Computational modeling; Feature extraction; Training; Event detection; Learning systems; Adaptive optics; Abnormal event detection (AED); adversarial event prediction (AEP); adversarial learning; event prediction;
D O I
10.1109/TNNLS.2021.3053563
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present adversarial event prediction (AEP), a novel approach to detecting abnormal events through an event prediction setting. Given normal event samples, AEP derives the prediction model, which can discover the correlation between the present and future of events in the training step. In obtaining the prediction model, we propose adversarial learning for the past and future of events. The proposed adversarial learning enforces AEP to learn the representation for predicting future events and restricts the representation learning for the past of events. By exploiting the proposed adversarial learning, AEP can produce the discriminative model to detect an anomaly of events without complementary information, such as optical flow and explicit abnormal event samples in the training step. We demonstrate the efficiency of AEP for detecting anomalies of events using the UCSD-Ped, CUHK Avenue, Subway, and UCF-Crime data sets. Experiments include the performance analysis depending on hyperparameter settings and the comparison with existing state-of-the-art methods. The experimental results show that the proposed adversarial learning can assist in deriving a better model for normal events on AEP, and AEP trained by the proposed adversarial learning can surpass the existing state-of-the-art methods.
引用
收藏
页码:3572 / 3586
页数:15
相关论文
共 78 条
[11]   Learning Spatiotemporal Features with 3D Convolutional Networks [J].
Du Tran ;
Bourdev, Lubomir ;
Fergus, Rob ;
Torresani, Lorenzo ;
Paluri, Manohar .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4489-4497
[12]   Variational Bayesian Learning of Generalized Dirichlet-Based Hidden Markov Models Applied to Unusual Events Detection [J].
Epaillard, Elise ;
Bouguila, Nizar .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2019, 30 (04) :1034-1047
[13]   Deep Representation for Abnormal Event Detection in Crowded Scenes [J].
Feng, Yachuang ;
Yuan, Yuan ;
Lu, Xiaoqiang .
MM'16: PROCEEDINGS OF THE 2016 ACM MULTIMEDIA CONFERENCE, 2016, :591-595
[14]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[15]   Learning Temporal Regularity in Video Sequences [J].
Hasan, Mahmudul ;
Choi, Jonghyun ;
Neumann, Jan ;
Roy-Chowdhury, Amit K. ;
Davis, Larry S. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :733-742
[16]   An anomaly-introduced learning method for abnormal event detection [J].
He, Chengkun ;
Shao, Jie ;
Sun, Jiayu .
MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (22) :29573-29588
[17]  
He KM, 2015, PROC CVPR IEEE, P5353, DOI 10.1109/CVPR.2015.7299173
[18]  
Vu H, 2019, AAAI CONF ARTIF INTE, P5216
[19]  
Ioffe Sergey, 2015, INT C MACHINE LEARNI, V37, P448
[20]   Object-centric Auto-encoders and Dummy Anomalies for Abnormal Event Detection in Video [J].
Ionescu, Radu Tudor ;
Khan, Fahad Shahbaz ;
Georgescu, Mariana-Iuliana ;
Shao, Ling .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :7834-7843