Self-trained prediction model and novel anomaly score mechanism for video anomaly detection

被引:24
作者
Guo, Aibin [1 ]
Guo, Lijun [1 ]
Zhang, Rong [1 ]
Wang, Yirui [1 ]
Gao, Shangce [2 ]
机构
[1] Ningbo Univ, Ningbo, Peoples R China
[2] Univ Toyama, Toyama, Japan
关键词
Anomaly detection; Unsupervised method; Memory module; Reconstruction; Self-training mechanism; EVENT DETECTION;
D O I
10.1016/j.imavis.2022.104391
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video anomaly detection is important in various practical applications. This paper proposes an unsupervised method for video anomaly detection. In the core of the method lies a new prediction model for anomaly detection with novel anomaly score mechanism and self-training mechanism combined with prediction model. In the first stage, we use two conventional unsupervised anomaly detection methods to obtain pseudo normal and anoma-lous frames from the original unlabeled data. In the second stage, we train the prediction model with the pseudo normal frames to learn normal patterns. In the last stage, a three-branch decision module is constructed using prediction model and decision function to calculate the anomaly score of frames and update the pseudo frames for subsequent iterative training. The model then enters the second stage, until the last iterative training is com-pleted. After several iterative training and evaluations, the optimal anomaly scores of the original unlabeled data are finally obtained, and a stable model is generated at the same time. Experimental results on four real-world video datasets demonstrate that the proposed method outperforms state-of-the-art methods without labeled data by a significant margin.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页数:11
相关论文
共 53 条
[1]   Latent Space Autoregression for Novelty Detection [J].
Abati, Davide ;
Porrello, Angelo ;
Calderara, Simone ;
Cucchiara, Rita .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :481-490
[2]   Robust real-time unusual event detection using multiple fixed-location monitors [J].
Adam, Amit ;
Rivlin, Ehud ;
Shimshoni, Ilan ;
Reinitz, David .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (03) :555-560
[3]  
Borghesi A, 2019, AAAI CONF ARTIF INTE, P9428
[4]  
Cheng KW, 2015, PROC CVPR IEEE, P2909, DOI 10.1109/CVPR.2015.7298909
[5]   Abnormal Event Detection in Videos Using Spatiotemporal Autoencoder [J].
Chong, Yong Shean ;
Tay, Yong Haur .
ADVANCES IN NEURAL NETWORKS, PT II, 2017, 10262 :189-196
[6]   Sparse Reconstruction Cost for Abnormal Event Detection [J].
Cong, Yang ;
Yuan, Junsong ;
Liu, Ji .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :1807-+
[7]   Heterogeneous Memory Enhanced Multimodal Attention Model for Video Question Answering [J].
Fan, Chenyou ;
Zhang, Xiaofan ;
Zhang, Shu ;
Wang, Wensheng ;
Zhang, Chi ;
Huang, Heng .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :1999-2007
[8]  
Feng J.-C, P IEEE CVF C COMP VI, P14009
[9]   Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection [J].
Gong, Dong ;
Liu, Lingqiao ;
Le, Vuong ;
Saha, Budhaditya ;
Mansour, Moussa Reda ;
Venkatesh, Svetha ;
van den Hengel, Anton .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1705-1714
[10]   Learning Temporal Regularity in Video Sequences [J].
Hasan, Mahmudul ;
Choi, Jonghyun ;
Neumann, Jan ;
Roy-Chowdhury, Amit K. ;
Davis, Larry S. .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :733-742