Towards Video Anomaly Detection in the Real World: A Binarization Embedded Weakly-Supervised Network

被引:8
作者
Yang, Zhen [1 ]
Guo, Yuanfang [1 ]
Wang, Junfu [2 ]
Huang, Di [1 ,3 ]
Bao, Xiuguo [4 ]
Wang, Yunhong [2 ]
机构
[1] Beihang Univ, Sch Comp Sci & Engn, State Key Lab Software Dev Environm, Beijing 100191, Peoples R China
[2] Beihang Univ, Sch Comp Sci & Engn, Beijing 100191, Peoples R China
[3] Beihang Univ, Hangzhou Innovat Inst, Hangzhou 310052, Peoples R China
[4] Natl Comp Network Emergency Response Tech Team Coo, Beijing 100029, Peoples R China
关键词
Feature extraction; Anomaly detection; Training; Surveillance; Memory management; Correlation; Convolution; Video anomaly detection; weakly supervised learning; binarized graph convolutional network;
D O I
10.1109/TCSVT.2023.3321235
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this letter, we pioneer to propose a binarization embedded weakly-supervised video anomaly detection (BE-WSVAD) method by constructing a binarized GCN-based anomaly detection module. Compared to the existing weakly-supervised video anomaly detection (WS-VAD) methods, BE-WSVAD focuses on the detection efficiency, which is ignored by the existing literature yet vital in real applications. Specifically, to improve the detection performance of the binary anomaly detection module, we propose a binary network augmentation strategy in the training process. Due to the weakly supervision mechanism, the videos employed in the training process are usually lengthy, in which the lengthy-input dependencies tend to be exploited to improve the detection performance with extra memory consumption. Then, we propose the short-input inference modes, which can largely reduce the desired length of the input video. Experimental results demonstrate the superiority of our BE-WSVAD in terms of the memory and computational consumptions while giving comparable accuracies.
引用
收藏
页码:4135 / 4140
页数:6
相关论文
共 17 条
[1]   Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset [J].
Carreira, Joao ;
Zisserman, Andrew .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4724-4733
[2]  
Gong Y., 2022, P IEEE INT C MULT EX, P1
[3]  
Li S, 2022, AAAI CONF ARTIF INTE, P1395
[4]   Future Frame Prediction for Anomaly Detection - A New Baseline [J].
Liu, Wen ;
Luo, Weixin ;
Lian, Dongze ;
Gao, Shenghua .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6536-6545
[5]   Learning Normal Dynamics in Videos with Meta Prototype Network [J].
Lv, Hui ;
Chen, Chen ;
Cui, Zhen ;
Xu, Chunyan ;
Li, Yong ;
Yang, Jian .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15420-15429
[6]   Adaptive Sparse Representations for Video Anomaly Detection [J].
Mo, Xuan ;
Monga, Vishal ;
Bala, Raja ;
Fan, Zhigang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2014, 24 (04) :631-645
[7]   Not only Look, But Also Listen: Learning Multimodal Violence Detection Under Weak Supervision [J].
Wu, Peng ;
Liu, Jing ;
Shi, Yujia ;
Sun, Yujia ;
Shao, Fangtao ;
Wu, Zhaoyang ;
Yang, Zhiwei .
COMPUTER VISION - ECCV 2020, PT XXX, 2020, 12375 :322-339
[8]   Trajectory-Based Anomalous Event Detection [J].
Piciarelli, Claudio ;
Micheloni, Christian ;
Foresti, Gian Luca .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2008, 18 (11) :1544-1554
[9]   Real-world Anomaly Detection in Surveillance Videos [J].
Sultani, Waqas ;
Chen, Chen ;
Shah, Mubarak .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6479-6488
[10]   Weakly-supervised Video Anomaly Detection with Robust Temporal Feature Magnitude Learning [J].
Tian, Yu ;
Pang, Guansong ;
Chen, Yuanhong ;
Singh, Rajvinder ;
Verjans, Johan W. ;
Carneiro, Gustavo .
2021 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2021), 2021, :4955-4966