Influence-Aware Attention Networks for Anomaly Detection in Surveillance Videos

被引:53
作者
Zhang, Sijia [1 ]
Gong, Maoguo [1 ]
Xie, Yu [1 ]
Qin, A. K. [2 ]
Li, Hao [1 ]
Gao, Yuan [1 ]
Ong, Yew-Soon [3 ]
机构
[1] Xidian Univ, Sch Elect Engn, Minist Educ, Key Lab Intelligent Percept & Image Understanding, Xian 710071, Peoples R China
[2] Swinburne Univ Technol, Dept Comp Sci & Software Engn, Hawthorn, Vic 3122, Australia
[3] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
澳大利亚研究理事会; 中国国家自然科学基金;
关键词
Videos; Anomaly detection; Feature extraction; Generators; Trajectory; Hidden Markov models; Surveillance; Influence-aware attention; GAN;
D O I
10.1109/TCSVT.2022.3148392
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Detecting anomalies in videos is a fundamental issue in public security. The majority of existing deep learning methods often perform anomaly detection based on the behavior or the trajectory of a single target. However, due to the overlaps of the crowd and the low-resolution of monitoring images, the segmentation of population is hard to implement and the features cannot be learned thoroughly, which make the methods be easily disturbed by visual elements and thus may lead to false detection sometimes. To tackle these problems, we propose the influence-aware attention to learn the representative attributes of the whole crowd. Walking pedestrians can be divided into numbers of flows, and in this paper, we aim to measure the consistency of movement patterns in the same stream and the interactions between different streams. Meanwhile, great importance is given to the relation between pedestrians and the circumstance for certain anomalies occur as a result of environmental issues. Specifically, the influence-aware attention module is composed of the motion attention and the location attention, which is designed to quantify the relations in the scene from spatial and temporal aspects. For the lack of abnormal samples, we utilize a dual generator-based framework to learn interactions among normal scenes. Experimental results on six benchmarks verify the effectiveness and robustness of our proposed method.
引用
收藏
页码:5427 / 5437
页数:11
相关论文
共 50 条
[31]   Fast sparse coding networks for anomaly detection in videos [J].
Wu, Peng ;
Liu, Jing ;
Li, Mingming ;
Sun, Yujia ;
Shen, Fang .
PATTERN RECOGNITION, 2020, 107
[32]   Anomaly Detection in Surveillance Videos by Future Appearance-motion Prediction [J].
Tuan-Hung Vu ;
Ambellouis, Sebastien ;
Boonaert, Jacques ;
Taleb-Ahmed, Abdelmalik .
PROCEEDINGS OF THE 15TH INTERNATIONAL JOINT CONFERENCE ON COMPUTER VISION, IMAGING AND COMPUTER GRAPHICS THEORY AND APPLICATIONS, VOL 5: VISAPP, 2020, :484-490
[33]   A Scalable and Generalised Deep Learning Framework for Anomaly Detection in Surveillance Videos [J].
Jebur, Sabah Abdulazeez ;
Alzubaidi, Laith ;
Saihood, Ahmed ;
Hussein, Khalid A. ;
Hoomod, Haider Kadhim ;
Gu, Yuantong .
INTERNATIONAL JOURNAL OF INTELLIGENT SYSTEMS, 2025, 2025 (01)
[34]   A data stream-based approach for anomaly detection in surveillance videos [J].
Aydogdu, Ozge ;
Ekinci, Murat .
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (21) :60213-60241
[35]   Application of Deep Learning for Crowd Anomaly Detection from Surveillance Videos [J].
Pawar, Karishma ;
Attar, Vahida .
2021 11TH INTERNATIONAL CONFERENCE ON CLOUD COMPUTING, DATA SCIENCE & ENGINEERING (CONFLUENCE 2021), 2021, :506-511
[36]   Generative Adversarial Networks for Abnormal Event Detection in Videos Based on Self-Attention Mechanism [J].
Zhang, Weichao ;
Wang, Guanjun ;
Huang, Mengxing ;
Wang, Hongyu ;
Wen, Shaoping .
IEEE ACCESS, 2021, 9 :124847-124860
[37]   GssMILP for anomaly classification in surveillance videos [J].
Krishna, N. Satya ;
Bhattu, S. Nagesh ;
Somayajulu, D. V. L. N. ;
Kumar, N. V. Narendra ;
Reddy, K. Jaya Shankar .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 203
[38]   Attention-Driven Loss for Anomaly Detection in Video Surveillance [J].
Zhou, Joey Tianyi ;
Zhang, Le ;
Fang, Zhiwen ;
Du, Jiawei ;
Peng, Xi ;
Xiao, Yang .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (12) :4639-4647
[39]   Multi-Encoder Towards Effective Anomaly Detection in Videos [J].
Fang, Zhiwen ;
Zhou, Joey Tianyi ;
Xiao, Yang ;
Li, Yanan ;
Yang, Feng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :4106-4116
[40]   Weakly Supervised Anomaly Detection in Videos Considering the Openness of Events [J].
Zhang, Chen ;
Li, Guorong ;
Xu, Qianqian ;
Zhang, Xinfeng ;
Su, Li ;
Huang, Qingming .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :21687-21699