FOAD: a novel video anomaly detection focusing on objects

被引:0
作者
Li, Hongjun [1 ,2 ,3 ]
Chen, Jinyi [1 ]
Huang, Xiezhou [1 ]
Zhang, Yuxing [1 ]
Du, Yunlong [1 ]
Chen, Junjie [1 ,3 ]
机构
[1] Nantong Univ, Sch Informat Sci & Technol, 9 Seyuan Rd, Nantong 226019, Jiangsu, Peoples R China
[2] Nanjing Univ, State Key Lab Novel Software Technol, Nanjing 210023, Jiangsu, Peoples R China
[3] Nantong Res Inst Adv Commun Technol, Nantong 226019, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Video anomaly detection; Scene object; Autoencoder; Memory;
D O I
10.1007/s11042-023-16429-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the popularity of surveillance video, people's increased security awareness and demand for risk warning, video anomaly detection is gradually gaining widespread attention. Since the amount of data in the background is larger than that of the foreground object, the background information of video frames is more easily noticed by the model, while the abnormal behaviors that cannot be easily detected mostly occur in the foreground. At the same time, if the background information is processed separately from the foreground information, it will inevitably increase the complexity of the model. In this paper, we propose a novel video anomaly detection based on scene object. In the training phase, we put foreground objects on the canvas for training and the memory module remembers various normal patterns of the foreground objects, so that the model can be more sensitive to the anomalies in the foreground objects during detection. Our method is able to achieve AUC 74.01% and 30 FPS on ShanghaiTech dataset. At the same time, several advanced video anomaly detection algorithms are compared, which all demonstrate the superiority of our method.
引用
收藏
页码:20637 / 20651
页数:15
相关论文
共 29 条
[1]   A3N: Attention-based adversarial autoencoder network for detecting anomalies in video sequence [J].
Aslam, Nazia ;
Rai, Prateek Kumar ;
Kolekar, Maheshkumar H. .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2022, 87
[2]   A comparative study between single and multi-frame anomaly detection and localization in recorded video streams [J].
Bahrami, Maedeh ;
Pourahmadi, Majid ;
Vafaei, Abbas ;
Shayesteh, Mohammad Reza .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 79
[3]   Video anomaly detection with spatio-temporal dissociation [J].
Chang, Yunpeng ;
Tu, Zhigang ;
Xie, Wei ;
Luo, Bin ;
Zhang, Shifu ;
Sui, Haigang ;
Yuan, Junsong .
PATTERN RECOGNITION, 2022, 122
[4]   Clustering Driven Deep Autoencoder for Video Anomaly Detection [J].
Chang, Yunpeng ;
Tu, Zhigang ;
Xie, Wei ;
Yuan, Junsong .
COMPUTER VISION - ECCV 2020, PT XV, 2020, 12360 :329-345
[5]   MIST: Multiple Instance Self-Training Framework for Video Anomaly Detection [J].
Feng, Jia-Chang ;
Hong, Fa-Ting ;
Zheng, Wei-Shi .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :14004-14013
[6]  
github, 2020, ULTR YOLOV5
[7]   Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection [J].
Gong, Dong ;
Liu, Lingqiao ;
Le, Vuong ;
Saha, Budhaditya ;
Mansour, Moussa Reda ;
Venkatesh, Svetha ;
van den Hengel, Anton .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :1705-1714
[8]   Video Prediction Recalling Long-term Motion Context via Memory Alignment Learning [J].
Lee, Sangmin ;
Kim, Hak Gu ;
Choi, Dae Hwi ;
Kim, Hyung-Il ;
Ro, Yong Man .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :3053-3062
[9]   Decoupled appearance and motion learning for efficient anomaly detection in surveillance video [J].
Li, Bo ;
Leroux, Sam ;
Simoens, Pieter .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2021, 210
[10]   Towards a multi-layers anomaly detection framework for analyzing network traffic [J].
Li, Bo ;
Zhang, Simin ;
Li, Ke .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2017, 29 (14)