Normal Spatio-Temporal Information Enhance for Unsupervised Video Anomaly Detection

被引:0
|
作者
Wang, Jun [1 ]
Jia, Di [1 ]
Huang, Ziqing [1 ]
Zhang, Miaohui [1 ]
Ren, Xing [1 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Video anomaly detection; Spatio-temporal information; Gap expansion; Memory bank; EVENT DETECTION;
D O I
10.1007/s11063-023-11347-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video anomaly detection is the study of detecting low probability anomalies from high probability normal behaviour. The imbalance of data raises the need to effectively distinguish between normal and abnormal behaviour in foreground targets. In the current state of research, the focus of many researchers has been on predictions closer to acquisition, but this need to effectively distinguish between normal and abnormal has received little attention. To address this problem, we propose a spatio-temporal enhancement network, a prediction-based unsupervised learning approach to video anomaly detection. In order to capture similar properties between foreground targets, we design the correlation enhancement module, which aims to quantify the spatial information of normal foreground targets. The temporal information enhancement module is also designed to stabilise the temporal information of normal foreground targets to reduce the effect of background variation and improve the robustness of the network structure. To clarify the boundary between normal and abnormal targets, a poorer substitution is represents the abnormal target feature vector, a superior substitution is represents the normal target feature vector. In this way, to obtain a clear and accurate locus of the abnormal occurrence time. We have extensively test on the UCSD Ped1, UCSD Ped2, and Avenue datasets and obtained desirable average AUC metrics of 82.7, 97.6, and 89.6, respectively.
引用
收藏
页码:10727 / 10745
页数:19
相关论文
共 50 条
  • [41] Survey on visual rhythms: A spatio-temporal representation for video sequences
    Roberto e Souza, Marcos
    Maia, Helena de Almeida
    Vieira, Marcelo Bernardes
    Pedrini, Helio
    NEUROCOMPUTING, 2020, 402 : 409 - 422
  • [42] Unsupervised Conditional Diffusion Models in Video Anomaly Detection for Monitoring Dust Pollution
    Cai, Limin
    Li, Mofei
    Wang, Dianpeng
    SENSORS, 2024, 24 (05)
  • [43] Multi-Swin Transformer Based Spatio-Temporal Information Exploration for Compressed Video Quality Enhancement
    Yu, Li
    Wu, Shiyu
    Gabbouj, Moncef
    IEEE SIGNAL PROCESSING LETTERS, 2024, 31 : 1880 - 1884
  • [44] Video anomaly detection with both normal and anomaly memory modules
    Zhang, Liang
    Li, Shifeng
    Luo, Xi
    Liu, Xiaoru
    Zhang, Ruixuan
    VISUAL COMPUTER, 2024, : 3003 - 3015
  • [45] Robust Unsupervised Video Anomaly Detection by Multipath Frame Prediction
    Wang, Xuanzhao
    Che, Zhengping
    Jiang, Bo
    Xiao, Ning
    Yang, Ke
    Tang, Jian
    Ye, Jieping
    Wang, Jingyu
    Qi, Qi
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (06) : 2301 - 2312
  • [46] Memory-Token Transformer for Unsupervised Video Anomaly Detection
    Li, Youyu
    Song, Xiaoning
    Xu, Tianyang
    Feng, Zhenhua
    2022 26TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2022, : 3325 - 3332
  • [47] Learning Anomalies with Normality Prior for Unsupervised Video Anomaly Detection
    Shi, Haoyue
    Wang, Le
    Zhou, Sanping
    Hua, Gang
    Tang, Wei
    COMPUTER VISION - ECCV 2024, PT VI, 2025, 15064 : 163 - 180
  • [48] Anomaly Detection in Maritime Domain based on Spatio-Temporal Analysis of AIS Data Using Graph Neural Networks
    Eljabu, Lubna
    Etemad, Mohammad
    Matwin, Stan
    2021 5TH INTERNATIONAL CONFERENCE ON VISION, IMAGE AND SIGNAL PROCESSING (ICVISP 2021), 2021, : 142 - 147
  • [49] ESTI: an action recognition network with enhanced spatio-temporal information
    ZhiYu Jiang
    Yi Zhang
    Shu Hu
    International Journal of Machine Learning and Cybernetics, 2023, 14 : 3059 - 3070
  • [50] Learning Spatio-Temporal Information for Multi-Object Tracking
    Wei, Jian
    Yang, Mei
    Liu, Feng
    IEEE ACCESS, 2017, 5 : 3869 - 3877