Normal Spatio-Temporal Information Enhance for Unsupervised Video Anomaly Detection

被引:0
|
作者
Wang, Jun [1 ]
Jia, Di [1 ]
Huang, Ziqing [1 ]
Zhang, Miaohui [1 ]
Ren, Xing [1 ]
机构
[1] Henan Univ, Sch Artificial Intelligence, Zhengzhou 450046, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Video anomaly detection; Spatio-temporal information; Gap expansion; Memory bank; EVENT DETECTION;
D O I
10.1007/s11063-023-11347-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Video anomaly detection is the study of detecting low probability anomalies from high probability normal behaviour. The imbalance of data raises the need to effectively distinguish between normal and abnormal behaviour in foreground targets. In the current state of research, the focus of many researchers has been on predictions closer to acquisition, but this need to effectively distinguish between normal and abnormal has received little attention. To address this problem, we propose a spatio-temporal enhancement network, a prediction-based unsupervised learning approach to video anomaly detection. In order to capture similar properties between foreground targets, we design the correlation enhancement module, which aims to quantify the spatial information of normal foreground targets. The temporal information enhancement module is also designed to stabilise the temporal information of normal foreground targets to reduce the effect of background variation and improve the robustness of the network structure. To clarify the boundary between normal and abnormal targets, a poorer substitution is represents the abnormal target feature vector, a superior substitution is represents the normal target feature vector. In this way, to obtain a clear and accurate locus of the abnormal occurrence time. We have extensively test on the UCSD Ped1, UCSD Ped2, and Avenue datasets and obtained desirable average AUC metrics of 82.7, 97.6, and 89.6, respectively.
引用
收藏
页码:10727 / 10745
页数:19
相关论文
共 50 条
  • [21] LEARNING SPATIO-TEMPORAL RELATIONS WITH MULTI-SCALE INTEGRATED PERCEPTION FOR VIDEO ANOMALY DETECTION
    Ye, Hongyu
    Xu, Ke
    Jiang, Xinghao
    Sun, Tanfeng
    2024 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, ICASSP 2024, 2024, : 4020 - 4024
  • [22] Video anomaly detection based on multi-scale optical flow spatio-temporal enhancement and normality mining
    He, Qiang
    Shi, Ruinian
    Chen, Linlin
    Huo, Lianzhi
    INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2025, 16 (03) : 1873 - 1888
  • [23] Dual-Scale Temporal Dependency Learning for Unsupervised Video Anomaly Detection
    Li, Xu
    Wang, Xue
    Du, Zexing
    Wang, Qing
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2024, PT X, 2025, 15040 : 284 - 298
  • [24] State-of-the-art on spatio-temporal information-based video retrieval
    Ren, W.
    Singh, S.
    Singh, M.
    Zhu, Y. S.
    PATTERN RECOGNITION, 2009, 42 (02) : 267 - 282
  • [25] A New Unsupervised Video Anomaly Detection Using Multi-Scale Feature Memorization and Multipath Temporal Information Prediction
    Taghinezhad, Neda
    Yazdi, Mehran
    IEEE ACCESS, 2023, 11 : 9295 - 9310
  • [26] Video anomaly detection based on cross-frame prediction mechanism and spatio-temporal memory-enhanced pseudo-3D encoder
    Wen, Xiaopeng
    Lai, Huicheng
    Gao, Guxue
    Xiao, Yang
    Wang, Tongguan
    Jia, Zhenhong
    Wang, Liejun
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [27] Vehicle detection and classification with spatio-temporal information obtained from CNN
    Satyanarayana, G. S. R.
    Deshmukh, Prashant
    Das, Santos Kumar
    DISPLAYS, 2022, 75
  • [28] A new spatio-temporal method for event detection and personalized retrieval of sports video
    Minh-Son Dao
    Noboru Babaguchi
    Multimedia Tools and Applications, 2010, 50 : 227 - 248
  • [29] A new spatio-temporal method for event detection and personalized retrieval of sports video
    Dao, Minh-Son
    Babaguchi, Noboru
    MULTIMEDIA TOOLS AND APPLICATIONS, 2010, 50 (01) : 227 - 248
  • [30] Video Anomaly Detection Based on Optical Flow Feature Enhanced Spatio-Temporal Feature Network FusionNet-LSTM-G
    Song, Jun-Fang
    Zhao, Hai-Li
    Wen, Duo-Yang
    Xu, Xiao-Yu
    IEEE ACCESS, 2022, 10 : 130314 - 130325