Deep BiLSTM Attention Model for Spatial and Temporal Anomaly Detection in Video Surveillance

被引:0
作者
Natha, Sarfaraz [1 ,2 ]
Ahmed, Fareed [1 ]
Siraj, Mohammad [3 ]
Lagari, Mehwish [1 ]
Altamimi, Majid [3 ]
Chandio, Asghar Ali [1 ]
机构
[1] Quaid E Awam Univ, Dept Informat Technol, Nawabshah 67450, Pakistan
[2] Sir Syed Univ Engn & Technol, Dept Software Engn, Karachi 75300, Pakistan
[3] King Saud Univ, Coll Engn, Dept Elect Engn, Riyadh 11543, Saudi Arabia
关键词
convolutional neural network; recurrent neural network; BiLSTM; multi-attention layer; anomaly detection;
D O I
10.3390/s25010251
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Detection of anomalies in video surveillance plays a key role in ensuring the safety and security of public spaces. The number of surveillance cameras is growing, making it harder to monitor them manually. So, automated systems are needed. This change increases the demand for automated systems that detect abnormal events or anomalies, such as road accidents, fighting, snatching, car fires, and explosions in real-time. These systems improve detection accuracy, minimize human error, and make security operations more efficient. In this study, we proposed the Composite Recurrent Bi-Attention (CRBA) model for detecting anomalies in surveillance videos. The CRBA model combines DenseNet201 for robust spatial feature extraction with BiLSTM networks that capture temporal dependencies across video frames. A multi-attention mechanism was also incorporated to direct the model's focus to critical spatiotemporal regions. This improves the system's ability to distinguish between normal and abnormal behaviors. By integrating these methodologies, the CRBA model improves the detection and classification of anomalies in surveillance videos, effectively addressing both spatial and temporal challenges. Experimental assessments demonstrate that the CRBA model achieves high accuracy on both the University of Central Florida (UCF) and the newly developed Road Anomaly Dataset (RAD). This model enhances detection accuracy while also improving resource efficiency and minimizing response times in critical situations. These advantages make it an invaluable tool for public safety and security operations, where rapid and accurate responses are needed for maintaining safety.
引用
收藏
页数:24
相关论文
共 61 条
  • [41] Cyber Threat Intelligence Sharing Scheme Based on Federated Learning for Network Intrusion Detection
    Sarhan, Mohanad
    Layeghy, Siamak
    Moustafa, Nour
    Portmann, Marius
    [J]. JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 2023, 31 (01)
  • [42] Video classification and retrieval through spatio-temporal Radon features
    Sasithradevi, A.
    Roomi, S. Mohamed Mansoor
    [J]. PATTERN RECOGNITION, 2020, 99
  • [43] Deep learning in neural networks: An overview
    Schmidhuber, Juergen
    [J]. NEURAL NETWORKS, 2015, 61 : 85 - 117
  • [44] Deep Spatio-Temporal Representation for Detection of Road Accidents Using Stacked Autoencoder
    Singh, Dinesh
    Mohan, Chalavadi Krishna
    [J]. IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2019, 20 (03) : 879 - 887
  • [45] Tamagusko T., 2022, Transp. Res. Procedia, V64, P90, DOI [DOI 10.1016/J.TRPRO.2022.09.012, 10.1016/j.trpro.2022.09.012]
  • [46] Weakly-supervised action localization based on seed superpixels
    Ullah, Sami
    Bhatti, Naeem
    Qasim, Tehreem
    Hassan, Najmul
    Zia, Muhammad
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (04) : 6203 - 6220
  • [47] An Efficient Anomaly Recognition Framework Using an Attention Residual LSTM in Surveillance Videos
    Ullah, Waseem
    Ullah, Amin
    Hussain, Tanveer
    Khan, Zulfiqar Ahmad
    Baik, Sung Wook
    [J]. SENSORS, 2021, 21 (08)
  • [48] Intelligent traffic video surveillance and accident detection system with dynamic traffic signal control
    Vishnu, V. C. Maha
    Rajalakshmi, M.
    Nedunchezhian, R.
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2018, 21 (01): : 135 - 147
  • [49] A CNN-RNN Combined Structure for Real-World Violence Detection in Surveillance Cameras
    Vosta, Soheil
    Yow, Kin-Choong
    [J]. APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [50] Abnormal event detection via covariance matrix for optical flow based feature
    Wang, Tian
    Qiao, Meina
    Zhu, Aichun
    Niu, Yida
    Li, Ce
    Snoussi, Hichem
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2018, 77 (13) : 17375 - 17395