Suspicious Human Activity Recognition From Surveillance Videos Using Deep Learning

被引:0
作者
Mohamed Zaidi, Monji [1 ,2 ]
Avelino Sampedro, Gabriel [3 ]
Almadhor, Ahmad [4 ]
Alsubai, Shtwai [5 ]
Al Hejaili, Abdullah [6 ]
Gregus, Michal [7 ]
Abbas, Sidra [8 ]
机构
[1] King Khalid Univ, Coll Engn, Dept Elect Engn, Abha 61421, Saudi Arabia
[2] King Khalid Univ, Ctr Engn & Technol Innovat, Abha 61421, Saudi Arabia
[3] De La Salle Coll St Benilde, Sch Management & Informat Technol, Manila 1004, Philippines
[4] Jouf Univ, Coll Comp & Informat Sci, Dept Comp Engn & Networks, Sakaka 72388, Saudi Arabia
[5] Prince Sattam Bin Abdulaziz Univ, Coll Comp Engn & Sci, Al Kharj 16273, Saudi Arabia
[6] Univ Tabuk, Fac Comp & Informat Technol, Comp Sci Dept, Tabuk 71491, Saudi Arabia
[7] Univ Comenius Bratislava, Fac Management, Bratislava 82005, Slovakia
[8] COMSATS Univ Islamabad, Dept Comp Sci, Islamabad 45550, Pakistan
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Videos; Convolutional neural networks; Surveillance; Accuracy; Security; Deep learning; Data models; Human activity recognition; Multimedia communication; Suspicious human activity recognition (SHAR); deep learning; convolutional neural network; multimedia data;
D O I
10.1109/ACCESS.2024.3436653
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Suspicious Human activity recognition (SHAR) is crucial for improving surveillance and security systems by recognizing and reducing possible hazards in different situations. This study focuses on the task of precisely identifying potentially suspicious human behaviour by utilizing an innovative approach that harnesses advanced deep learning methods. Despite the abundance of research on the subject of SHAR, current methods frequently need to be revised with restricted levels of precision and efficiency. This research aims to address these constraints by presenting a thorough methodology for detecting and recognizing suspicious human activities. By rigorously collecting and preparing data, as well as training models, we aim to solve the issue of inaccurate and inefficient activity recognition in surveillance systems. By utilizing Convolutional Neural Networks (CNNs) and deep learning structures, such as the proposed time-distributed CNN model and Conv3D model, we attain notably enhanced accuracy rates of 90.14% and 88.23%, respectively, surpassing current research approaches. Moreover, the efficacy of our approach is illustrated by conducting prediction experiments on previously unreported test data and YouTube videos. Through the process of evaluating the trained models on unseen test data, we ascertain their accuracy and ability to apply learned knowledge to new situations. Moreover, the algorithms are utilized to predict dubious human conduct in a YouTube video, demonstrating their practical usefulness in real-life surveillance situations. The results of this study have important consequences for improving surveillance and security systems, allowing for better identification and reduction of possible dangers in various settings. Our methodology enhances the precision and effectiveness of SHAR, advancing the construction of more resilient and dependable surveillance systems and ultimately strengthening public safety and security.
引用
收藏
页码:105497 / 105510
页数:14
相关论文
共 21 条
[1]  
Amrutha C. V., 2020, 2020 2nd International Conference on Innovative Mechanisms for Industry Applications (ICIMIA). Proceedings, P335, DOI 10.1109/ICIMIA48430.2020.9074920
[2]  
Anishchenko Lesya, 2018, 2018 Ural Symposium on Biomedical Engineering, Radioelectronics and Information Technology (USBEREIT). Proceedings, P99, DOI 10.1109/USBEREIT.2018.8384560
[3]   Anomalous Situations Recognition in Surveillance Images Using Deep Learning [J].
Arshad, Qurat-ul-Ain ;
Raza, Mudassar ;
Khan, Wazir Zada ;
Siddiqa, Ayesha ;
Muiz, Abdul ;
Khan, Muhammad Attique ;
Tariq, Usman ;
Kim, Taerang ;
Cha, Jae-Hyuk .
CMC-COMPUTERS MATERIALS & CONTINUA, 2023, 76 (01) :1103-1125
[4]  
Butt UM, 2020, INT J ADV COMPUT SC, V11, P674
[5]   Convolutional Two-Stream Network Fusion for Video Action Recognition [J].
Feichtenhofer, Christoph ;
Pinz, Axel ;
Zisserman, Andrew .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1933-1941
[6]   ConvGRU-CNN: Spatiotemporal Deep Learning for Real-World Anomaly Detection in Video Surveillance System [J].
Gandapur, Maryam Qasim ;
Verdu, Elena .
INTERNATIONAL JOURNAL OF INTERACTIVE MULTIMEDIA AND ARTIFICIAL INTELLIGENCE, 2023, 8 (04) :88-95
[7]   Human activity recognition using 2D skeleton data and supervised machine learning [J].
Ghazal, Sumaira ;
Khan, Umar S. ;
Saleem, Muhammad Mubasher ;
Rashid, Nasir ;
Iqbal, Javaid .
IET IMAGE PROCESSING, 2019, 13 (13) :2572-2578
[8]   Patient Monitoring by Abnormal Human Activity Recognition Based on CNN Architecture [J].
Gul, Malik Ali ;
Yousaf, Muhammad Haroon ;
Nawaz, Shah ;
Ur Rehman, Zaka ;
Kim, HyungWon .
ELECTRONICS, 2020, 9 (12) :1-14
[9]   Skeleton-based human activity recognition for elderly monitoring systems [J].
Hbali, Youssef ;
Hbali, Sara ;
Ballihi, Lahoucine ;
Sadgal, Mohammed .
IET COMPUTER VISION, 2018, 12 (01) :16-26
[10]   Large-scale Video Classification with Convolutional Neural Networks [J].
Karpathy, Andrej ;
Toderici, George ;
Shetty, Sanketh ;
Leung, Thomas ;
Sukthankar, Rahul ;
Fei-Fei, Li .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :1725-1732