Abnormal human activity detection by convolutional recurrent neural network using fuzzy logic

被引:5
作者
Kumar, Manoj [1 ,2 ]
Biswas, Mantosh [3 ]
机构
[1] JSS Acad Tech Educ, Noida, UP, India
[2] Natl Inst Technol, Kurukshetra, Haryana, India
[3] Natl Inst Technol, Dept Comp Engn, Kurukshetra, Haryana, India
关键词
Abnormal human activity; Fuzzy logic; Transfer learning; Deep learning; ACTION RECOGNITION; ANOMALY DETECTION; SURVEILLANCE; FRAMEWORK; FEATURES; BAG;
D O I
10.1007/s11042-023-15904-x
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In automated video surveillance applications, detecting abnormal human activity is incredibly difficult to classify them. The automatic detection of aberrant human activity in a surveillance system was resolved in our proposed work. The videos are first turned into frames, and keyframes from a batch of frames are extracted using fuzzy logic. Secondly, the features are retrieved from the keyframes using a pre-train convolutional neural network (CNN) through transfer learning. Finally, to recognize anomalous activity from video, the collected features are loaded into a Long-Short Term Memory (LSTM) based recurrent network. Two benchmark datasets were used to evaluate the proposed methodology: the UCF50 and the UCF-crime, with our model achieving 95.04% and 49.04% accuracy, respectively. Using the same data set, the experimental findings are compared to conventional detection approaches which suggest that our proposed model outperforms the other approaches that were compared.
引用
收藏
页码:61843 / 61859
页数:17
相关论文
共 48 条
[1]   Anomaly3D: Video anomaly detection based on 3D-normality clusters [J].
Asad, Mujtaba ;
Yang, Jie ;
Tu, Enmei ;
Chen, Liming ;
He, Xiangjian .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75
[2]   Structural Recurrent Neural Network (SRNN) for Group Activity Analysis [J].
Biswas, Sovan ;
Gall, Juergen .
2018 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2018), 2018, :1615-1622
[3]   Bag-of-Event-Models based embeddings for detecting anomalies in surveillance videos [J].
Chandrakala, S. ;
Deepak, K. ;
Vignesh, L. K. P. .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 190
[4]   Semantic Event Fusion of Different Visual Modality Concepts for Activity Recognition [J].
Crispim-Junior, Carlos F. ;
Buso, Vincent ;
Avgerinakis, Konstantinos ;
Meditskos, Georgios ;
Briassouli, Alexia ;
Benois-Pineau, Jenny ;
Kompatsiaris, Ioannis ;
Bremond, Francois .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (08) :1598-1611
[5]   Application of intelligent edge computing technology for video surveillance in human movement recognition and Taekwondo training [J].
Cui, Xiaocan ;
Hu, Ruizhe .
ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (04) :2899-2908
[6]   Learning Video Actions in Two Stream Recurrent Neural Network [J].
Hassan, Ehtesham .
PATTERN RECOGNITION LETTERS, 2021, 151 :200-208
[7]   Going deeper into action recognition: A survey [J].
Herath, Samitha ;
Harandi, Mehrtash ;
Porikli, Fatih .
IMAGE AND VISION COMPUTING, 2017, 60 :4-21
[8]   Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge [J].
Hinami, Ryota ;
Mei, Tao ;
Satoh, Shin'ichi .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3639-3647
[9]   Content-Attention Representation by Factorized Action-Scene Network for Action Recognition [J].
Hou, Jingyi ;
Wu, Xinxiao ;
Sun, Yuchao ;
Jia, Yunde .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (06) :1537-1547
[10]   Histograms of Optical Flow Orientation and Magnitude and Entropy to Detect Anomalous Events in Videos [J].
Hugo Mora Colque, Rensso Victor ;
Caetano, Carlos ;
Lustosa de Andrade, Matheus Toledo ;
Schwartz, William Robson .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2017, 27 (03) :673-682