Optimized deep learning-based cricket activity focused network and medium scale benchmark

被引:14
作者
Ahmad, Waqas [1 ,2 ]
Munsif, Muhammad [1 ]
Ullah, Habib [3 ]
Ullah, Mohib [2 ]
Alsuwailem, Alhanouf Abdulrahman [4 ]
Saudagar, Abdul Khader Jilani [4 ]
Muhammad, Khan [5 ]
Sajjad, Muhammad [1 ,2 ]
机构
[1] Islamia Coll Peshawar, Dept Comp Sci, Peshawar 25000, Pakistan
[2] Norwegian Univ Sci & Technol, Dept Comp Sci, N-2815 Gjovik, Norway
[3] Norwegian Univ Life Sci, Fac Sci & Technol, Gjovik, Norway
[4] Imam Mohammad Ibn Saud Islamic Univ IMSIU, Coll Comp & Informat Sci, Informat Syst Dept, Riyadh 11432, Saudi Arabia
[5] Sungkyunkwan Univ, Coll Comp & Informat, Sch Convergence, Dept Appl Artificial Intelligence,VIS2KNOW Lab, Seoul 03063, South Korea
关键词
Activity recognition; Cricket sports activities; Convolutional neural net-work; Sequence learning; Spatiotemporal network; ACTION RECOGNITION; FUSION;
D O I
10.1016/j.aej.2023.04.062
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
The recognition of different activities in sports has gained attention in recent years for its applications in various athletic events, including soccer and cricket. Cricket, in particular, presents a challenging task for automatic activity recognition methods due to its closely overlapped activities such as cover drive, and pull short, to name a few. Existing methods often rely on hand-crafted features as the limited availability of public data has restricted the scope of research to only the significant categories of cricket activities. To this end, we proposed a cricket activities dataset and an intuitive end-to-end deep learning model for cricket activity recognition. The data is collected from online sources and pre-processed through cleaning, resizing, and organizing. Similarly, an intuitive deep model is designed with a combination of time-distributed 2D CNN layers and LSTM cells for extracting and learning the spatiotemporal information from the input sequences. For benchmarking, we evaluated the model on our cricket datasets and four standard datasets namely UCF101, HMDB51, YouTube action, and Kinetics. The quantitative results show that the proposed model outperforms different variants of recurrent neural networks and achieved an accuracy of 92%, recall of 91%, and F1 score of 91%. Our code and dataset is publicly available for further research on https://drive.google.com/file/d/1c9qcAz4q00qvx4yFA3pSudWFczm1cWUL/view?usp=sharing. & COPY; 2023 THE AUTHORS. Published by Elsevier BV on behalf of Faculty of Engineering, Alexandria licenses/by-nc-nd/4.0/).
引用
收藏
页码:771 / 779
页数:9
相关论文
共 36 条
[1]  
Arora U., 2017, PEERJ PREPRINTS, V5
[2]  
Chowdhury A.E., 2016 3 INT C EL ENG, P1
[3]   Application of intelligent edge computing technology for video surveillance in human movement recognition and Taekwondo training [J].
Cui, Xiaocan ;
Hu, Ruizhe .
ALEXANDRIA ENGINEERING JOURNAL, 2022, 61 (04) :2899-2908
[4]   Human action recognition using two-stream attention based LSTM networks [J].
Dai, Cheng ;
Liu, Xingang ;
Lai, Jinfeng .
APPLIED SOFT COMPUTING, 2020, 86
[5]   Convolutional Two-Stream Network Fusion for Video Action Recognition [J].
Feichtenhofer, Christoph ;
Pinz, Axel ;
Zisserman, Andrew .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1933-1941
[6]   Two Stream LSTM : A Deep Fusion Framework for Human Action Recognition [J].
Gammulle, Harshala ;
Denman, Simon ;
Sridharan, Sridha ;
Fookes, Clinton .
2017 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2017), 2017, :177-186
[7]   A survey on deep learning techniques for image and video semantic segmentation [J].
Garcia-Garcia, Alberto ;
Orts-Escolano, Sergio ;
Oprea, Sergiu ;
Villena-Martinez, Victor ;
Martinez-Gonzalez, Pablo ;
Garcia-Rodriguez, Jose .
APPLIED SOFT COMPUTING, 2018, 70 :41-65
[8]   Hybrid deep neural network model for human action recognition [J].
Ijjina, Earnest Paul ;
Mohan, Chalavadi Krishna .
APPLIED SOFT COMPUTING, 2016, 46 :936-952
[9]  
Karmaker D, 2015, 2015 SECOND INTERNATIONAL CONFERENCE ON COMPUTING TECHNOLOGY AND INFORMATION MANAGEMENT (ICCTIM), P125, DOI 10.1109/ICCTIM.2015.7224605
[10]   Automated Wheat Diseases Classification Framework Using Advanced Machine Learning Technique [J].
Khan, Habib ;
Ul Haq, Ijaz ;
Munsif, Muhammad ;
Mustaqeem ;
Khan, Shafi Ullah ;
Lee, Mi Young .
AGRICULTURE-BASEL, 2022, 12 (08)