RETRACTED: Dynamic Gesture Recognition Algorithm Based on 3D Convolutional Neural Network (Retracted Article)

被引:60
作者
Liu, Yuting [1 ,2 ]
Jiang, Du [1 ,2 ]
Duan, Haojie [2 ,3 ]
Sun, Ying [1 ,2 ,3 ]
Li, Gongfa [1 ,2 ,3 ]
Tao, Bo [1 ,2 ]
Yun, Juntong [2 ,3 ]
Liu, Ying [1 ,3 ]
Chen, Baojia [4 ]
机构
[1] Wuhan Univ Sci & Technol, Key Lab Met Equipment & Control Technol, Minist Educ, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Res Ctr Biomimet Robot & Intelligent Measurement, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] China Three Gorges Univ, Hubei Key Lab Hydroelect Machinery Design & Maint, Yichang 443002, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanisms - Gesture recognition algorithm - Key frame extraction technologies - Network optimization - Real time performance - Recognition accuracy - Recognition efficiency - Temporal and spatial;
D O I
10.1155/2021/4828102
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Gesture recognition is one of the important ways of human-computer interaction, which is mainly detected by visual technology. The temporal and spatial features are extracted by convolution of the video containing gesture. However, compared with the convolution calculation of a single image, multiframe image of dynamic gestures has more computation, more complex feature extraction, and more network parameters, which affects the recognition efficiency and real-time performance of the model. To solve above problems, a dynamic gesture recognition model based on CBAM-C3D is proposed. Key frame extraction technology, multimodal joint training, and network optimization with BN layer are used for making the network performance better. The experiments show that the recognition accuracy of the proposed 3D convolutional neural network combined with attention mechanism reaches 72.4% on EgoGesture dataset, which is improved greatly compared with the current main dynamic gesture recognition methods, and the effectiveness of the proposed algorithm is verified.
引用
收藏
页数:12
相关论文
共 45 条
[11]   Two-Phase Multidocument Summarization Through Content-Attention-Based Subtopic Detection [J].
Dong, Luobing ;
Satpute, Meghana N. ;
Wu, Weili ;
Du, Ding-Zhu .
IEEE TRANSACTIONS ON COMPUTATIONAL SOCIAL SYSTEMS, 2021, 8 (06) :1379-1392
[12]   Learning Spatiotemporal Features with 3D Convolutional Networks [J].
Du Tran ;
Bourdev, Lubomir ;
Fergus, Rob ;
Torresani, Lorenzo ;
Paluri, Manohar .
2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :4489-4497
[13]   Gesture recognition based on multi-modal feature weight [J].
Duan, Haojie ;
Sun, Ying ;
Cheng, Wentao ;
Jiang, Du ;
Yun, Juntong ;
Liu, Ying ;
Liu, Yibo ;
Zhou, Dalin .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (05)
[14]   Convolutional Two-Stream Network Fusion for Video Action Recognition [J].
Feichtenhofer, Christoph ;
Pinz, Axel ;
Zisserman, Andrew .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1933-1941
[15]   A Continuous Hand Gestures Recognition Technique for Human-Machine Interaction Using Accelerometer and Gyroscope Sensors [J].
Gupta, Hari Prabhat ;
Chudgar, Haresh S. ;
Mukherjee, Siddhartha ;
Dutta, Tanima ;
Sharma, Kulwant .
IEEE SENSORS JOURNAL, 2016, 16 (16) :6425-6432
[16]   Struck: Structured Output Tracking with Kernels [J].
Hare, Sam ;
Golodetz, Stuart ;
Saffari, Amir ;
Vineet, Vibhav ;
Cheng, Ming-Ming ;
Hicks, Stephen L. ;
Torr, Philip H. S. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2016, 38 (10) :2096-2109
[17]   Gesture recognition based on an improved local sparse representation classification algorithm [J].
He, Yang ;
Li, Gongfa ;
Liao, Yajie ;
Sun, Ying ;
Kong, Jianyi ;
Jiang, Guozhang ;
Jiang, Du ;
Tao, Bo ;
Xu, Shuang ;
Liu, Honghai .
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 5) :10935-10946
[18]   Human action recognition based on HOIRM feature fusion and AP clustering BOW [J].
Huan, Ruo-Hong ;
Xie, Chao-Jie ;
Guo, Feng ;
Chi, Kai-Kai ;
Mao, Ke-Ji ;
Li, Ying-Long ;
Pan, Yun .
PLOS ONE, 2019, 14 (07)
[19]   Manipulator grabbing position detection with information fusion of color image and depth image using deep learning [J].
Jiang, Du ;
Li, Gongfa ;
Sun, Ying ;
Hu, Jiabing ;
Yun, Juntong ;
Liu, Ying .
JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (12) :10809-10822
[20]   Semantic segmentation for multiscale target based on object recognition using the improved Faster-RCNN model [J].
Jiang, Du ;
Li, Gongfa ;
Tan, Chong ;
Huang, Li ;
Sun, Ying ;
Kong, Jianyi .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2021, 123 :94-104