RETRACTED: Dynamic Gesture Recognition Algorithm Based on 3D Convolutional Neural Network (Retracted Article)

被引:60
作者
Liu, Yuting [1 ,2 ]
Jiang, Du [1 ,2 ]
Duan, Haojie [2 ,3 ]
Sun, Ying [1 ,2 ,3 ]
Li, Gongfa [1 ,2 ,3 ]
Tao, Bo [1 ,2 ]
Yun, Juntong [2 ,3 ]
Liu, Ying [1 ,3 ]
Chen, Baojia [4 ]
机构
[1] Wuhan Univ Sci & Technol, Key Lab Met Equipment & Control Technol, Minist Educ, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Res Ctr Biomimet Robot & Intelligent Measurement, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[4] China Three Gorges Univ, Hubei Key Lab Hydroelect Machinery Design & Maint, Yichang 443002, Peoples R China
基金
中国国家自然科学基金;
关键词
Attention mechanisms - Gesture recognition algorithm - Key frame extraction technologies - Network optimization - Real time performance - Recognition accuracy - Recognition efficiency - Temporal and spatial;
D O I
10.1155/2021/4828102
中图分类号
Q [生物科学];
学科分类号
07 ; 0710 ; 09 ;
摘要
Gesture recognition is one of the important ways of human-computer interaction, which is mainly detected by visual technology. The temporal and spatial features are extracted by convolution of the video containing gesture. However, compared with the convolution calculation of a single image, multiframe image of dynamic gestures has more computation, more complex feature extraction, and more network parameters, which affects the recognition efficiency and real-time performance of the model. To solve above problems, a dynamic gesture recognition model based on CBAM-C3D is proposed. Key frame extraction technology, multimodal joint training, and network optimization with BN layer are used for making the network performance better. The experiments show that the recognition accuracy of the proposed 3D convolutional neural network combined with attention mechanism reaches 72.4% on EgoGesture dataset, which is improved greatly compared with the current main dynamic gesture recognition methods, and the effectiveness of the proposed algorithm is verified.
引用
收藏
页数:12
相关论文
共 45 条
[1]   Tiny Hand Gesture Recognition without Localization via a Deep Convolutional Network [J].
Bao, Peijun ;
Maqueda, Ana I. ;
del-Blanco, Carlos R. ;
Garcia, Narciso .
IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2017, 63 (03) :251-257
[2]  
Bhaskaran K., 2016, 2016 International Conference on Robotics and Automation for Humanitarian Applications (RAHA), P1
[3]   Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset [J].
Carreira, Joao ;
Zisserman, Andrew .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4724-4733
[4]   Review of constraints on vision-based gesture recognition for human-computer interaction [J].
Chakraborty, Biplab Ketan ;
Sarma, Debajit ;
Bhuyan, M. K. ;
MacDorman, Karl F. .
IET COMPUTER VISION, 2018, 12 (01) :3-15
[5]  
Chen D., 2019, PERS UBIQUIT COMPUT
[6]   Analysis of Social Effects on Employment Promotion Policies for College Graduates Based on Data Mining for Online Use Review in China during the COVID-19 Pandemic [J].
Chen, Tinggui ;
Rong, Jingtao ;
Peng, Lijuan ;
Yang, Jianjun ;
Cong, Guodong ;
Fang, Jing .
HEALTHCARE, 2021, 9 (07)
[7]   Monitoring and Recognizing Enterprise Public Opinion from High-Risk Users Based on User Portrait and Random Forest Algorithm [J].
Chen, Tinggui ;
Yin, Xiaohua ;
Peng, Lijuan ;
Rong, Jingtao ;
Yang, Jianjun ;
Cong, Guodong .
AXIOMS, 2021, 10 (02)
[8]   Analysis of User Needs on Downloading Behavior of English Vocabulary APPs Based on Data Mining for Online Comments [J].
Chen, Tinggui ;
Peng, Lijuan ;
Yang, Jianjun ;
Cong, Guodong .
MATHEMATICS, 2021, 9 (12)
[9]   Gesture recognition based on surface electromyography-featureimage [J].
Cheng, Yangwei ;
Li, Gongfa ;
Yu, Mingchao ;
Jiang, Du ;
Yun, Juntong ;
Liu, Ying ;
Liu, Yibo ;
Chen, Disi .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2021, 33 (06)
[10]   SLAM based on Adaptive SVSF for Cooperative Unmanned Vehicles in Dynamic environment [J].
Demim, Fethi ;
Nemra, Abdelkrim ;
Boucheloukh, Abdelghani ;
Kobzili, Elhaouari ;
Hamerlain, Mustapha ;
Bazoula, Abdelouahab .
IFAC PAPERSONLINE, 2019, 52 (08) :73-80