Dynamic Gesture Recognition in the Internet of Things

被引:71
作者
Li, Gongfa [1 ,2 ]
Wu, Hao [1 ]
Jiang, Guozhang [3 ,4 ]
Xu, Shuang [1 ,4 ]
Liu, Honghai [5 ,6 ]
机构
[1] Wuhan Univ Sci & Technol, Minist Educ, Key Lab Met Equipment & Control Technol, Wuhan 430081, Hubei, Peoples R China
[2] Wuhan Univ Sci & Technol, Res Ctr Biol Manipulator & Intelligent Measuremen, Wuhan 430081, Hubei, Peoples R China
[3] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Hubei, Peoples R China
[4] Wuhan Univ Sci & Technol, 3D Printing & Intelligent Mfg Engn Inst, Wuhan 430081, Hubei, Peoples R China
[5] Univ Portsmouth, Sch Comp, Portsmouth PO1 3HE, Hants, England
[6] Shanghai Jiao Tong Univ, Sch Mech Engn, Key Lab Mech Syst & Vibrat, Shanghai 200240, Peoples R China
基金
中国国家自然科学基金;
关键词
Gesture recognition; hidden Markov model (HMM); D-S evidence theory; Internet of Things (IoT); HIDDEN MARKOV MODEL; SYSTEM; KINECT; PREDICTION; SENSOR; GLOVE; EMG;
D O I
10.1109/ACCESS.2018.2887223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Gesture recognition based on computer vision has gradually become a hot research direction in the field of human-computer interaction. The field of human-computer interaction is an important direction in the Internet of Things (IoTs) technology. Human-computer interaction through gestures is the direction of continuous research on IoTs technology. In recent years, the Kinect sensor-based gesture recognition method has been widely used in gesture recognition, because it can separate gestures from complex backgrounds and is less affected by illumination and can accurately track and locate gesture motions. At present, the Kinect sensor needs to be further improved on the recognition of complex gesture movements, especially the problem that the recognition rate of dynamic gestures is not high, which hinders the development of human-computer interaction under the IoTs technology. In this paper, based on the above problems, the Kinect-based gesture recognition is analyzed in detail, and a dynamic gesture recognition method based on HMM and D-S evidence theory is proposed. Based on the original HMM, the tangent angle and gesture change at different moments of the palm trajectory are used as the characteristics of the complex motion gesture, and the dimension of the trajectory tangent is reduced by the number of quantization codes. Then, the parameter model training of HMM is completed. Finally, combined with D-S evidence theory, combinatorial logic is judged, dynamic gesture recognition is carried out, and a better recognition effect is obtained, which lays a good foundation for human-computer interaction under the IoTs technology.
引用
收藏
页码:23713 / 23724
页数:12
相关论文
共 58 条
[1]  
[Anonymous], 2015, SENS LETT
[2]   A dynamic gesture recognition and prediction system using the convexity approach [J].
Barros, Pablo ;
Maciel-Junior, Nestor T. ;
Fernandes, Bruno J. T. ;
Bezerra, Byron L. D. ;
Fernandes, Sergio M. M. .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2017, 155 :139-149
[3]   Hidden Markov model for human to computer interaction: a study on human hand gesture recognition [J].
Bilal, Sara ;
Akmeliawati, Rini ;
Shafie, Amir A. ;
Salami, Momoh Jimoh E. .
ARTIFICIAL INTELLIGENCE REVIEW, 2013, 40 (04) :495-516
[4]   An Interactive Image Segmentation Method in Hand Gesture Recognition [J].
Chen, Disi ;
Li, Gongfa ;
Sun, Ying ;
Kong, Jianyi ;
Jiang, Guozhang ;
Tang, Heng ;
Ju, Zhaojie ;
Yu, Hui ;
Liu, Honghai .
SENSORS, 2017, 17 (02)
[5]   The Thermodynamic Properties of MgSiO3 Perovskite by Using a New Set Interaction Potential Parameters [J].
Chen, Qiong .
JOURNAL OF COMPUTATIONAL AND THEORETICAL NANOSCIENCE, 2015, 12 (07) :1263-1265
[6]   Jointly network: a network based on CNN and RBM for gesture recognition [J].
Cheng, Wentao ;
Sun, Ying ;
Li, Gongfa ;
Jiang, Guozhang ;
Liu, Honghai .
NEURAL COMPUTING & APPLICATIONS, 2019, 31 (Suppl 1) :309-323
[7]  
Ding W., 2015, J COMPUTATIONAL THEO, V12, P6096
[8]   D-S evidential theory on sEMG signal recognition [J].
Ding W. ;
Li G. ;
Sun Y. ;
Jiang G. ;
Kong J. ;
Liu H. .
International Journal of Computing Science and Mathematics, 2017, 8 (02) :138-145
[9]   Interface Prostheses With Classifier-Feedback-Based User Training [J].
Fang, Yinfeng ;
Zhou, Dalin ;
Li, Kairu ;
Liu, Honghai .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2017, 64 (11) :2575-2583
[10]   A Multichannel Surface EMG System for Hand Motion Recognition [J].
Fang, Yinfeng ;
Liu, Honghai ;
Li, Gongfa ;
Zhu, Xiangyang .
INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2015, 12 (02)