Research on gesture recognition of smart data fusion features in the IoT

被引:77
作者
Tan, Chong [1 ]
Sun, Ying [1 ,2 ]
Li, Gongfa [1 ,2 ,4 ]
Jiang, Guozhang [2 ,3 ]
Chen, Disi [5 ]
Liu, Honghai [5 ]
机构
[1] Wuhan Univ Sci & Technol, Minist Educ, Key Lab Met Equipment & Control Technol, Wuhan 430081, Peoples R China
[2] Wuhan Univ Sci & Technol, Hubei Key Lab Mech Transmiss & Mfg Engn, Wuhan 430081, Peoples R China
[3] Wuhan Univ Sci & Technol, Res Ctr Biol Manipulator & Intelligent Measuremen, Wuhan 430081, Peoples R China
[4] Wuhan Univ Sci & Technol, Inst Precis Mfg, Wuhan 430081, Peoples R China
[5] Univ Portsmouth, Sch Comp, Portsmouth PO1 3HE, Hants, England
基金
中国国家自然科学基金;
关键词
Gesture recognition; Fusion features; Smart data aggregation; Hu moment; SVM; INTELLIGENT CONTROL; SIMULATION; DESIGN; ROBOTS; SPACE; HAND;
D O I
10.1007/s00521-019-04023-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the rapid development of Internet of things technology, the interaction between people and things has become increasingly frequent. Using simple gestures instead of complex operations to interact with the machine, the fusion of smart data feature information and so on has gradually become a research hotspot. Considering that the depth image of the Kinect sensor lacks color information and is susceptible to depth thresholds, this paper proposes a gesture segmentation method based on the fusion of color information and depth information; in order to ensure the complete information of the segmentation image, a gesture feature extraction method based on Hu invariant moment and HOG feature fusion is proposed; and by determining the optimal weight parameters, the global and local features are effectively fused. Finally, the SVM classifier is used to classify and identify gestures. The experimental results show that the proposed fusion features method has a higher gesture recognition rate and better robustness than the traditional method.
引用
收藏
页码:16917 / 16929
页数:13
相关论文
共 53 条
  • [1] Experimental comparison of color spaces for material classification
    Bello-Cerezo, Raquel
    Bianconi, Francesco
    Fernandez, Antonio
    Gonzalez, Elena
    Di Maria, Francesco
    [J]. JOURNAL OF ELECTRONIC IMAGING, 2016, 25 (06)
  • [2] Developing Non-Somatotopic Phantom Finger Sensation to Comparable Levels of Somatotopic Sensation through User Training With Electrotactile Stimulation
    Chai, Guohong
    Zhang, Dingguo
    Zhu, Xiangyang
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (05) : 469 - 480
  • [3] THERMAL MECHANICAL STRESS ANALYSIS OF LADLE LINING WITH INTEGRAL BRICK JOINT
    Chang, W.
    Li, G.
    Kong, J.
    Sun, Y.
    Jiang, G.
    Liu, H.
    [J]. ARCHIVES OF METALLURGY AND MATERIALS, 2018, 63 (02) : 659 - 666
  • [4] An Interactive Image Segmentation Method in Hand Gesture Recognition
    Chen, Disi
    Li, Gongfa
    Sun, Ying
    Kong, Jianyi
    Jiang, Guozhang
    Tang, Heng
    Ju, Zhaojie
    Yu, Hui
    Liu, Honghai
    [J]. SENSORS, 2017, 17 (02)
  • [5] Jointly network: a network based on CNN and RBM for gesture recognition
    Cheng, Wentao
    Sun, Ying
    Li, Gongfa
    Jiang, Guozhang
    Liu, Honghai
    [J]. NEURAL COMPUTING & APPLICATIONS, 2019, 31 (Suppl 1) : 309 - 323
  • [6] Class-Dependent Sparse Representation Classifier for Robust Hyperspectral Image Classification
    Cui, Minshan
    Prasad, Saurabh
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (05): : 2683 - 2695
  • [7] DYNAMIC RECURRENT NEURAL NETWORK BASED CLASSIFICATION SCHEME FOR MYOELECTRIC CONTROL OF UPPER LIMB REHABILITATION ROBOT
    Cui, Yuding
    Xiong, Caihua
    [J]. JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2014, 14 (06)
  • [8] Disi Chen, 2017, International Journal of Wireless and Mobile Computing, V12, P305
  • [9] Solving the Boundary Value Problem of an Under-Actuated Quadrotor with Subspace Stabilization Approach
    Dong, Wei
    Gu, Guo-Ying
    Zhu, Xiangyang
    Ding, Han
    [J]. JOURNAL OF INTELLIGENT & ROBOTIC SYSTEMS, 2015, 80 (02) : 299 - 311
  • [10] A Multichannel Surface EMG System for Hand Motion Recognition
    Fang, Yinfeng
    Liu, Honghai
    Li, Gongfa
    Zhu, Xiangyang
    [J]. INTERNATIONAL JOURNAL OF HUMANOID ROBOTICS, 2015, 12 (02)