Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:32
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [41] OctoPocus: A Dynamic Guide for Learning Gesture-Based Command Sets
    Bau, Olivier
    Mackay, Wendy E.
    UIST 2008: PROCEEDINGS OF THE 21ST ANNUAL ACM SYMPOSIUM ON USER INTERFACE SOFTWARE AND TECHNOLOGY, 2008, : 37 - 46
  • [42] Dynamic gesture recognition based on gesture contour model of time series
    Pang, Hai-Bo
    Li, Zhan-Bo
    Ding, You-Dong
    Huanan Ligong Daxue Xuebao/Journal of South China University of Technology (Natural Science), 2015, 43 (01): : 140 - 146
  • [43] An Exosuit System With Bidirectional Hand Support for Bilateral Assistance Based on Dynamic Gesture Recognition
    Tang, Zhichuan
    Zhu, Zhihao
    Lv, Shengye
    Hong, Xuanyu
    Peng, Yuxin
    Chen, Nuo
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 3147 - 3156
  • [44] Glove-Based Hand Gesture Recognition for Diver Communication
    Antillon, Derek W. Orbaugh
    Walker, Christopher R.
    Rosset, Samuel
    Anderson, Iain A.
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (12) : 9874 - 9886
  • [45] Dynamic Hand Gesture Recognition Using Multi-Branch Attention Based Graph and General Deep Learning Model
    Miah, Abu Saleh Musa
    Hasan, Md Al Mehedi
    Shin, Jungpil
    IEEE ACCESS, 2023, 11 : 4703 - 4716
  • [46] Dynamic and Interactive Gesture Recognition Algorithm Based on Kinect
    Dai, Guangjun
    Yu, Lei
    Huang, Jun
    2017 29TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2017, : 3479 - 3484
  • [47] GloveSense: A Hand Gesture Recognition System Based on Inductive Sensing
    Byberi, Armanda
    Ravan, Maryam
    Amineh, Reza K.
    IEEE SENSORS JOURNAL, 2023, 23 (09) : 9210 - 9219
  • [48] Hand Gesture-Based On-Line Programming of Industrial Robot Manipulators
    Sylari, Antonios
    Ferrer, Borja Ramis
    Lastra, Jose L. Martinez
    2019 IEEE 17TH INTERNATIONAL CONFERENCE ON INDUSTRIAL INFORMATICS (INDIN), 2019, : 827 - 834
  • [49] Vision Based Traffic Personnel Hand Gesture Recognition Using Tree Based Classifiers
    Sathya, R.
    Geetha, M. Kalaiselvi
    COMPUTATIONAL INTELLIGENCE IN DATA MINING, VOL 2, 2015, 32 : 187 - 200
  • [50] Non-trajectory-based gesture recognition in human-computer interaction based on hand skeleton data
    Lesong Jia
    Xiaozhou Zhou
    Chengqi Xue
    Multimedia Tools and Applications, 2022, 81 : 20509 - 20539