Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:32
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [1] CNN plus RNN Depth and Skeleton based Dynamic Hand Gesture Recognition
    Lai, Kenneth
    Yanushkevich, Svetlana N.
    2018 24TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION (ICPR), 2018, : 3451 - 3456
  • [2] Skeleton-Based Gesture Recognition With Learnable Paths and Signature Features
    Cheng, Jiale
    Shi, Dongzi
    Li, Chenyang
    Li, Yu
    Ni, Hao
    Jin, Lianwen
    Zhang, Xin
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 3951 - 3961
  • [3] SHREC 2021: Skeleton-based hand gesture recognition in the wild
    Caputo, Ariel
    Giachetti, Andrea
    Soso, Simone
    Pintani, Deborah
    D'Eusanio, Andrea
    Pini, Stefano
    Borghi, Guido
    Simoni, Alessandro
    Vezzani, Roberto
    Cucchiara, Rita
    Ranieri, Andrea
    Giannini, Franca
    Lupinetti, Katia
    Monti, Marina
    Maghoumi, Mehran
    LaViola Jr, J. Joseph
    Le, Minh-Quan
    Nguyen, Hai-Dang
    Tran, Minh-Triet
    COMPUTERS & GRAPHICS-UK, 2021, 99 : 201 - 211
  • [4] A lightweight GRU-based gesture recognition model for skeleton dynamic graphs
    Ni, Jianjun
    Wang, Yongchun
    Tang, Guangyi
    Cao, Weidong
    Yang, Simon X.
    MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (27) : 70545 - 70570
  • [5] Skeleton-Based Dynamic Hand Gesture Recognition Using an Enhanced Network with One-Shot Learning
    Ma, Chunyong
    Zhang, Shengsheng
    Wang, Anni
    Qi, Yongyang
    Chen, Ge
    APPLIED SCIENCES-BASEL, 2020, 10 (11):
  • [6] Temporal Decoupling Graph Convolutional Network for Skeleton-Based Gesture Recognition
    Liu, Jinfu
    Wang, Xinshun
    Wang, Can
    Gao, Yuan
    Liu, Mengyuan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 811 - 823
  • [7] DIFFERENTIAL PSEUDO-IMAGE FOR SKELETON-BASED DYNAMIC GESTURE RECOGNITION
    Kapuscinski, Tomasz
    Mis, Mateusz
    2022 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2022, : 4203 - 4207
  • [8] Spatial--Temporal Synchronous Transformer for Skeleton-Based Hand Gesture Recognition
    Zhao, Dongdong
    Li, Hongli
    Yan, Shi
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) : 1403 - 1412
  • [9] Gesture recognition matching based on dynamic skeleton
    Wang Jingyao
    Yu Naigong
    Firdaous, Essaf
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 1680 - 1685
  • [10] Skeleton-based Self-Supervised Feature Extraction for Improved Dynamic Hand Gesture Recognition
    Ikne, Omar
    Allaert, Benjamin
    Wannous, Hazem
    2024 IEEE 18TH INTERNATIONAL CONFERENCE ON AUTOMATIC FACE AND GESTURE RECOGNITION, FG 2024, 2024,