Skeleton-Based Dynamic Hand Gesture Recognition Using a Part-Based GRU-RNN for Gesture-Based Interface

被引:32
|
作者
Shin, Seunghyeok [1 ]
Kim, Whoi-Yul [1 ]
机构
[1] Hanyang Univ, Dept Elect & Comp Engn, Seoul 04763, South Korea
关键词
Feature extraction; Gesture recognition; Joints; Neural networks; Hidden Markov models; Sensors; Artificial neural networks; gesture recognition; multi-layer neural network; recurrent neural networks; SEGMENTATION;
D O I
10.1109/ACCESS.2020.2980128
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent improvements in imaging sensors and computing units have led to the development of a range of image-based human-machine interfaces (HMIs). An important approach in this direction is the use of dynamic hand gestures for a gesture-based interface, and some methods have been developed to provide real-time hand skeleton generation from depth images for dynamic hand gesture recognition. Towards this end, we propose a skeleton-based dynamic hand gesture recognition method that divides geometric features into multiple parts and uses a gated recurrent unit-recurrent neural network (GRU-RNN) for each feature part. Because each divided feature part has fewer dimensions than an entire feature, the number of hidden units required for optimization is reduced. As a result, we achieved similar recognition performance as the latest methods with fewer parameters.
引用
收藏
页码:50236 / 50243
页数:8
相关论文
共 50 条
  • [21] RBF Models with Shallow and Deep Feature for Skeleton-based Human Gesture Recognition
    Dai-Hai Nguyen
    Quoc-Thang Pham
    Duc-Dung Nguyen
    2017 4TH NAFOSTED CONFERENCE ON INFORMATION AND COMPUTER SCIENCE (NICS), 2017, : 72 - 77
  • [22] TEMPORAL-SPATIAL DEFORMABLE POSE NETWORK FOR SKELETON-BASED GESTURE RECOGNITION
    Lin, Honghui
    Cheng, Jiale
    Li, Yu
    Zhang, Xin
    2021 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2021, : 2324 - 2328
  • [23] Trajectory based hand gesture recognition
    Popa, Daniel
    Simion, Georgiana
    Gui, Vasile
    Otesteanu, Marius
    CIMMACS '07: PROCEEDINGS OF THE 6TH WSEAS INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE, MAN-MACHINE SYSTEMS AND CYBERNETICS, 2007, : 115 - +
  • [24] Visual-based interface using hand gesture recognition and object tracking
    Chalechale, A.
    Safael, F.
    IRANIAN JOURNAL OF SCIENCE AND TECHNOLOGY TRANSACTION B-ENGINEERING, 2008, 32 (B3): : 279 - 293
  • [25] Gesture-based interaction and communication: Automated classification of hand gesture contours
    Gupta, L
    Ma, S
    IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART C-APPLICATIONS AND REVIEWS, 2001, 31 (01): : 114 - 120
  • [26] Spatio-Temporal Transformer with Kolmogorov-Arnold Network for Skeleton-Based Hand Gesture Recognition
    Han, Pengcheng
    He, Xin
    Matsumaru, Takafumi
    Dutta, Vibekananda
    SENSORS, 2025, 25 (03)
  • [27] Hand gesture recognition using subunit-based dynamic time warping
    Wang, Yanrung
    Shimada, Atsushi
    Yamashita, Takayoshi
    Taniguchi, Rin-ichiro
    PROCEEDINGS OF THE EIGHTEENTH INTERNATIONAL SYMPOSIUM ON ARTIFICIAL LIFE AND ROBOTICS (AROB 18TH '13), 2013, : 480 - 483
  • [28] Robust Dynamic Hand Gesture Recognition Based on Millimeter Wave Radar Using Atten-TsNN
    Jin, Biao
    Peng, Yu
    Kuang, Xiaofei
    Zhang, Zhenkai
    Lian, Zhuxian
    Wang, Biao
    IEEE SENSORS JOURNAL, 2022, 22 (11) : 10861 - 10869
  • [29] A general skeleton-based action and gesture recognition framework for human-robot collaboration
    Terreran, Matteo
    Barcellona, Leonardo
    Ghidoni, Stefano
    ROBOTICS AND AUTONOMOUS SYSTEMS, 2023, 170
  • [30] LSTM-based dynamic probability continuous hand gesture trajectory recognition
    Jian, Chengfeng
    Li, Junjie
    Zhang, Meiyu
    IET IMAGE PROCESSING, 2019, 13 (12) : 2314 - 2320