Robust hand gesture recognition using multiple shape-oriented visual cues

被引:0
|
作者
Samy Bakheet
Ayoub Al-Hamadi
机构
[1] Sohag University,Faculty of Computers and Information
[2] Otto-von-Guericke-University Magdeburg,Institute for Information Technology and Communications
来源
EURASIP Journal on Image and Video Processing | / 2021卷
关键词
Hand gesture recognition; Shape oriented features; Fourier descriptor; Moments invariants; SVM;
D O I
暂无
中图分类号
学科分类号
摘要
Robust vision-based hand pose estimation is highly sought but still remains a challenging task, due to its inherent difficulty partially caused by self-occlusion among hand fingers. In this paper, an innovative framework for real-time static hand gesture recognition is introduced, based on an optimized shape representation build from multiple shape cues. The framework incorporates a specific module for hand pose estimation based on depth map data, where the hand silhouette is first extracted from the extremely detailed and accurate depth map captured by a time-of-flight (ToF) depth sensor. A hybrid multi-modal descriptor that integrates multiple affine-invariant boundary-based and region-based features is created from the hand silhouette to obtain a reliable and representative description of individual gestures. Finally, an ensemble of one-vs.-all support vector machines (SVMs) is independently trained on each of these learned feature representations to perform gesture classification. When evaluated on a publicly available dataset incorporating a relatively large and diverse collection of egocentric hand gestures, the approach yields encouraging results that agree very favorably with those reported in the literature, while maintaining real-time operation.
引用
收藏
相关论文
共 50 条
  • [1] Robust hand gesture recognition using multiple shape-oriented visual cues
    Bakheet, Samy
    Al-Hamadi, Ayoub
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2021, 2021 (01)
  • [2] Hand Gesture Recognition using RGB-D Cues
    Lin, Lan
    Cong, Yang
    Tang, Yandong
    PROCEEDING OF THE IEEE INTERNATIONAL CONFERENCE ON INFORMATION AND AUTOMATION, 2012, : 311 - 316
  • [3] Hand Gesture Recognition Using Multiple Acoustic Measurements at Wrist
    Siddiqui, Nabeel
    Chan, Rosa H. M.
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2021, 51 (01) : 56 - 62
  • [4] A ROBUST GESTURE RECOGNITION USING HAND LOCAL DATA AND SKELETON TRAJECTORY
    Escobedo-Cardenas, E.
    Camara-Chavez, G.
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 1240 - 1244
  • [5] Visual Based Hand Gesture Recognition Systems
    Li, Linghua
    Du, Jifang
    INFORMATION TECHNOLOGY APPLICATIONS IN INDUSTRY, PTS 1-4, 2013, 263-266 : 2422 - 2425
  • [6] Integrating Color and Depth Cues for Static Hand Gesture Recognition
    Li, Jiaming
    Guo, Yulan
    Ma, Yanxin
    Lu, Min
    Zhang, Jun
    COMPUTER VISION, PT I, 2017, 771 : 295 - 306
  • [7] Robust Part-Based Hand Gesture Recognition Using Kinect Sensor
    Ren, Zhou
    Yuan, Junsong
    Meng, Jingjing
    Zhang, Zhengyou
    IEEE TRANSACTIONS ON MULTIMEDIA, 2013, 15 (05) : 1110 - 1120
  • [8] Hand Gesture Recognition using CVZONE
    Nguyen, Hao A.
    Tran, Thien T.
    Ho, Hien Q.
    Ngo, Toan D.
    Vu, Khanh N.
    Huynh, Viet L. T.
    PROCEEDINGS OF THE 2024 9TH INTERNATIONAL CONFERENCE ON INTELLIGENT INFORMATION TECHNOLOGY, ICIIT 2024, 2024, : 108 - 113
  • [9] Visual Hand Gesture Recognition with Convolution Neural Network
    Han, Mengmeng
    Chen, Jiajun
    Li, Ling
    Chang, Yuchun
    2016 17TH IEEE/ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING AND PARALLEL/DISTRIBUTED COMPUTING (SNPD), 2016, : 287 - 291
  • [10] Dynamic Hand Gesture Recognition Using the Skeleton of the Hand
    Bogdan Ionescu
    Didier Coquin
    Patrick Lambert
    Vasile Buzuloiu
    EURASIP Journal on Advances in Signal Processing, 2005