Novel error correction-based key frame extraction technique for dynamic hand gesture recognition

被引:0
|
作者
Snehal Bharti
Archana Balmik
Anup Nandy
机构
[1] National Institute of Technology,Department of Computer Science and Engineering
来源
Neural Computing and Applications | 2023年 / 35卷
关键词
Sign language; Hand gesture recognition; Key frame extraction; MINDS-Libras; DensePose; Three-dimensional CNN;
D O I
暂无
中图分类号
学科分类号
摘要
Before languages came into existence, sign language was the mode of communication. For human–computer interaction, recognizing these sign languages is vital; thus, hand gesture recognition comes into play. With the advancement of technology and its vast applications, hand gesture recognition has become a common field of research. Gesture recognition has gained a lot of popularity due to its application in sign language detection for speech and hearing-impaired people. This paper presents a methodology for hand gesture recognition using a 3D convolutional neural network. The dataset used for this purpose is MINDS-Libras, a Brazilian sign language dataset. We propose a novel error correction-based key frame extraction technique that selects significant key frames for video summarization. The chosen key frames are preprocessed through the steps of the region of interest selection, background removal, segmentation, binarization, and resizing. The frames are given as input to the proposed three-dimensional convolutional neural network for the classification of hand gestures, which offers an accuracy of 98% and performs better than state-of-the-art techniques.
引用
收藏
页码:21165 / 21180
页数:15
相关论文
共 50 条
  • [1] Novel error correction-based key frame extraction technique for dynamic hand gesture recognition
    Bharti, Snehal
    Balmik, Archana
    Nandy, Anup
    NEURAL COMPUTING & APPLICATIONS, 2023, 35 (28): : 21165 - 21180
  • [2] A dynamic gesture trajectory recognition based on key frame extraction and HMM
    Qiu-Yu, Zhang
    Lu, Lv
    Mo-Yi, Zhang
    Hong-Xiang, Duan
    Jun-Chi, Lu
    International Journal of Signal Processing, Image Processing and Pattern Recognition, 2015, 8 (06) : 91 - 106
  • [3] A Framework For Dynamic Hand Gesture Recognition Using Key Frames Extraction
    Pathak, Bhumika
    Jalal, Anand Singh
    Agrawal, Subhash Chand
    Bhatnagar, Charul
    2015 FIFTH NATIONAL CONFERENCE ON COMPUTER VISION, PATTERN RECOGNITION, IMAGE PROCESSING AND GRAPHICS (NCVPRIPG), 2015,
  • [4] SILK-SVM: An Effective Machine Learning Based Key-Frame Extraction Approach for Dynamic Hand Gesture Recognition
    Kaur, Arpneek
    Bansal, Sandhya
    ARABIAN JOURNAL FOR SCIENCE AND ENGINEERING, 2024,
  • [5] Hand Gesture Recognition Using Object Based Key Frame Selection
    Rokade, Ulka S.
    Doye, Dharmpal
    Kokare, Manesh
    ICDIP 2009: INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING, PROCEEDINGS, 2009, : 288 - +
  • [6] Adaptive Key Frame Extraction from RGB-D for Hand Gesture Recognition
    Jiang, Hanni
    Ma, Xing
    Li, Wenyang
    Ding, Shaohu
    Mu, Chunyang
    TENTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2018), 2018, 10806
  • [7] A frame-based model for hand gesture recognition
    Ko, IJ
    Choi, HI
    INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, PROCEEDINGS - VOL III, 1996, : 515 - 518
  • [8] Dynamic Hand Gesture Tracking Method Based on Key Frame and Video Perceptual Hashing
    Zhang, Qiuyu
    Wang, Qian
    Zhang, Moyi
    Duan, Hongxiang
    3RD ANNUAL INTERNATIONAL CONFERENCE ON INFORMATION SYSTEM AND ARTIFICIAL INTELLIGENCE (ISAI2018), 2018, 1069
  • [9] A novel approach to frame reduction in robust hand gesture recognition
    Balmik, Archana
    Sunanda, Anup
    Nandy, Anup
    PHYSICA SCRIPTA, 2025, 100 (02)
  • [10] Fast and robust dynamic hand gesture recognition via key frames extraction and feature fusion
    Tang, Hao
    Liu, Hong
    Xiao, Wei
    Sebe, Nicu
    NEUROCOMPUTING, 2019, 331 : 424 - 433