A simple and effective static gesture recognition method based on attention mechanism

被引:7
|
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] HandFormer: A Dynamic Hand Gesture Recognition Method Based on Attention Mechanism
    Zhang, Yun
    Wang, Fengping
    APPLIED SCIENCES-BASEL, 2023, 13 (07):
  • [2] A Gesture Recognition Method Based on MIC-Attention- LSTM
    Hu, Ming-Jia
    Gong, Yu-Lin
    Chen, Xiao-Juan
    Han, Bo
    HUMAN-CENTRIC COMPUTING AND INFORMATION SCIENCES, 2023, 13
  • [3] A classroom facial expression recognition method based on attention mechanism
    Jin, Huilong
    Du, Ruiyan
    Wen, Tian
    Zhao, Jia
    Shi, Lei
    Zhang, Shuang
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2023, 45 (06) : 11873 - 11882
  • [4] Yolov5-Based Attention Mechanism for Gesture Recognition in Complex Environment
    Khare, Deepak Kumar
    Bhagat, Amit
    Priya, R. Vishnu
    Nag, Prashant Kumar
    Malviya, Sunil
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (11) : 699 - 711
  • [5] Deep Learning with Attention on Hand Gesture Recognition Based on sEMG
    Zhao, Huanjun
    Zheng, Bin
    Wang, Le
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 316 - 320
  • [6] Effective Attention-Based Mechanism for Masked Face Recognition
    Pann, Vandet
    Lee, Hyo Jong
    APPLIED SCIENCES-BASEL, 2022, 12 (11):
  • [7] A Speaker Recognition Method Based on Dynamic Convolution with Dual Attention Mechanism
    Luo, Yuan
    Zhu, Kuilin
    Wang, Wenhao
    Lin, Ziyao
    ENGINEERING LETTERS, 2023, 31 (02) : 825 - 832
  • [8] Parallel temporal feature selection based on improved attention mechanism for dynamic gesture recognition
    Chen, Gongzheng
    Dong, Zhenghong
    Wang, Jue
    Xia, Lurui
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (02) : 1377 - 1390
  • [9] HAND GESTURE RECOGNITION USING TEMPORAL CONVOLUTIONS AND ATTENTION MECHANISM
    Rahimian, Elahe
    Zabihi, Soheil
    Asif, Amir
    Farina, Dario
    Atashzar, S. Farokh
    Mohammadi, Arash
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 1196 - 1200
  • [10] Parallel temporal feature selection based on improved attention mechanism for dynamic gesture recognition
    Gongzheng Chen
    Zhenghong Dong
    Jue Wang
    Lurui Xia
    Complex & Intelligent Systems, 2023, 9 : 1377 - 1390