A simple and effective static gesture recognition method based on attention mechanism

被引:7
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Food Recognition Model Based on Deep Learning and Attention Mechanism
    He, Lili
    Cai, Zhiwei
    Ouyang, Dantong
    Bai, Hongtao
    2022 8TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS, BIGCOM, 2022, : 206 - 216
  • [22] Poster: Gesture Recognition Based on ConvLSTM-Attention Implementation of Small Data sEMG Signals
    Gao, Xin
    Iwase, Masami
    Inoue, Jun
    Maeda, Eisaku
    UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, : 21 - 24
  • [23] A multimodal fusion emotion recognition method based on multitask learning and attention mechanism
    Xie, Jinbao
    Wang, Jiyu
    Wang, Qingyan
    Yang, Dali
    Gu, Jinming
    Tang, Yongqiang
    Varatnitski, Yury I.
    NEUROCOMPUTING, 2023, 556
  • [24] EEG Recognition Method for Epileptic Patients Based on RNN Model with Attention Mechanism
    Zhou S.
    Gao T.-H.
    Dongbei Daxue Xuebao/Journal of Northeastern University, 2023, 44 (08): : 1098 - 1103
  • [25] Radar Deception Jamming Recognition Method Based on Domain Adaptation and Attention Mechanism
    Sun Minhong
    Chen Xinwei
    Qiu Zhaoyang
    Teng Xuyang
    JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (11) : 3891 - 3899
  • [26] Ultra-lightweight tomatoes disease recognition method based on efficient attention mechanism in complex environment
    Sun, Wenbin
    Xu, Zhilong
    Xu, Kang
    Ru, Lin
    Yang, Ranbing
    Wang, Rong
    Xing, Jiejie
    FRONTIERS IN PLANT SCIENCE, 2025, 15
  • [27] Pupil Refinement Recognition Method Based on Deep Residual Network and Attention Mechanism
    Chen, Zehui
    Wang, Changyuan
    Wu, Gongpu
    APPLIED SCIENCES-BASEL, 2024, 14 (23):
  • [28] Part recognition method based on visual selective attention mechanism and deep learning
    Zhou, Dan
    Xiao, Nanfeng
    Journal of Fiber Bioengineering and Informatics, 2015, 8 (04): : 791 - 800
  • [29] Method for Fruit and Vegetable Automatic Recognition Based on Residual Block and Attention Mechanism
    Yu Q.
    Zhang R.
    Li D.
    Yun Y.
    Wang Z.
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 : 214 - 222
  • [30] EFFECTIVE ATTENTION MECHANISM IN DYNAMIC MODELS FOR SPEECH EMOTION RECOGNITION
    Hsiao, Po-Wei
    Chen, Chia-Ping
    2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, : 2526 - 2530