A simple and effective static gesture recognition method based on attention mechanism

被引:8
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
[21]   EFFECTIVE ATTENTION MECHANISM IN DYNAMIC MODELS FOR SPEECH EMOTION RECOGNITION [J].
Hsiao, Po-Wei ;
Chen, Chia-Ping .
2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2018, :2526-2530
[22]   Food Recognition Model Based on Deep Learning and Attention Mechanism [J].
He, Lili ;
Cai, Zhiwei ;
Ouyang, Dantong ;
Bai, Hongtao .
2022 8TH INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING AND COMMUNICATIONS, BIGCOM, 2022, :331-341
[23]   Poster: Gesture Recognition Based on ConvLSTM-Attention Implementation of Small Data sEMG Signals [J].
Gao, Xin ;
Iwase, Masami ;
Inoue, Jun ;
Maeda, Eisaku .
UBICOMP/ISWC'19 ADJUNCT: PROCEEDINGS OF THE 2019 ACM INTERNATIONAL JOINT CONFERENCE ON PERVASIVE AND UBIQUITOUS COMPUTING AND PROCEEDINGS OF THE 2019 ACM INTERNATIONAL SYMPOSIUM ON WEARABLE COMPUTERS, 2019, :21-24
[24]   A speech emotion recognition method for the elderly based on feature fusion and attention mechanism [J].
Jian, Qijian ;
Xiang, Min ;
Huang, Wei .
THIRD INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION; NETWORK AND COMPUTER TECHNOLOGY (ECNCT 2021), 2022, 12167
[25]   Part recognition method based on visual selective attention mechanism and deep learning [J].
Zhou, Dan ;
Xiao, Nanfeng .
Journal of Fiber Bioengineering and Informatics, 2015, 8 (04) :791-800
[26]   Pupil Refinement Recognition Method Based on Deep Residual Network and Attention Mechanism [J].
Chen, Zehui ;
Wang, Changyuan ;
Wu, Gongpu .
APPLIED SCIENCES-BASEL, 2024, 14 (23)
[27]   Radar Deception Jamming Recognition Method Based on Domain Adaptation and Attention Mechanism [J].
Sun Minhong ;
Chen Xinwei ;
Qiu Zhaoyang ;
Teng Xuyang .
JOURNAL OF ELECTRONICS & INFORMATION TECHNOLOGY, 2022, 44 (11) :3891-3899
[28]   A multimodal fusion emotion recognition method based on multitask learning and attention mechanism [J].
Xie, Jinbao ;
Wang, Jiyu ;
Wang, Qingyan ;
Yang, Dali ;
Gu, Jinming ;
Tang, Yongqiang ;
Varatnitski, Yury I. .
NEUROCOMPUTING, 2023, 556
[29]   EEG Recognition Method for Epileptic Patients Based on RNN Model with Attention Mechanism [J].
Zhou S. ;
Gao T.-H. .
Dongbei Daxue Xuebao/Journal of Northeastern University, 2023, 44 (08) :1098-1103
[30]   Method for Fruit and Vegetable Automatic Recognition Based on Residual Block and Attention Mechanism [J].
Yu Q. ;
Zhang R. ;
Li D. ;
Yun Y. ;
Wang Z. .
Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2023, 54 :214-222