A simple and effective static gesture recognition method based on attention mechanism

被引:7
作者
Zhang, Lizao [1 ]
Tian, Qiuhong [1 ]
Ruan, Qionglu [1 ]
Shi, Zhixiang [1 ]
机构
[1] Zhejiang Sci Tech Univ, Sch Informat Sci & Technol, Hangzhou 310018, Peoples R China
基金
中国国家自然科学基金;
关键词
Sign language recognition; Deep learning; Attention mechanism;
D O I
10.1016/j.jvcir.2023.103783
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To solve the problem of low sign language recognition rate under the condition of small samples, a simple and effective static gesture recognition method based on an attention mechanism is proposed. The method proposed in this paper can enhance the features of both the details and the subject of the gesture image. The input of the proposed method depends on the intermediate feature map generated by the original network. Also, the proposed convolutional model is a lightweight general module, which can be seamlessly integrated into any CNN(Convolutional Neural Network) architecture and achieve significant performance gains with minimal overhead. Experiments on two different datasets show that the proposed method is effective and can improve the accuracy of sign language recognition of the benchmark model, making its performance better than the existing methods.
引用
收藏
页数:9
相关论文
共 50 条
[31]   Ultra-lightweight tomatoes disease recognition method based on efficient attention mechanism in complex environment [J].
Sun, Wenbin ;
Xu, Zhilong ;
Xu, Kang ;
Ru, Lin ;
Yang, Ranbing ;
Wang, Rong ;
Xing, Jiejie .
FRONTIERS IN PLANT SCIENCE, 2025, 15
[32]   Multitask Touch Gesture and Emotion Recognition Using Multiscale Spatiotemporal Convolutions With Attention Mechanism [J].
Wang, Ya-Xin ;
Li, Yun-Kai ;
Yang, Tian-Hao ;
Meng, Qing-Hao .
IEEE SENSORS JOURNAL, 2022, 22 (16) :16190-16201
[33]   Infrared Target Detection Method Based on Attention Mechanism [J].
Gu, Xing ;
Zhan, Weida ;
Cui, Ziwei ;
Gui, Tingting ;
Shi, Yanli ;
Hu, Jiahui .
LASER & OPTOELECTRONICS PROGRESS, 2023, 60 (10)
[34]   An Effective Image Classification Method for Plant Diseases with Improved Channel Attention Mechanism aECAnet Based on Deep Learning [J].
Yang, Wenqiang ;
Yuan, Ying ;
Zhang, Donghua ;
Zheng, Liyuan ;
Nie, Fuquan .
SYMMETRY-BASEL, 2024, 16 (04)
[35]   Automatic recognition of landslides based on YOLOv7 and attention mechanism [J].
Song, Yewei ;
Guo, Jie ;
Wu, Gaofeng ;
Ma, Fengshan ;
Li, Fangrui .
JOURNAL OF MOUNTAIN SCIENCE, 2024, 21 (08) :2681-2695
[36]   Research on Spider Recognition Technology Based on Transfer Learning and Attention Mechanism [J].
Wang, Jianming ;
Chen, Qiyu ;
Shi, Chenyang .
SYMMETRY-BASEL, 2023, 15 (09)
[37]   Content-Adaptive and Attention-Based Network for Hand Gesture Recognition [J].
Cao, Zongjing ;
Li, Yan ;
Shin, Byeong-Seok .
APPLIED SCIENCES-BASEL, 2022, 12 (04)
[38]   Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition [J].
Miah, Abu Saleh Musa ;
Hasan, Md. Al Mehedi ;
Shin, Jungpil ;
Okuyama, Yuichi ;
Tomioka, Yoichi .
COMPUTERS, 2023, 12 (01)
[39]   An attention-based RGBD dual-branch gesture recognition network [J].
Chen, Bo ;
Xie, Pengwei ;
Hao, Nan .
2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC), 2021, :8022-8027
[40]   Research on named entity recognition method of marine natural products based on attention mechanism [J].
Ma, Xiaodong ;
Yu, Rilei ;
Gao, Chunxiao ;
Wei, Zhiqiang ;
Xia, Yimin ;
Wang, Xiaowei ;
Liu, Hao .
FRONTIERS IN CHEMISTRY, 2023, 11