A Static Sign Language Recognition Method Enhanced with Self-Attention Mechanisms

被引:0
|
作者
Wang, Yongxin [1 ]
Jiang, He [1 ]
Sun, Yutong [2 ]
Xu, Longqi [1 ]
机构
[1] Harbin Univ Sci & Technol, Sch Measurement & Control Technol & Commun Engn, Harbin 150080, Peoples R China
[2] Harbin Univ Sci & Technol, Sch Elect & Elect Engn, Harbin 150080, Peoples R China
关键词
static gesture recognition; high robustness; self-attention enhanced; CNN;
D O I
10.3390/s24216921
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For the current wearable devices in the application of cross-diversified user groups, it is common to face the technical difficulties of static sign language recognition accuracy attenuation, weak anti-noise ability, and insufficient system robustness due to the differences in the use of users. This paper proposes a novel static sign language recognition method enhanced by a self-attention mechanism. The key features of sign language gesture classification are highlighted by the weight function, and then the self-attention mechanism is combined to pay more attention to the key features, and the convolutional neural network is used to extract the features and classify them, which realizes the accurate recognition of different types of static sign language under standard gestures and non-standard gestures. Experimental results reveal that the proposed method achieves an average accuracy of 99.52% in the standard static sign language recognition task when tested against the standard 36 static gestures selected within the reference American Sign Language dataset. By imposing random angular bias conditions of +/-(0 degrees-9 degrees] and +/-(9 degrees-18 degrees], the average recognition rates in this range were 98.63% and 86.33%. These findings indicate that, compared to existing methods, the proposed method not only maintains a high recognition rate for standard static gestures but also exhibits superior noise resistance and robustness, rendering it suitable for static sign language recognition among diverse user populations.
引用
收藏
页数:19
相关论文
共 50 条
  • [41] Speaker Verification Employing Combinations of Self-Attention Mechanisms
    Bae, Ara
    Kim, Wooil
    ELECTRONICS, 2020, 9 (12) : 1 - 11
  • [42] Att-Net: Enhanced emotion recognition system using lightweight self-attention module
    Mustaqeem
    Kwon, Soonil
    APPLIED SOFT COMPUTING, 2021, 102
  • [43] Crop Diseases Recognition Method via Fusion Color Mask and Self-attention Mechanism
    Yu, Ming
    Li, Ruoxi
    Yan, Gang
    Wang, Yan
    Wang, Jianchun
    Li, Yang
    Nongye Jixie Xuebao/Transactions of the Chinese Society for Agricultural Machinery, 2022, 53 (08): : 337 - 344
  • [44] An Intelligent Point Cloud Recognition Method for Substation Equipment Based on Multiscale Self-Attention
    Shen, Xiaojun
    Xu, Zelin
    Wang, Mei
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [45] A Fast Convolutional Self-attention Based Speech Dereverberation Method for Robust Speech Recognition
    Li, Nan
    Ge, Meng
    Wang, Longbiao
    Dang, Jianwu
    NEURAL INFORMATION PROCESSING (ICONIP 2019), PT III, 2019, 11955 : 295 - 305
  • [46] An Intelligent Point Cloud Recognition Method for Substation Equipment Based on Multiscale Self-Attention
    Shen, Xiaojun
    Xu, Zelin
    Wang, Mei
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [47] Fusion of Attention-Based Convolution Neural Network and HOG Features for Static Sign Language Recognition
    Kumari, Diksha
    Anand, Radhey Shyam
    APPLIED SCIENCES-BASEL, 2023, 13 (21):
  • [48] Attention Modeling with Temporal Shift in Sign Language Recognition
    Celimli, Ahmet Faruk
    Ozdemir, Ogulcan
    Akarun, Lale
    2022 30TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE, SIU, 2022,
  • [49] A recognition method of sign language sentences for Japanese sign language translation
    Sagawa, H
    Takeuchi, M
    PROCEEDINGS OF THE FIFTH JOINT CONFERENCE ON INFORMATION SCIENCES, VOLS 1 AND 2, 2000, : A858 - A861
  • [50] A SEGMENTATION METHOD FOR SIGN LANGUAGE RECOGNITION
    OHIRA, E
    SAGAWA, H
    SAKIYAMA, T
    OHKI, M
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 1995, E78D (01) : 49 - 57