A Static Sign Language Recognition Method Enhanced with Self-Attention Mechanisms

被引:0
|
作者
Wang, Yongxin [1 ]
Jiang, He [1 ]
Sun, Yutong [2 ]
Xu, Longqi [1 ]
机构
[1] Harbin Univ Sci & Technol, Sch Measurement & Control Technol & Commun Engn, Harbin 150080, Peoples R China
[2] Harbin Univ Sci & Technol, Sch Elect & Elect Engn, Harbin 150080, Peoples R China
关键词
static gesture recognition; high robustness; self-attention enhanced; CNN;
D O I
10.3390/s24216921
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
For the current wearable devices in the application of cross-diversified user groups, it is common to face the technical difficulties of static sign language recognition accuracy attenuation, weak anti-noise ability, and insufficient system robustness due to the differences in the use of users. This paper proposes a novel static sign language recognition method enhanced by a self-attention mechanism. The key features of sign language gesture classification are highlighted by the weight function, and then the self-attention mechanism is combined to pay more attention to the key features, and the convolutional neural network is used to extract the features and classify them, which realizes the accurate recognition of different types of static sign language under standard gestures and non-standard gestures. Experimental results reveal that the proposed method achieves an average accuracy of 99.52% in the standard static sign language recognition task when tested against the standard 36 static gestures selected within the reference American Sign Language dataset. By imposing random angular bias conditions of +/-(0 degrees-9 degrees] and +/-(9 degrees-18 degrees], the average recognition rates in this range were 98.63% and 86.33%. These findings indicate that, compared to existing methods, the proposed method not only maintains a high recognition rate for standard static gestures but also exhibits superior noise resistance and robustness, rendering it suitable for static sign language recognition among diverse user populations.
引用
收藏
页数:19
相关论文
共 50 条
  • [31] A lightweight transformer with linear self-attention for defect recognition
    Zhai, Yuwen
    Li, Xinyu
    Gao, Liang
    Gao, Yiping
    ELECTRONICS LETTERS, 2024, 60 (17)
  • [32] NEPALI SPEECH RECOGNITION USING SELF-ATTENTION NETWORKS
    Joshi, Basanta
    Shrestha, Rupesh
    INTERNATIONAL JOURNAL OF INNOVATIVE COMPUTING INFORMATION AND CONTROL, 2023, 19 (06): : 1769 - 1784
  • [33] Finger Vein Recognition Based on ResNet With Self-Attention
    Zhang, Zhibo
    Chen, Guanghua
    Zhang, Weifeng
    Wang, Huiyang
    IEEE ACCESS, 2024, 12 : 1943 - 1951
  • [34] Assessing the Impact of Attention and Self-Attention Mechanisms on the Classification of Skin Lesions
    Pedro, Rafael
    Oliveira, Arlindo L.
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [35] UniFormer: Unifying Convolution and Self-Attention for Visual Recognition
    Li, Kunchang
    Wang, Yali
    Zhang, Junhao
    Gao, Peng
    Song, Guanglu
    Liu, Yu
    Li, Hongsheng
    Qiao, Yu
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2023, 45 (10) : 12581 - 12600
  • [36] Multimodal cooperative self-attention network for action recognition
    Zhong, Zhuokun
    Hou, Zhenjie
    Liang, Jiuzhen
    Lin, En
    Shi, Haiyong
    IET IMAGE PROCESSING, 2023, 17 (06) : 1775 - 1783
  • [37] Inductive Biases and Variable Creation in Self-Attention Mechanisms
    Edelman, Benjamin L.
    Goel, Surbhi
    Kakade, Sham
    Zhang, Cyril
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 162, 2022,
  • [38] Recognition of piglet postures based on self-attention mechanism and anchor-free method
    Xu C.
    Xue Y.
    Zheng C.
    Hou W.
    Guo J.
    Wang X.
    Nongye Gongcheng Xuebao/Transactions of the Chinese Society of Agricultural Engineering, 2022, 38 (14): : 166 - 173
  • [39] Sign Language Static Gestures Recognition Tool Prototype
    Imashev, Alfarabi
    2017 11TH IEEE INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT 2017), 2017, : 53 - 56
  • [40] An Encoding and Identification Approach for the Static Sign Language Recognition
    Chou, Fu-Hua
    Su, Yung-Chun
    2012 IEEE/ASME INTERNATIONAL CONFERENCE ON ADVANCED INTELLIGENT MECHATRONICS (AIM), 2012, : 885 - 889