Chinese sign language recognition based on surface electromyography and motion information

被引：0
|
作者：
Li, Wenyu [1 ]
Luo, Zhizeng [1 ]
Li, Wenguo [1 ,2 ]
Xi, Xugang [1 ]
机构：
[1] Hangzhou Dianzi Univ, Inst Intelligent Control & Robot, Hangzhou, Zhejiang, Peoples R China
[2] Xianheng Int Hangzhou Elect Mfg Co Ltd, Hangzhou, Zhejiang, Peoples R China
来源：
PLOS ONE | 2023年 / 18卷 / 12期
基金：
中国国家自然科学基金;
关键词：
MODEL;
D O I：
10.1371/journal.pone.0295398
中图分类号：
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号：
07 ; 0710 ; 09 ;
摘要：
Sign language (SL) has strong structural features. Various gestures and the complex trajectories of hand movements bring challenges to sign language recognition (SLR). Based on the inherent correlation between gesture and trajectory of SL action, SLR is organically divided into gesture-based recognition and gesture-related movement trajectory recognition. One hundred and twenty commonly used Chinese SL words involving 9 gestures and 8 movement trajectories, are selected as research and test objects. The method based on the amplitude state of surface electromyography (sEMG) signal and acceleration signal is used for vocabulary segmentation. The multi-sensor decision fusion method of coupled hidden Markov model is used to complete the recognition of SL vocabulary, and the average recognition rate is 90.41%. Experiments show that the method of sEMG signal and motion information fusion has good practicability in SLR.
引用
收藏
页数：15
相关论文
共 50 条
  • [21] Multichannel surface electromyography classification based on muscular synergy
    Lopez, Natalia M.
    Orosco, Eugenio
    di Sciascio, Fernando
    2010 ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY (EMBC), 2010, : 1658 - 1661
  • [22] Feature extraction in Brazilian Sign Language Recognition based on phonological structure and using RGB-D sensors
    Almeida, Silvia Grasiella Moreira
    Guimaraes, Frederico Gadelha
    Ramirez, Jaime Arturo
    EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (16) : 7259 - 7271
  • [23] Isolated Video-Based Sign Language Recognition Using a Hybrid CNN-LSTM Framework Based on Attention Mechanism
    Kumari, Diksha
    Anand, Radhey Shyam
    ELECTRONICS, 2024, 13 (07)
  • [24] Artificial Intelligent based Human Motion Pattern Recognition and Prediction for the Surface Electromyographic Signals
    Xu Guo
    Hu Yu
    Gao Zhen
    Liu Yuliang
    Zhang Yong
    Zhang Ying
    2009 INTERNATIONAL CONFERENCE ON INFORMATION TECHNOLOGY AND COMPUTER SCIENCE, VOL 1, PROCEEDINGS, 2009, : 289 - +
  • [25] Optimization of Convolutional Neural Networks Architectures Using PSO for Sign Language Recognition
    Fregoso, Jonathan
    Gonzalez, Claudia, I
    Martinez, Gabriela E.
    AXIOMS, 2021, 10 (03)
  • [26] An Optimized Convolutional Neural Network with Combination Blocks for Chinese Sign Language Identification
    Gao, Yalan
    Zhang, Yanqiong
    Jiang, Xianwei
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2022, 132 (01): : 95 - 117
  • [27] Motion Recognition Based on Concept Learning
    Ma, Xiang
    Zhao, Tong
    Wen, Ruoshi
    Wu, Zhaojun
    Wang, Qiang
    2017 IEEE INTERNATIONAL INSTRUMENTATION AND MEASUREMENT TECHNOLOGY CONFERENCE (I2MTC), 2017, : 447 - 452
  • [28] Traffic Sign Detection and Recognition Based on Deep Learning
    Zhang, H.
    Zhao, J.
    ENGINEERING LETTERS, 2022, 30 (02) : 666 - 673
  • [29] Traffic Sign Recognition Based on Semantic Scene Understanding and Structural Traffic Sign Location
    Min, Weidong
    Liu, Ruikang
    He, Daojing
    Han, Qing
    Wei, Qingting
    Wang, Qi
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 15794 - 15807
  • [30] Machine Learning of Motion Statistics Reveals the Kinematic Signature of the Identity of a Person in Sign Language
    Bigand, Felix
    Prigent, Elise
    Berret, Bastien
    Braffort, Annelies
    FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2021, 9
12345