Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG

被引:2
|
作者
Zhang, Shenyilang [1 ]
Fang, Yinfeng [1 ]
Wan, Jiacheng [1 ]
Jiang, Guozhang [2 ]
Li, Gongfa [2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Wuhan Univ Sci & Technol, Wuhan 430081, Hubei, Peoples R China
关键词
Feature combination; Hand gesture classification; Transfer learning; Alexnet; EMG SIGNALS;
D O I
10.1007/s40846-023-00837-5
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
PurposeThis study explores the emerging field of human physical action classification within human-machine interaction (HMI), with potential applications in assisting individuals with disabilities and robotics. The research focuses on addressing the challenges posed by diverse sEMG signals, aiming for improved cross-subject hand gesture recognition.MethodsThe proposed approach utilizes deep transfer learning technology, employing multi-feature images (MFI) generated through grayscale conversion and RGB mapping of numerical matrices. These MFIs are fed as input into a fine-tuned AlexNet model. Two databases, ISRMyo-I and Ninapro DB1, are employed for experimentation. Rigorous testing is conducted to identify optimal parameters and feature combinations. Data augmentation techniques are applied, doubling the MFI dataset. Cross-subject experiments encompass six wrist gestures from Ninapro DB1 and thirteen gestures from ISRMyo-I.ResultsThe study demonstrates substantial performance enhancements. In Ninapro DB1, the mean accuracy achieves 86.16%, showcasing a 13.25% improvement over the best-performing traditional decoding method. Similarly, in ISRMyo-I, a mean accuracy of 70.41% is attained, signifying a 7.4% increase in accuracy compared to traditional methods.ConclusionThis research establishes a robust framework capable of mitigating cross-user differences in hand gesture recognition based on sEMG signals. By employing deep transfer learning techniques and multi-feature image processing, the study significantly enhances the accuracy of cross-subject hand gesture recognition. This advancement holds promise for enriching human-machine interaction and extending the practical applications of this technology in assisting disabled individuals and robotics.
引用
收藏
页码:672 / 688
页数:17
相关论文
共 50 条
  • [11] Hand Gesture Recognition via Transient sEMG Using Transfer Learning of Dilated Efficient CapsNet: Towards Generalization for Neurorobotics
    Tyacke, Eion
    Reddy, Shreyas P. J.
    Feng, Natalie
    Edlabadkar, Rama
    Zhou, Shucong
    Patel, Jay
    Hu, Qin
    Atashzar, S. Farokh
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (04) : 9216 - 9223
  • [12] Multi-Source Integration based Transfer Learning Method for Cross-User sEMG Gesture Recognition
    Wang, Kang
    Chen, Yiqiang
    Zhang, Yingwei
    Yang, Xiaodong
    Hu, Chunyu
    2022 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2022,
  • [13] Cross-Subject Emotion Recognition Based on Domain Similarity of EEG Signal Transfer
    Ma, Yuliang
    Zhao, Weicheng
    Meng, Ming
    Zhang, Qizhong
    She, Qingshan
    Zhang, Jianhai
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 936 - 943
  • [14] Hand Gesture Recognition using RVC Normalization and Transfer Learning
    Kim S.-Y.
    Kim I.-J.
    Lee Y.-C.
    Lee Y.-J.
    Transactions of the Korean Institute of Electrical Engineers, 2021, 70 (01) : 190 - 200
  • [15] A Fusion Model for Cross-Subject Stress Level Detection Based on Transfer Learning
    Mozafari, Mohsen
    Goubran, Rafik
    Green, James R.
    2021 IEEE SENSORS APPLICATIONS SYMPOSIUM (SAS 2021), 2021,
  • [16] Cross-subject spatial filter transfer method for SSVEP-EEG feature recognition
    Yan, Wenqiang
    Wu, Yongcheng
    Du, Chenghang
    Xu, Guanghua
    JOURNAL OF NEURAL ENGINEERING, 2022, 19 (03)
  • [17] Cross-subject MEG Transfer Learning by Riemannian Manifold and Feature Subspace Alignment
    Liu, Shihao
    Yu, Tianyou
    Huang, Zebin
    Ye, Hengfeng
    2020 INTERNATIONAL SYMPOSIUM ON AUTONOMOUS SYSTEMS (ISAS), 2020, : 12 - 16
  • [18] Hand Gesture Recognition Using Input Impedance Variation of Two Antennas with Transfer Learning
    Alnujaim, Ibrahim
    Alali, Hashim
    Khan, Faisal
    Kim, Youngwook
    IEEE SENSORS JOURNAL, 2018, 18 (10) : 4129 - 4135
  • [19] Dual layer transfer learning for sEMG-based user-independent gesture recognition
    Zhang, Yingwei
    Chen, Yiqiang
    Yu, Hanchao
    Yang, Xiaodong
    Lu, Wang
    PERSONAL AND UBIQUITOUS COMPUTING, 2020, 26 (3) : 575 - 586
  • [20] Dual layer transfer learning for sEMG-based user-independent gesture recognition
    Yingwei Zhang
    Yiqiang Chen
    Hanchao Yu
    Xiaodong Yang
    Wang Lu
    Personal and Ubiquitous Computing, 2022, 26 : 575 - 586