Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG

被引:2
|
作者
Zhang, Shenyilang [1 ]
Fang, Yinfeng [1 ]
Wan, Jiacheng [1 ]
Jiang, Guozhang [2 ]
Li, Gongfa [2 ]
机构
[1] Hangzhou Dianzi Univ, Sch Commun Engn, Hangzhou 310018, Zhejiang, Peoples R China
[2] Wuhan Univ Sci & Technol, Wuhan 430081, Hubei, Peoples R China
关键词
Feature combination; Hand gesture classification; Transfer learning; Alexnet; EMG SIGNALS;
D O I
10.1007/s40846-023-00837-5
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
PurposeThis study explores the emerging field of human physical action classification within human-machine interaction (HMI), with potential applications in assisting individuals with disabilities and robotics. The research focuses on addressing the challenges posed by diverse sEMG signals, aiming for improved cross-subject hand gesture recognition.MethodsThe proposed approach utilizes deep transfer learning technology, employing multi-feature images (MFI) generated through grayscale conversion and RGB mapping of numerical matrices. These MFIs are fed as input into a fine-tuned AlexNet model. Two databases, ISRMyo-I and Ninapro DB1, are employed for experimentation. Rigorous testing is conducted to identify optimal parameters and feature combinations. Data augmentation techniques are applied, doubling the MFI dataset. Cross-subject experiments encompass six wrist gestures from Ninapro DB1 and thirteen gestures from ISRMyo-I.ResultsThe study demonstrates substantial performance enhancements. In Ninapro DB1, the mean accuracy achieves 86.16%, showcasing a 13.25% improvement over the best-performing traditional decoding method. Similarly, in ISRMyo-I, a mean accuracy of 70.41% is attained, signifying a 7.4% increase in accuracy compared to traditional methods.ConclusionThis research establishes a robust framework capable of mitigating cross-user differences in hand gesture recognition based on sEMG signals. By employing deep transfer learning techniques and multi-feature image processing, the study significantly enhances the accuracy of cross-subject hand gesture recognition. This advancement holds promise for enriching human-machine interaction and extending the practical applications of this technology in assisting disabled individuals and robotics.
引用
收藏
页码:672 / 688
页数:17
相关论文
共 50 条
  • [41] Subject-Adaptive Transfer Learning Using Resting State EEG Signals for Cross-Subject EEG Motor Imagery Classification
    An, Sion
    Kang, Myeongkyun
    Kim, Soopil
    Chikontwe, Philip
    Shen, Li
    Park, Sang Hyun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 678 - 688
  • [42] The Effect of Space-filling Curves on the Efficiency of Hand Gesture Recognition Based on sEMG Signals
    Tsinganos, Panagiotis
    Jansen, Bart
    Cornelis, Bruno
    Skodras, Athanassios
    Cornelis, Jan
    INTERNATIONAL JOURNAL OF ELECTRICAL AND COMPUTER ENGINEERING SYSTEMS, 2021, 12 (01) : 23 - 31
  • [43] Manifold Feature Fusion with Dynamical Feature Selection for Cross-Subject Emotion Recognition
    Hua, Yue
    Zhong, Xiaolong
    Zhang, Bingxue
    Yin, Zhong
    Zhang, Jianhua
    BRAIN SCIENCES, 2021, 11 (11)
  • [44] Multisource Associate Domain Adaptation for Cross-Subject and Cross-Session EEG Emotion Recognition
    She, Qingshan
    Zhang, Chenqi
    Fang, Feng
    Ma, Yuliang
    Zhang, Yingchun
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [45] Transfer Learning Decision Forests for Gesture Recognition
    Goussies, Norberto A.
    Ubalde, Sebastian
    Mejail, Marta
    JOURNAL OF MACHINE LEARNING RESEARCH, 2014, 15 : 3667 - 3690
  • [46] Cross-subject driver status detection from physiological signals based on hybrid feature selection and transfer learning
    Chen, Lan-lan
    Zhang, Ao
    Lou, Xiao-guang
    EXPERT SYSTEMS WITH APPLICATIONS, 2019, 137 : 266 - 280
  • [47] Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition
    Tayyip Ozcan
    Alper Basturk
    Neural Computing and Applications, 2019, 31 : 8955 - 8970
  • [48] Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition
    Ozcan, Tayyip
    Basturk, Alper
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (12) : 8955 - 8970
  • [49] Subject matching for cross-subject EEG-based recognition of driver states related to situation awareness
    Li, Ruilin
    Wang, Lipo
    Sourina, Olga
    METHODS, 2022, 202 : 136 - 143
  • [50] Cross-Subject Lifelong Learning for Continuous Estimation From Surface Electromyographic Signal
    Chen, Xingjian
    Guo, Weiyu
    Lin, Chuang
    Jiang, Ning
    Su, Jingyong
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2024, 32 : 1965 - 1973