Fusion inception and transformer network for continuous estimation of finger kinematics from surface electromyography

被引:2
|
作者
Lin, Chuang [1 ]
Zhang, Xiaobing [1 ]
机构
[1] Dalian Maritime Univ, Sch Informat Sci & Technol, Dalian, Peoples R China
来源
关键词
surface electromyography; human-computer interaction; continuous estimation; finger kinematics; deep learning; MOTION;
D O I
10.3389/fnbot.2024.1305605
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Decoding surface electromyography (sEMG) to recognize human movement intentions enables us to achieve stable, natural and consistent control in the field of human computer interaction (HCI). In this paper, we present a novel deep learning (DL) model, named fusion inception and transformer network (FIT), which effectively models both local and global information on sequence data by fully leveraging the capabilities of Inception and Transformer networks. In the publicly available Ninapro dataset, we selected surface EMG signals from six typical hand grasping maneuvers in 10 subjects for predicting the values of the 10 most important joint angles in the hand. Our model's performance, assessed through Pearson's correlation coefficient (PCC), root mean square error (RMSE), and R-squared (R2) metrics, was compared with temporal convolutional network (TCN), long short-term memory network (LSTM), and bidirectional encoder representation from transformers model (BERT). Additionally, we also calculate the training time and the inference time of the models. The results show that FIT is the most performant, with excellent estimation accuracy and low computational cost. Our model contributes to the development of HCI technology and has significant practical value.
引用
收藏
页数:11
相关论文
共 50 条
  • [1] A CNN-Attention Network for Continuous Estimation of Finger Kinematics from Surface Electromyography
    Geng, Yanjuan
    Yu, Zhebin
    Long, Yucheng
    Qin, Liuni
    Chen, Ziyin
    Li, Yongcheng
    Guo, Xin
    Li, Guanglin
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (03) : 6297 - 6304
  • [2] Continuous Kalman Estimation Method for Finger Kinematics Tracking from Surface Electromyography
    Zhang, Haoshi
    Peng, Boxing
    Tian, Lan
    Samuel, Oluwarotimi Williams
    Li, Guanglin
    CYBORG AND BIONIC SYSTEMS, 2024, 5
  • [3] Multi-Attention Feature Fusion Network for Accurate Estimation of Finger Kinematics From Surface Electromyographic Signals
    Guo, Weiyu
    Jiang, Ning
    Farina, Dario
    Su, Jingyong
    Wang, Zheng
    Lin, Chuang
    Xiong, Hui
    IEEE TRANSACTIONS ON HUMAN-MACHINE SYSTEMS, 2023, 53 (03) : 512 - 519
  • [4] Trace Finger Kinematics from Surface Electromyography by Using Kalman Decoding Method
    Zhang, Haoshi
    Zhou, Xiaomeng
    Yang, Zijian
    Tian, Lan
    Zheng, Yue
    Li, Guanglin
    2022 IEEE INTERNATIONAL CONFERENCE ON CYBORG AND BIONIC SYSTEMS, CBS, 2022, : 153 - 158
  • [5] Continuous Finger Kinematics Estimation Based on sEMG and Attention-ConvGRU Network
    Zhao, Penghui
    Lin, Chuang
    Zhang, Jianhua
    Niu, Xinyue
    Liu, Yanhong
    INTELLIGENT ROBOTICS AND APPLICATIONS (ICIRA 2022), PT IV, 2022, 13458 : 345 - 353
  • [6] Continuous grip force estimation from surface electromyography using generalized regression neural network
    Mao, He
    Fang, Peng
    Zheng, Yue
    Tian, Lan
    Li, Xiangxin
    Wang, Pu
    Peng, Liang
    Li, Guanglin
    TECHNOLOGY AND HEALTH CARE, 2023, 31 (02) : 675 - 689
  • [7] Long exposure convolutional memory network for accurate estimation of finger kinematics from surface electromyographic signals
    Guo, Weiyu
    Ma, Chenfei
    Wang, Zheng
    Zhang, Hang
    Farina, Dario
    Jiang, Ning
    Lin, Chuang
    JOURNAL OF NEURAL ENGINEERING, 2021, 18 (02)
  • [8] Proportional estimation of finger movements from high-density surface electromyography
    Nicolò Celadon
    Strahinja Došen
    Iris Binder
    Paolo Ariano
    Dario Farina
    Journal of NeuroEngineering and Rehabilitation, 13
  • [9] Proportional estimation of finger movements from high-density surface electromyography
    Celadon, Nicolo
    Dosen, Strahinja
    Binder, Iris
    Ariano, Paolo
    Farina, Dario
    JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2016, 13
  • [10] Hierarchical approach for fusion of electroencephalography and electromyography for predicting finger movements and kinematics using deep learning
    Das, Tanaya
    Gohain, Lakhyajit
    Kakoty, Nayan M.
    Malarvili, M. B.
    Widiyanti, Prihartini
    Kumar, Gajendra
    NEUROCOMPUTING, 2023, 527 : 184 - 195