A Robust and Real-Time Framework of Cross-Subject Myoelectric Control Model Calibration via Multi-Source Domain Adaptation

被引:4
作者
Liu, Jiayan [1 ]
Yuan, Yangyang [1 ]
Jiang, Xinyu [1 ]
Guo, Yao [1 ]
Jia, Fumin [2 ]
Dai, Chenyun [3 ]
机构
[1] Fudan Univ, Ctr Biomed Engn, Sch Informat Sci & Technol, Shanghai 200433, Peoples R China
[2] Fudan Univ, Inst Sci & Technol Brain Inspired Intelligence, Shanghai 200433, Peoples R China
[3] Shanghai Jiao Tong Univ, Sch Biomed Engn, Shanghai 200241, Peoples R China
基金
中国国家自然科学基金;
关键词
Electromyography; hand gesture recognition; multi-source domain adaptation; HUMAN-COMPUTER INTERACTION; FORCE CONTROL; SEMG; RECOGNITION;
D O I
10.1109/JBHI.2024.3354909
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Surface electromyogram (sEMG) has been widely used in hand gesture recognition. However, most previous studies focused on user-personalized models, which require a great amount of data from each new target user to learn the user-specific EMG patterns. In this work, we present a novel real-time gesture recognition framework based on multi-source domain adaptation, which learns extra knowledge from the data of other users, thereby reducing the data collection burdens on the target user. Additionally, compared with conventional domain adaptation methods which treat data from all users in the source domain as a whole, the proposed multi-source method treat data from different users as multiple separate source domains. Therefore, more detailed statistical information on the data distribution from each user can be learned effectively. High-density sEMG (256 channels) from 20 subjects was used to validate the proposed method. Importantly, we evaluated our method with a simulated real-time processing pipeline on continuous sEMG data stream, rather than well-segmented data. The false alarm rate during rest periods in an EMG data stream, which is typically neglected by previous studies performing offline analyses, was also considered. Our results showed that, with only 1 s sEMG data per gesture from the new user, the 10-gesture classification accuracy reached 87.66 but the false alarm rate was reduced to 1.95. Our method can reduce the frustratingly heavy data collection burdens on each new user.
引用
收藏
页码:1363 / 1373
页数:11
相关论文
共 39 条
  • [1] Performance Evaluation of Convolutional Neural Network for Hand Gesture Recognition Using EMG
    Asif, Ali Raza
    Waris, Asim
    Gilani, Syed Omer
    Jamil, Mohsin
    Ashraf, Hassan
    Shafique, Muhammad
    Niazi, Imran Khan
    [J]. SENSORS, 2020, 20 (06)
  • [2] Hand Gesture Recognition Using Compact CNN via Surface Electromyography Signals
    Chen, Lin
    Fu, Jianting
    Wu, Yuheng
    Li, Haochen
    Zheng, Bin
    [J]. SENSORS, 2020, 20 (03)
  • [3] Chen Y., Hand gesture recognitionbased on surface electromyography using convolutional neural networkwith transfer learning method
  • [4] Comparison of Constant-Posture Force-Varying EMG-Force Dynamic Models About the Elbow
    Dai, Chenyun
    Bardizbanian, Berj
    Clancy, Edward A.
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (09) : 1529 - 1538
  • [5] Cross-Domain Error Minimization for Unsupervised Domain Adaptation
    Du, Yuntao
    Chen, Yinghao
    Cui, Fengli
    Zhang, Xiaowen
    Wang, Chongjun
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 : 429 - 448
  • [6] A robust, real-time control scheme for multifunction myoelectric control
    Englehart, K
    Hudgins, B
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2003, 50 (07) : 848 - 854
  • [7] Gong BQ, 2012, PROC CVPR IEEE, P2066, DOI 10.1109/CVPR.2012.6247911
  • [8] Prototype Classification: Insights from Machine Learning
    Graf, Arnulf B. A.
    Bousquet, Olivier
    Raetsch, Gunnar
    Schoelkopf, Bernhard
    [J]. NEURAL COMPUTATION, 2009, 21 (01) : 272 - 300
  • [9] Development of recommendations for SEMG sensors and sensor placement procedures
    Hermens, HJ
    Freriks, B
    Disselhorst-Klug, C
    Rau, G
    [J]. JOURNAL OF ELECTROMYOGRAPHY AND KINESIOLOGY, 2000, 10 (05) : 361 - 374
  • [10] Comparing subject-to-subject transfer learning methods in surface electromyogram-based motion recognition with shallow and deep classifiers
    Hoshino, Takayuki
    Kanoga, Suguru
    Tsubaki, Masashi
    Aoyama, Atsushi
    [J]. NEUROCOMPUTING, 2022, 489 : 599 - 612