Electromyography-Based, Robust Hand Motion Classification Employing Temporal Multi-Channel Vision Transformers

被引:19
作者
Godoy, Ricardo, V [1 ]
Lahr, Gustavo J. G. [2 ]
Dwivedi, Anany [3 ]
Reis, Tharik J. S. [4 ]
Polegato, Paulo H. [4 ]
Becker, Marcelo [4 ]
Caurin, Glauco A. P. [4 ]
Liarokapis, Minas [1 ]
机构
[1] Univ Auckland, Dept Mech & Mechatron Engn, New Dexter Res Grp, Auckland 1010, New Zealand
[2] Ist Italiano Tecnol, Human Robot Interfaces & Phys Interact HRII Lab, I-16163 Genoa, Italy
[3] Friedrich Alexander Univ Erlangen Nurnberg, Chair Autonomous Syst & Mechatron, D-91052 Erlangen, Germany
[4] Univ Sao Paulo, Sao Carlos Sch Engn, BR-13563120 Sao Carlos, Brazil
关键词
Deep learning methods; deep learning in grasping and manipulation; in-hand manipulation; prosthetics and exoskeletons;
D O I
10.1109/LRA.2022.3192623
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
With an increasing use of robotic and bionic devices for the execution of everyday life, complex tasks, Electromyography (EMG) based interfaces are being explored as candidate technologies for facilitating an intuitive interaction with such devices. However, EMG-based interfaces typically require appropriate features to be extracted from the raw EMG signals using a plethora of feature extraction methods to achieve excellent performance in practical applications. To select an appropriate feature set that will lead to significant EMG-based decoding performance, a deep understanding of available methods and the human musculoskeletal system is needed. To overcome this issue, researchers have proposed the use of deep learning methods for automatically extracting complex features directly from the raw EMG data. In this work, we propose Temporal Multi-Channel Vision Transformers as a deep learning technique that has the potential to achieve dexterous control of robots and bionic hands. The performance of this method is evaluated and compared with other well-known methods, employing the open-access Ninapro dataset.
引用
收藏
页码:10200 / 10207
页数:8
相关论文
共 42 条
[31]   Multi-channel surface EMG classification using support vector machines and signal-based wavelet optimization [J].
Lucas, Marie-Francoise ;
Gaufriau, Adrien ;
Pascual, Sylvain ;
Doncarli, Christian ;
Farina, Dario .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2008, 3 (02) :169-174
[32]   Myoelectric control systems-A survey [J].
Oskoei, Mohammadreza Asghari ;
Hu, Huosheng .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2007, 2 (04) :275-294
[33]  
Piczak KJ, 2015, IEEE INT WORKS MACH
[34]   Comparison of six electromyography acquisition setups on hand movement classification tasks [J].
Pizzolato, Stefano ;
Tagliapietra, Luca ;
Cognolato, Matteo ;
Reggiani, Monica ;
Muller, Henning ;
Atzori, Manfredo .
PLOS ONE, 2017, 12 (10)
[35]   Gesture Recognition Through sEMG with Wearable Device Based on Deep Learning [J].
Shen, Shu ;
Gu, Kang ;
Chen, Xin-Rong ;
Lv, Cai-Xia ;
Wang, Ru-Chuan .
MOBILE NETWORKS & APPLICATIONS, 2020, 25 (06) :2447-2458
[36]   EMG-based online classification of gestures with recurrent neural networks [J].
Simao, Miguel ;
Neto, Pedro ;
Gibaru, Olivier .
PATTERN RECOGNITION LETTERS, 2019, 128 :45-51
[37]   A control system of semg signal based on deep learning [J].
Song W. ;
Wang W. ;
Jiang F. .
International Journal of Circuits, Systems and Signal Processing, 2020, 14 :386-391
[38]   Comparing Machine Learning Methods and Feature Extraction Techniques for the EMG Based Decoding of Human Intention [J].
Turner, Amber ;
Shieff, Dasha ;
Dwivedi, Anany ;
Liarokapis, Minas .
2021 43RD ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE & BIOLOGY SOCIETY (EMBC), 2021, :4738-4743
[39]  
Vaswani A, 2017, ADV NEUR IN, V30
[40]  
Xiong D., 2021, IEEECAA J AUTOMATICA, V8, P512