Electromyography-Based, Robust Hand Motion Classification Employing Temporal Multi-Channel Vision Transformers

被引:19
作者
Godoy, Ricardo, V [1 ]
Lahr, Gustavo J. G. [2 ]
Dwivedi, Anany [3 ]
Reis, Tharik J. S. [4 ]
Polegato, Paulo H. [4 ]
Becker, Marcelo [4 ]
Caurin, Glauco A. P. [4 ]
Liarokapis, Minas [1 ]
机构
[1] Univ Auckland, Dept Mech & Mechatron Engn, New Dexter Res Grp, Auckland 1010, New Zealand
[2] Ist Italiano Tecnol, Human Robot Interfaces & Phys Interact HRII Lab, I-16163 Genoa, Italy
[3] Friedrich Alexander Univ Erlangen Nurnberg, Chair Autonomous Syst & Mechatron, D-91052 Erlangen, Germany
[4] Univ Sao Paulo, Sao Carlos Sch Engn, BR-13563120 Sao Carlos, Brazil
关键词
Deep learning methods; deep learning in grasping and manipulation; in-hand manipulation; prosthetics and exoskeletons;
D O I
10.1109/LRA.2022.3192623
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
With an increasing use of robotic and bionic devices for the execution of everyday life, complex tasks, Electromyography (EMG) based interfaces are being explored as candidate technologies for facilitating an intuitive interaction with such devices. However, EMG-based interfaces typically require appropriate features to be extracted from the raw EMG signals using a plethora of feature extraction methods to achieve excellent performance in practical applications. To select an appropriate feature set that will lead to significant EMG-based decoding performance, a deep understanding of available methods and the human musculoskeletal system is needed. To overcome this issue, researchers have proposed the use of deep learning methods for automatically extracting complex features directly from the raw EMG data. In this work, we propose Temporal Multi-Channel Vision Transformers as a deep learning technique that has the potential to achieve dexterous control of robots and bionic hands. The performance of this method is evaluated and compared with other well-known methods, employing the open-access Ninapro dataset.
引用
收藏
页码:10200 / 10207
页数:8
相关论文
共 42 条
[1]   Optuna: A Next-generation Hyperparameter Optimization Framework [J].
Akiba, Takuya ;
Sano, Shotaro ;
Yanase, Toshihiko ;
Ohta, Takeru ;
Koyama, Masanori .
KDD'19: PROCEEDINGS OF THE 25TH ACM SIGKDD INTERNATIONAL CONFERENCCE ON KNOWLEDGE DISCOVERY AND DATA MINING, 2019, :2623-2631
[2]   Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands [J].
Atzori, Manfredo ;
Cognolato, Matteo ;
Mueller, Henning .
FRONTIERS IN NEUROROBOTICS, 2016, 10
[3]  
Atzori M, 2014, IEEE ENG MED BIO, P4362, DOI 10.1109/EMBC.2014.6944590
[4]  
Azad M. M., 2021, Ann. Romanian Soc. Cell Bio., V25, P5591
[5]  
Ba JL, 2016, arXiv
[6]  
Baao Xie, 2020, 2020 Proceedings of IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), P493, DOI 10.1109/ICAICA50127.2020.9182510
[7]  
Bertasius G., ARXIV210205095
[8]  
Buongiorno Domenico, 2019, Intelligent Computing Methodologies. 15th International Conference, ICIC 2019. Proceedings: Lecture Notes in Artificial Intelligence (LNAI 11645), P751, DOI 10.1007/978-3-030-26766-7_68
[9]   Hand-Gesture Recognition Based on EMG and Event-Based Camera Sensor Fusion: A Benchmark in Neuromorphic Computing [J].
Ceolini, Enea ;
Frenkel, Charlotte ;
Shrestha, Sumit Bam ;
Taverni, Gemma ;
Khacef, Lyes ;
Payvand, Melika ;
Donati, Elisa .
FRONTIERS IN NEUROSCIENCE, 2020, 14
[10]  
Choong J., 2020, medRxiv