Recurrent Neural Network for electromyographic gesture recognition in transhumeral amputees

被引:20
作者
Barron, Olivier [1 ]
Raison, Maxime [1 ]
Gaudet, Guillaume [1 ]
Achiche, Sofiane [1 ]
机构
[1] Polytech Montreal, Dept Mech Engn, 2900 Boul Edouard Montpetit, Montreal, PQ H3T 1J4, Canada
关键词
Classification; Recurrent Neural Network; Surface electromyography (sEMG); Phantom limb movements; Transhumeral amputee; PATTERN-RECOGNITION; MYOELECTRIC CONTROL; HAND; CLASSIFICATION;
D O I
10.1016/j.asoc.2020.106616
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Gesture recognition is a key aspect of myoelectric control of upper-limb prostheses and is rather complex to achieve for transhumeral amputees. The prosthesis control of upper arm movements must rely only on the arm muscles, which were not involved in these gestures before the amputation. For decades, machine learning has been used in research for upper-limb gesture recognition. However, reported classification accuracies for transhumeral amputees have not improved significantly since the 1990s. Latest developments in deep learning suggest it can outperform classical machine learning both in accuracy and processing time. This study aims to determine if a deep learning approach, specifically a Recurrent Neural Network (RNN), could better recognize the movement intents in transhumeral amputees. To do so, the classification accuracy and the processing time of the RNN were measured and compared to two state-of-the-art approaches that use a linear discriminant analysis (LDA) and a multilayer perceptron (MLP) respectively. All three approaches were used to classify the signals of five transhumeral amputees between 6 upper-limb gestures. For subjects 1, 3 and 5, the classification accuracy was significantly higher (p = 0.0002) for the RNN (79.7%) compared to the LDA (67,1%) and the MLP (74,1%). Additionally, the RNN had a much smaller processing time, under 7 ms, compared to 385 ms and 377 ms for the LDA and the MLP respectively. Consequently, the RNN is better suited for a real-time prosthesis control that occurs between 100-250 ms. Results suggest deep learning as a viable solution for gesture recognition in transhumeral amputees. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:9
相关论文
共 54 条
[1]   Convolutional Neural Networks for Speech Recognition [J].
Abdel-Hamid, Ossama ;
Mohamed, Abdel-Rahman ;
Jiang, Hui ;
Deng, Li ;
Penn, Gerald ;
Yu, Dong .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (10) :1533-1545
[2]  
Allard UC, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P2464, DOI 10.1109/IROS.2016.7759384
[3]   Regression convolutional neural network for improved simultaneous EMG control [J].
Ameri, Ali ;
Akhaee, Mohammad Ali ;
Scheme, Erik ;
Englehart, Kevin .
JOURNAL OF NEURAL ENGINEERING, 2019, 16 (03)
[4]   Real-time, simultaneous myoelectric control using a convolutional neural network [J].
Ameri, Ali ;
Akhaee, Mohammad Ali ;
Scheme, Erik ;
Englehart, Kevin .
PLOS ONE, 2018, 13 (09)
[5]  
[Anonymous], 2012, ARXIV12065538CS
[6]   Effect of clinical parameters on the control of myoelectric robotic prosthetic hands [J].
Atzori, Manfredo ;
Gijsberts, Arjan ;
Castellini, Claudio ;
Caputo, Barbara ;
Hager, Anne-Gabrielle Mittaz ;
Elsig, Simone ;
Giatsidis, Giorgio ;
Bassetto, Franco ;
Muller, Henning .
JOURNAL OF REHABILITATION RESEARCH AND DEVELOPMENT, 2016, 53 (03) :345-358
[7]   Consumer design priorities for upper limb prosthetics [J].
Biddiss, Elaine ;
Beaton, Dorcas ;
Chau, Tom .
DISABILITY AND REHABILITATION-ASSISTIVE TECHNOLOGY, 2007, 2 (06) :346-357
[8]   A convolutional neural network with feature fusion for real-time hand posture recognition [J].
Chevtchenko, Sergio F. ;
Vale, Rafaella F. ;
Macario, Valmir ;
Cordeiro, Filipe R. .
APPLIED SOFT COMPUTING, 2018, 73 :748-766
[9]   Using recurrent neural network models for early detection of heart failure onset [J].
Choi, Edward ;
Schuetz, Andy ;
Stewart, Walter F. ;
Sun, Jimeng .
JOURNAL OF THE AMERICAN MEDICAL INFORMATICS ASSOCIATION, 2017, 24 (02) :361-370
[10]   MOTOR REORGANIZATION AFTER UPPER LIMB AMPUTATION IN MAN - A STUDY WITH FOCAL MAGNETIC STIMULATION [J].
COHEN, LG ;
BANDINELLI, S ;
FINDLEY, TW ;
HALLETT, M .
BRAIN, 1991, 114 :615-627