Temporal Dilation of Deep LSTM for Agile Decoding of sEMG: Application in Prediction of Upper-Limb Motor Intention in NeuroRobotics

被引:26
作者
Sun, Tianyun [1 ]
Hu, Qin [1 ]
Gulati, Paras [1 ]
Atashzar, S. Farokh [1 ,2 ,3 ]
机构
[1] NYU, Dept Elect & Comp Engn, New York, NY 10003 USA
[2] NYU, Dept Mech & Aerosp Engn, New York, NY 10003 USA
[3] NYU, Ctr Urban Sci & Progress, NewYork Univ Wireless, Brooklyn, NY 11201 USA
基金
美国国家科学基金会;
关键词
Electromyography; machine learning; medical robotics; multi-layer neural network; prosthetics; recurrent neural networks; and convergence; HAND GESTURE RECOGNITION; SURFACE EMG; PERFORMANCE; DESIGN;
D O I
10.1109/LRA.2021.3091698
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
The spectrotemporal information content of surface electromyography has shown strong potential in predicting the intended motor command. During the last decade, with accelerated exploitation of powerful deep-learning techniques aligned with advancements in active prostheses and neurorobots, a great deal of interest has been drawn to the development of intelligent myoelectric prostheses with an ultimate resolution of upper-limb gestures prediction. Recent research involves Deep CNNs, RNNs, and hybrid frameworks, which have shown promising results. However, deep-learning models have almost always been challenged by the structural complexity, the large number of trainable parameters, concerns of overfitting, and prolonged training time, which complicate the practicality and limit the outcomes. In this letter, for the first time, we propose temporal-dilation in the LSTM module of a hybrid Deepnet model for sEMG-based gesture detection, hypothesizing improved accuracy and training agility. We also analyze the effect of dilation-aggressiveness. We conduct systematic and statistical analysis on the efficacy of the proposed approach in comparison to recent literature, including our previous work. this letter shows that the proposed temporally-dilated LSTM model wins over the recent deep-learning techniques in terms of accuracy, and more significantly, it reduces the training time while increasing the convergence speed, with the ultimate goal of maximizing practicality and translational value for neurorobotic systems.
引用
收藏
页码:6212 / 6219
页数:8
相关论文
共 57 条
[1]  
Allard UC, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P2464, DOI 10.1109/IROS.2016.7759384
[2]  
[Anonymous], 2017, ARXIV171002224
[3]   Differentiating Variations in Thumb Position From Recordings of the Surface Electromyogram in Adults Performing Static Grips, a Proof of Concept Study [J].
Aranceta-Garza, Alejandra ;
Conway, Bernard Arthur .
FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2019, 7
[4]   Stronger, Smarter, Softer Next-Generation Wearable Robots [J].
Asbeck, Alan T. ;
De Rossi, Stefano M. M. ;
Galiana, Ignacio ;
Ding, Ye ;
Walsh, Conor J. .
IEEE ROBOTICS & AUTOMATION MAGAZINE, 2014, 21 (04) :22-33
[5]   Haptics-enabled Interactive NeuroRehabilitation Mechatronics: Classification, Functionality, Challenges and Ongoing Research [J].
Atashzar, Seyed Farokh ;
Shahbazi, Mahya ;
Patel, Rajni V. .
MECHATRONICS, 2019, 57 :1-19
[6]   Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands [J].
Atzori, Manfredo ;
Cognolato, Matteo ;
Mueller, Henning .
FRONTIERS IN NEUROROBOTICS, 2016, 10
[7]   Electromyography data for non-invasive naturally-controlled robotic hand prostheses [J].
Atzori, Manfredo ;
Gijsberts, Arjan ;
Castellini, Claudio ;
Caputo, Barbara ;
Hager, Anne-Gabrielle Mittaz ;
Elsig, Simone ;
Giatsidis, Giorgio ;
Bassetto, Franco ;
Muller, Henning .
SCIENTIFIC DATA, 2014, 1
[8]   Mechanical design and performance specifications of anthropomorphic prosthetic hands: A review [J].
Belter, Joseph T. ;
Segil, Jacob L. ;
Dollar, Aaron M. ;
Weir, Richard F. .
JOURNAL OF REHABILITATION RESEARCH AND DEVELOPMENT, 2013, 50 (05) :599-617
[9]   Stable Responsive EMG Sequence Prediction and Adaptive Reinforcement With Temporal Convolutional Networks [J].
Betthauser, Joseph L. ;
Krall, John T. ;
Bannowsky, Shain G. ;
Levay, Gyorgy ;
Kaliki, Rahul R. ;
Fifer, Matthew S. ;
Thakor, Nitish, V .
IEEE TRANSACTIONS ON BIOMEDICAL ENGINEERING, 2020, 67 (06) :1707-1717
[10]   The roles of predisposing characteristics, established need, and enabling resources on upper extremity prosthesis use and abandonment [J].
Biddiss, Elaine ;
Chau, Tom .
DISABILITY AND REHABILITATION-ASSISTIVE TECHNOLOGY, 2007, 2 (02) :71-84