Deep Heterogeneous Dilation of LSTM for Transient-Phase Gesture Prediction Through High-Density Electromyography: Towards Application in Neurorobotics

被引:12
作者
Sun, Tianyun [1 ,2 ]
Hu, Qin [1 ]
Libby, Jacqueline [3 ]
Atashzar, S. Farokh [1 ,3 ,4 ,5 ]
机构
[1] NYU, Dept Elect & Comp Engn, New York, NY 11201 USA
[2] Facebook, Menlo Pk, CA USA
[3] NYU, Ctr Urban Sci & Progress CUSP, New York, NY 10003 USA
[4] NYU, Dept Mech & Aerosp Engn, New York, NY 11201 USA
[5] NYU, NYU WIRELESS, New York, NY 11201 USA
基金
美国国家科学基金会;
关键词
Human-centered robotics; neurorobotics; high density sEMG; temporal dilation; recurrent neural networks; EMG;
D O I
10.1109/LRA.2022.3142721
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deep networks have been recently proposed to estimate motor intention using conventional bipolar surface electromyography (sEMG) signals for myoelectric control of neurorobots. In this regard, Deepnets are generally challenged by long training times (affecting practicality and calibration), complex model architectures (affecting the predictability of the outcomes), and a large number of trainable parameters (increasing the need for Big Data). Capitalizing on our recent work on homogeneous temporal dilation in a Recurrent Neural Network (RNN) model, this letter proposes, for the first time, heterogeneous temporal dilation in an LSTM model and applies that to high-density surface electromyography (HD-sEMG), allowing for the decoding of dynamic temporal dependencies with tunable temporal foci. In this letter, a 128-channel HD-sEMG signal space is considered due to the potential for enhancing the spatiotemporal resolution of humanrobot interfaces. Accordingly, this letter addresses a challenging motor intention decoding problem of neurorobots, namely, transient intention identification. Our approach uses only the dynamic and transient phase of gesture movements when the signals are not stabilized or plateaued, which can significantly enhance the temporal resolution of human-robot interfaces. This would eventually enhance seamless real-time implementations. Additionally, this letter introduces the concept of "dilation foci" to modulate the modeling of temporal variation in transient phases. In this work a high number (e.g., 65) of gestures is included, which adds to the complexity and significance of the understudied problem. Our results show state-of-the-art performance for gesture prediction in terms of accuracy, training time, and model convergence.
引用
收藏
页码:2851 / 2858
页数:8
相关论文
共 44 条
  • [31] Rahimian E, 2020, INT CONF ACOUST SPEE, P1304, DOI [10.1109/icassp40776.2020.9054586, 10.1109/ICASSP40776.2020.9054586]
  • [32] Multiday EMG-Based Classification of Hand Motions with Deep Learning Techniques
    Rehman, Muhammad Zia Ur
    Waris, Asim
    Gilani, Syed Omer
    Jochumsen, Mads
    Niazi, Imran Khan
    Jamil, Mohsin
    Farina, Dario
    Kamavuako, Ernest Nlandu
    [J]. SENSORS, 2018, 18 (08)
  • [33] Samadani A, 2018, IEEE ENG MED BIO, P1094, DOI 10.1109/EMBC.2018.8512531
  • [34] A bionic hand controlled by hand gesture recognition based on surface EMG signals: A preliminary study
    Shi, Wan-Ting
    Lyu, Zong-Jhe
    Tang, Shih-Tsang
    Chia, Tsorng-Lin
    Yang, Chia-Yen
    [J]. BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2018, 38 (01) : 126 - 135
  • [35] Adaptive Spatial Filtering of High-Density EMG for Reducing the Influence of Noise and Artefacts in Myoelectric Control
    Stachaczyk, Martyna
    Atashzar, S. Farokh
    Farina, Dario
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (07) : 1511 - 1517
  • [36] Stachaczyk M, 2019, I IEEE EMBS C NEUR E, P1080, DOI [10.1109/NER.2019.8717077, 10.1109/ner.2019.8717077]
  • [37] Temporal Dilation of Deep LSTM for Agile Decoding of sEMG: Application in Prediction of Upper-Limb Motor Intention in NeuroRobotics
    Sun, Tianyun
    Hu, Qin
    Gulati, Paras
    Atashzar, S. Farokh
    [J]. IEEE ROBOTICS AND AUTOMATION LETTERS, 2021, 6 (04) : 6212 - 6219
  • [38] A Fully Embedded Adaptive Real-Time Hand Gesture Classifier Leveraging HD-sEMG and Deep Learning
    Tam, Simon
    Boukadoum, Mounir
    Campeau-Lecours, Alexandre
    Gosselin, Benoit
    [J]. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS, 2020, 14 (02) : 232 - 243
  • [39] An Improved Performance of Deep Learning Based on Convolution Neural Network to Classify the Hand Motion by Evaluating Hyper Parameter
    Triwiyanto, Triwiyanto
    Pawana, I. Putu Alit
    Purnomo, Mauridhi Hery
    [J]. IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2020, 28 (07) : 1678 - 1688
  • [40] [周旭峰 Zhou Xufeng], 2020, [光学精密工程, Optics and Precision Engineering], V28, P424