Deep Heterogeneous Dilation of LSTM for Transient-Phase Gesture Prediction Through High-Density Electromyography: Towards Application in Neurorobotics

被引:12
作者
Sun, Tianyun [1 ,2 ]
Hu, Qin [1 ]
Libby, Jacqueline [3 ]
Atashzar, S. Farokh [1 ,3 ,4 ,5 ]
机构
[1] NYU, Dept Elect & Comp Engn, New York, NY 11201 USA
[2] Facebook, Menlo Pk, CA USA
[3] NYU, Ctr Urban Sci & Progress CUSP, New York, NY 10003 USA
[4] NYU, Dept Mech & Aerosp Engn, New York, NY 11201 USA
[5] NYU, NYU WIRELESS, New York, NY 11201 USA
基金
美国国家科学基金会;
关键词
Human-centered robotics; neurorobotics; high density sEMG; temporal dilation; recurrent neural networks; EMG;
D O I
10.1109/LRA.2022.3142721
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
Deep networks have been recently proposed to estimate motor intention using conventional bipolar surface electromyography (sEMG) signals for myoelectric control of neurorobots. In this regard, Deepnets are generally challenged by long training times (affecting practicality and calibration), complex model architectures (affecting the predictability of the outcomes), and a large number of trainable parameters (increasing the need for Big Data). Capitalizing on our recent work on homogeneous temporal dilation in a Recurrent Neural Network (RNN) model, this letter proposes, for the first time, heterogeneous temporal dilation in an LSTM model and applies that to high-density surface electromyography (HD-sEMG), allowing for the decoding of dynamic temporal dependencies with tunable temporal foci. In this letter, a 128-channel HD-sEMG signal space is considered due to the potential for enhancing the spatiotemporal resolution of humanrobot interfaces. Accordingly, this letter addresses a challenging motor intention decoding problem of neurorobots, namely, transient intention identification. Our approach uses only the dynamic and transient phase of gesture movements when the signals are not stabilized or plateaued, which can significantly enhance the temporal resolution of human-robot interfaces. This would eventually enhance seamless real-time implementations. Additionally, this letter introduces the concept of "dilation foci" to modulate the modeling of temporal variation in transient phases. In this work a high number (e.g., 65) of gestures is included, which adds to the complexity and significance of the understudied problem. Our results show state-of-the-art performance for gesture prediction in terms of accuracy, training time, and model convergence.
引用
收藏
页码:2851 / 2858
页数:8
相关论文
共 44 条
  • [1] Allard UC, 2016, 2016 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS 2016), P2464, DOI 10.1109/IROS.2016.7759384
  • [2] Advancing Muscle-Computer Interfaces with High-Density Electromyography
    Amma, Christoph
    Krings, Thomas
    Boer, Jonas
    Schultz, Tanja
    [J]. CHI 2015: PROCEEDINGS OF THE 33RD ANNUAL CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2015, : 929 - 938
  • [3] Differentiating Variations in Thumb Position From Recordings of the Surface Electromyogram in Adults Performing Static Grips, a Proof of Concept Study
    Aranceta-Garza, Alejandra
    Conway, Bernard Arthur
    [J]. FRONTIERS IN BIOENGINEERING AND BIOTECHNOLOGY, 2019, 7
  • [4] Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands
    Atzori, Manfredo
    Cognolato, Matteo
    Mueller, Henning
    [J]. FRONTIERS IN NEUROROBOTICS, 2016, 10
  • [5] Electromyography data for non-invasive naturally-controlled robotic hand prostheses
    Atzori, Manfredo
    Gijsberts, Arjan
    Castellini, Claudio
    Caputo, Barbara
    Hager, Anne-Gabrielle Mittaz
    Elsig, Simone
    Giatsidis, Giorgio
    Bassetto, Franco
    Muller, Henning
    [J]. SCIENTIFIC DATA, 2014, 1
  • [6] Multi-Channel sEMG Signal Gesture Recognition Based on Improved CNN-LSTM Hybrid Models
    Bai, Dianchun
    Liu, Tie
    Han, Xinghua
    Chen, Guo
    Jiang, Yinlai
    Hiroshi, Yokoi
    [J]. 2021 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENCE AND SAFETY FOR ROBOTICS (ISR), 2021, : 111 - 116
  • [7] The roles of predisposing characteristics, established need, and enabling resources on upper extremity prosthesis use and abandonment
    Biddiss, Elaine
    Chau, Tom
    [J]. DISABILITY AND REHABILITATION-ASSISTIVE TECHNOLOGY, 2007, 2 (02) : 71 - 84
  • [8] Consumer design priorities for upper limb prosthetics
    Biddiss, Elaine
    Beaton, Dorcas
    Chau, Tom
    [J]. DISABILITY AND REHABILITATION-ASSISTIVE TECHNOLOGY, 2007, 2 (06) : 346 - 357
  • [9] Deep learning for processing electromyographic signals: A taxonomy-based survey
    Buongiorno, Domenico
    Cascarano, Giacomo Donato
    De Feudis, Irio
    Brunetti, Antonio
    Carnimeo, Leonarda
    Dimauro, Giovanni
    Bevilacqua, Vitoantonio
    [J]. NEUROCOMPUTING, 2021, 452 : 549 - 565
  • [10] Byfield R., 2021, Intent. J. Robot. Control, V3, P13, DOI [10.5430/ijrc.v3n1p13, DOI 10.5430/IJRC.V3N1P13]