Hilbert sEMG data scanning for hand gesture recognition based on deep learning

被引:24
作者
Tsinganos, Panagiotis [1 ,2 ]
Cornelis, Bruno [2 ,3 ]
Cornelis, Jan [2 ]
Jansen, Bart [2 ,3 ]
Skodras, Athanassios [1 ]
机构
[1] Univ Patras, Dept Elect & Comp Engn, Patras 26504, Greece
[2] Vrije Univ Brussel, Dept Elect & Informat, B-1050 Brussels, Belgium
[3] IMEC, B-3001 Leuven, Belgium
关键词
Hilbert curve; Hand gesture recognition; sEMG; Electromyography; Classification; CNN; Deep learning; Multi-scale; PATTERN-RECOGNITION; ELECTRODE NUMBER; EMG SIGNALS; SURFACE EMG; ROBUST; REHABILITATION; EXTRACTION; SHIFT;
D O I
10.1007/s00521-020-05128-7
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Deep learning has transformed the field of data analysis by dramatically improving the state of the art in various classification and prediction tasks, especially in the area of computer vision. In biomedical engineering, a lot of new work is directed toward surface electromyography (sEMG)-based gesture recognition, often addressed as an image classification problem using convolutional neural networks (CNNs). In this paper, we utilize the Hilbert space-filling curve for the generation of image representations of sEMG signals, which allows the application of typical image processing pipelines such as CNNs on sequence data. The proposed method is evaluated on different state-of-the-art network architectures and yields a significant classification improvement over the approach without the Hilbert curve. Additionally, we develop a new network architecture (MSHilbNet) that takes advantage of multiple scales of an initial Hilbert curve representation and achieves equal performance with fewer convolutional layers.
引用
收藏
页码:2645 / 2666
页数:22
相关论文
共 54 条
  • [1] Anjum MM, 2019, CNN MODEL HILBERT CU
  • [2] [Anonymous], 2018, SPATIAL MAPPING ALGO
  • [3] Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands
    Atzori, Manfredo
    Cognolato, Matteo
    Mueller, Henning
    [J]. FRONTIERS IN NEUROROBOTICS, 2016, 10
  • [4] Electromyography data for non-invasive naturally-controlled robotic hand prostheses
    Atzori, Manfredo
    Gijsberts, Arjan
    Castellini, Claudio
    Caputo, Barbara
    Hager, Anne-Gabrielle Mittaz
    Elsig, Simone
    Giatsidis, Giorgio
    Bassetto, Franco
    Muller, Henning
    [J]. SCIENTIFIC DATA, 2014, 1
  • [5] Atzori M, 2012, P IEEE RAS-EMBS INT, P1258, DOI 10.1109/BioRob.2012.6290287
  • [6] Hybrid LSTM and Encoder-Decoder Architecture for Detection of Image Forgeries
    Bappy, Jawadul H.
    Simons, Cody
    Nataraj, Lakshmanan
    Manjunath, B. S.
    Roy-Chowdhury, Amit K.
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (07) : 3286 - 3300
  • [7] Multi-subject/daily-life activity EMG-based control of mechanical hands
    Castellini, Claudio
    Fiorilla, Angelo Emanuele
    Sandini, Giulio
    [J]. JOURNAL OF NEUROENGINEERING AND REHABILITATION, 2009, 6
  • [8] A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities
    Chang, Yao-Jen
    Chen, Shu-Fang
    Huang, Jun-Da
    [J]. RESEARCH IN DEVELOPMENTAL DISABILITIES, 2011, 32 (06) : 2566 - 2570
  • [9] A review of hand gesture and sign language recognition techniques
    Cheok, Ming Jin
    Omar, Zaid
    Jaward, Mohamed Hisham
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (01) : 131 - 153
  • [10] Cot^e-<prime>Allard U., 2018, DEEP LEARNING ELECTR