Complex Surface Electromyography Signal Gesture Recognition Based on Multipathway Featured Scale Convolutional Neural Network

被引:0
作者
Liu, Tie [1 ]
Bai, Dianchun [1 ]
Ma, Le [2 ]
Du, Qiang [1 ]
Yokoi, Hiroshi [3 ]
机构
[1] Shenyang Univ Technol, Sch Elect Engn, Shenyang 110870, Peoples R China
[2] Northeast Elect Power Univ, Sch Automa Engn, Jilin 132012, Peoples R China
[3] Univ Electrocommun, Dept Mech & Intelligent Syst Engn, Chofu 1828585, Japan
基金
中国国家自然科学基金;
关键词
Convolutional neural networks (CNNs); electromyography; feature extraction; hand gesture recognition; muscle activity; signal processing algorithms;
D O I
10.1109/TIM.2024.3485448
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface electromyography-based gesture recognition and prosthetic hand control using deep learning (DL) have become increasingly significant in the field of human-computer interaction. This study aims to enhance the control of prosthetic hands driven by complex gestures, addressing the challenge of low-resolution gesture differentiation caused by the coupling and superposition of surface electromyography signals in DL models. We propose a DL-based framework for the recognition of complex surface electromyography signals, utilizing a multipathway approach to acquire raw surface electromyography signals, process them in the time-frequency domain, and extract features using multiscale convolutional networks. The processed surface electromyography features are then analyzed in parallel to enhance accuracy. This method effectively processes multiple signals concurrently and extracts diverse feature sets. By collecting data from six channels, it achieves an 88.56% recognition rate for 16 complex hand gestures, enabling control of ten distinct prosthetic hand movements. By leveraging multidimensional continuous surface electromyography images, we have developed a feature model that resolves the issues of signal coupling and superposition in multichannel surface electromyography data, allowing for precise control of prosthetic hand movements.
引用
收藏
页数:11
相关论文
共 39 条
[1]   Electromyography data for non-invasive naturally-controlled robotic hand prostheses [J].
Atzori, Manfredo ;
Gijsberts, Arjan ;
Castellini, Claudio ;
Caputo, Barbara ;
Hager, Anne-Gabrielle Mittaz ;
Elsig, Simone ;
Giatsidis, Giorgio ;
Bassetto, Franco ;
Muller, Henning .
SCIENTIFIC DATA, 2014, 1
[2]   Estimating finger joint angles on surface EMG using Manifold Learning and Long Short-Term Memory with Attention mechanism [J].
Avian, Cries ;
Prakosa, Setya Widyawan ;
Faisal, Muhamad ;
Leu, Jenq-Shiou .
BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 71
[3]   A CNN-LSTM Hybrid Model for Wrist Kinematics Estimation Using Surface Electromyography [J].
Bao, Tianzhe ;
Zaidi, Syed Ali Raza ;
Xie, Shengquan ;
Yang, Pengfei ;
Zhang, Zhi-Qiang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2021, 70
[4]   Three-Electrode Double-Differential Biopotential Amplifier for Surface EMG Measurements [J].
Catacora, Valentin A. ;
Guerrero, Federico N. ;
Spinelli, Enrique M. .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[5]   High-Density Surface EMG-Based Gesture Recognition Using a 3D Convolutional Neural Network [J].
Chen, Jiangcheng ;
Bi, Sheng ;
Zhang, George ;
Cao, Guangzhong .
SENSORS, 2020, 20 (04)
[6]  
Clevert DA, 2016, Arxiv, DOI [arXiv:1511.07289, 10.48550/arXiv.1511.07289]
[7]   Filtering the surface EMG signal: Movement artifact and baseline noise contamination [J].
De Luca, Carlo J. ;
Gilmore, L. Donald ;
Kuznetsov, Mikhail ;
Roy, Serge H. .
JOURNAL OF BIOMECHANICS, 2010, 43 (08) :1573-1579
[8]   CSAC-Net: Fast Adaptive sEMG Recognition through Attention Convolution Network and Model-Agnostic Meta-Learning [J].
Fan, Xinchen ;
Zou, Lancheng ;
Liu, Ziwu ;
He, Yanru ;
Zou, Lian ;
Chi, Ruan .
SENSORS, 2022, 22 (10)
[9]   A Multifeatured Time-Frequency Neural Network System for Classifying sEMG [J].
Gao, Zhongke ;
Wang, Yangyang ;
Sun, Xinlin ;
Chen, Peiyin ;
Ma, Chao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS II-EXPRESS BRIEFS, 2022, 69 (11) :4588-4592
[10]  
Gultekin E., 2023, P MED TECHN C TIPTEK, P1, DOI [10.1109/TIPTEKNO59875.2023, DOI 10.1109/TIPTEKNO59875.2023]