A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 09期
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [11] Hand Gesture Classification Using Inertial Based Sensors via a Neural Network
    Akan, Erhan
    Tora, Hakan
    Uslu, Baran
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON ELECTRONICS, CIRCUITS AND SYSTEMS (ICECS), 2017, : 140 - 143
  • [12] Remote Sensing Image Classification using Transfer Learning and Attention Based Deep Neural Network
    Pham, Lam
    Tran, Khoa
    Ngo, Dat
    Lampert, Jasmin
    Schindler, Alexander
    IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVIII, 2022, 12267
  • [13] Surface EMG-Based Instantaneous Hand Gesture Recognition Using Convolutional Neural Network with the Transfer Learning Method
    Yu, Zhipeng
    Zhao, Jianghai
    Wang, Yucheng
    He, Linglong
    Wang, Shaonan
    SENSORS, 2021, 21 (07)
  • [14] Myoelectric Control of a Biomimetic Robotic Hand Using Deep Learning Artificial Neural Network for Gesture Classification
    Kashizadeh, Afsaneh
    Penan, Klyde
    Belford, Andrew
    Razmjou, Amir
    Asadnia, Mohsen
    IEEE SENSORS JOURNAL, 2022, 22 (19) : 18914 - 18921
  • [15] Convolution Neural Network based Transfer Learning for Classification of Flowers
    Wu, Yong
    Qin, Xiao
    Pan, Yonghua
    Yuan, Changan
    2018 IEEE 3RD INTERNATIONAL CONFERENCE ON SIGNAL AND IMAGE PROCESSING (ICSIP), 2018, : 562 - 566
  • [16] Image Classification Based on transfer Learning of Convolutional neural network
    Wang, Yunyan
    Wang, Chongyang
    Luo, Lengkun
    Zhou, Zhigang
    PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC), 2019, : 7506 - 7510
  • [17] Heterogeneous Transfer Learning for Hyperspectral Image Classification Based on Convolutional Neural Network
    He, Xin
    Chen, Yushi
    Ghamisi, Pedram
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (05): : 3246 - 3263
  • [18] Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition
    Tayyip Ozcan
    Alper Basturk
    Neural Computing and Applications, 2019, 31 : 8955 - 8970
  • [19] Transfer learning-based convolutional neural networks with heuristic optimization for hand gesture recognition
    Ozcan, Tayyip
    Basturk, Alper
    NEURAL COMPUTING & APPLICATIONS, 2019, 31 (12) : 8955 - 8970
  • [20] Adaptive transfer learning for EEG motor imagery classification with deep Convolutional Neural Network
    Zhang, Kaishuo
    Robinson, Neethu
    Lee, Seong-Whan
    Guan, Cuntai
    NEURAL NETWORKS, 2021, 136 : 1 - 10