A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 09期
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [41] Automated tomato leaf disease classification using transfer learning-based deep convolution neural network
    Thangaraj, Rajasekaran
    Anandamurugan, S.
    Kaliappan, Vishnu Kumar
    JOURNAL OF PLANT DISEASES AND PROTECTION, 2021, 128 (01) : 73 - 86
  • [42] Automated tomato leaf disease classification using transfer learning-based deep convolution neural network
    Rajasekaran Thangaraj
    S. Anandamurugan
    Vishnu Kumar Kaliappan
    Journal of Plant Diseases and Protection, 2021, 128 : 73 - 86
  • [43] Hyperspectral Image Classification Based on a Shuffled Group Convolutional Neural Network with Transfer Learning
    Liu, Yao
    Gao, Lianru
    Xiao, Chenchao
    Qu, Ying
    Zheng, Ke
    Marinoni, Andrea
    REMOTE SENSING, 2020, 12 (11)
  • [44] A Transfer Learning Method based on VGG-16 Convolutional Neural Network for MI Classification
    Li, Ming-Ai
    Xu, Dong-Qin
    PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 5430 - 5435
  • [45] Automatic classification of retinal diseases with transfer learning-based lightweight convolutional neural network
    Lu, Zhenzhen
    Miao, Jingpeng
    Dong, Jingran
    Zhu, Shuyuan
    Wang, Xiaobing
    Feng, Jihong
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 81
  • [46] Classification of Lower Limb Electromyographical Signals Based on Autoencoder Deep Neural Network Transfer Learning
    Daryakenari, F. H.
    Mollahossein, M.
    Taheri, A.
    Vossoughi, G. R.
    2022 10TH RSI INTERNATIONAL CONFERENCE ON ROBOTICS AND MECHATRONICS (ICROM), 2022, : 323 - 328
  • [47] Transfer learning-based approach using new convolutional neural network classifier for steel surface defects classification
    Ibrahim, Alaa Aldein M. S.
    Tapamo, Jules R.
    SCIENTIFIC AFRICAN, 2024, 23
  • [48] Multi-label learning based deep transfer neural network for facial attribute classification
    Zhuang, Ni
    Yan, Yan
    Chen, Si
    Wang, Hanzi
    Shen, Chunhua
    PATTERN RECOGNITION, 2018, 80 : 225 - 240
  • [49] Multi-Source Transfer Learning for EEG Classification Based on Domain Adversarial Neural Network
    Liu, Dezheng
    Zhang, Jia
    Wu, Hanrui
    Liu, Siwei
    Long, Jinyi
    IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2023, 31 : 218 - 228
  • [50] Raman spectrum classification based on transfer learning by a convolutional neural network: Application to pesticide detection
    Hu, Jiaqi
    Zou, Yanqiu
    Sun, Biao
    Yu, Xinyao
    Shang, Ziyang
    Huang, Jie
    Jin, Shangzhong
    Liang, Pei
    SPECTROCHIMICA ACTA PART A-MOLECULAR AND BIOMOLECULAR SPECTROSCOPY, 2022, 265