A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 09期
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [31] Analysis of transfer learning for deep neural network based plant classification models
    Kaya, Aydin
    Keceli, Ali Seydi
    Catal, Cagatay
    Yalic, Hamdi Yalin
    Temucin, Huseyin
    Tekinerdogan, Bedir
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 158 : 20 - 29
  • [32] Attention-based convolutional neural network deep learning approach for robust malware classification
    Ravi, Vinayakumar
    Alazab, Mamoun
    COMPUTATIONAL INTELLIGENCE, 2023, 39 (01) : 145 - 168
  • [33] RCSnet-Flower Classification Network Design Based on Transfer Learning and Channel Attention Mechanism
    Mao, Zijun
    Zhong, Tianyu
    Wei, Mojieming
    Hu, Runjie
    Liu, Jianzheng
    ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT III, ICIC 2024, 2024, 14864 : 48 - 59
  • [34] Tread Pattern Image Classification using Convolutional Neural Network Based on Transfer Learning
    Liu, Ying
    Zhang, Shuai
    Wang, Fuping
    Ling, Nam
    PROCEEDINGS OF THE 2018 IEEE INTERNATIONAL WORKSHOP ON SIGNAL PROCESSING SYSTEMS (SIPS), 2018, : 300 - 305
  • [35] Bangladeshi Native Vehicle Classification Based on Transfer Learning with Deep Convolutional Neural Network
    Hasan, Md Mahibul
    Wang, Zhijie
    Hussain, Muhammad Ather Iqbal
    Fatima, Kaniz
    SENSORS, 2021, 21 (22)
  • [36] Classification of Appearance Quality of Red Grape Based on Transfer Learning of Convolution Neural Network
    Zha, Zhihua
    Shi, Dongyuan
    Chen, Xiaohui
    Shi, Hui
    Wu, Jie
    AGRONOMY-BASEL, 2023, 13 (08):
  • [37] Classification of Domestic Refuse in Medical Institutions Based on Transfer Learning and Convolutional Neural Network
    Guo, Dequan
    Yang, Qiao
    Zhang, Yu-Dong
    Jiang, Tao
    Yan, Hanbing
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2021, 127 (02): : 599 - 620
  • [38] Hyperspectral Image Classification Based on Superpixel Pooling Convolutional Neural Network with Transfer Learning
    Xie, Fuding
    Gao, Quanshan
    Jin, Cui
    Zhao, Fengxia
    REMOTE SENSING, 2021, 13 (05) : 1 - 17
  • [39] Performance analysis of static hand gesture recognition approaches using artificial neural network, support vector machine and two stream based transfer learning approach
    Patil A.R.
    Subbaraman S.
    International Journal of Information Technology, 2022, 14 (7) : 3781 - 3792
  • [40] Vocal cord lesions classification based on deep convolutional neural network and transfer learning
    Zhao, Qian
    He, Yuqing
    Wu, Yanda
    Huang, Dongyan
    Wang, Yang
    Sun, Cai
    Ju, Jun
    Wang, Jiasen
    Jianshuo-li Mahr, Jeremy
    MEDICAL PHYSICS, 2022, 49 (01) : 432 - 442