A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 09期
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [21] Image Classification of Pests with Residual Neural Network Based on Transfer Learning
    Li, Chen
    Zhen, Tong
    Li, Zhihui
    APPLIED SCIENCES-BASEL, 2022, 12 (09):
  • [22] Application of Convolutional Neural Network Based on Transfer Learning for Garbage Classification
    Cao, Li
    Xiang, Wei
    PROCEEDINGS OF 2020 IEEE 5TH INFORMATION TECHNOLOGY AND MECHATRONICS ENGINEERING CONFERENCE (ITOEC 2020), 2020, : 1032 - 1036
  • [23] Waste image classification based on transfer learning and convolutional neural network
    Zhang, Qiang
    Yang, Qifan
    Zhang, Xujuan
    Bao, Qiang
    Su, Jinqi
    Liu, Xueyan
    WASTE MANAGEMENT, 2021, 135 (135) : 150 - 157
  • [24] A Transfer-Learning-Based Novel Convolution Neural Network for Melanoma Classification
    Qureshi, Mohammad Naved
    Umar, Mohammad Sarosh
    Shahab, Sana
    COMPUTERS, 2022, 11 (05)
  • [25] Performance Analysis of Deep Neural Network based on Transfer Learning for Pet Classification
    Jaiswal, Bhavesh
    Gajjar, Nagendra
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (03) : 80 - 85
  • [26] Sound event classification using deep neural network based transfer learning
    Lim, Hyungjun
    Kim, Myung Jong
    Kim, Hoirin
    JOURNAL OF THE ACOUSTICAL SOCIETY OF KOREA, 2016, 35 (02): : 143 - 148
  • [27] Crop pest classification based on deep convolutional neural network and transfer learning
    Thenmozhi, K.
    Reddy, U. Srinivasulu
    COMPUTERS AND ELECTRONICS IN AGRICULTURE, 2019, 164
  • [28] Attention Multibranch Convolutional Neural Network for Hyperspectral Image Classification Based on Adaptive Region Search
    Feng, Jie
    Wu, Xiande
    Shang, Ronghua
    Sui, Chenhong
    Li, Jie
    Jiao, Licheng
    Zhang, Xiangrong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (06): : 5054 - 5070
  • [29] Microseismic Event Recognition and Transfer Learning Based on Convolutional Neural Network and Attention Mechanisms
    Jin, Shu
    Zhang, Shichao
    Gao, Ya
    Yu, Benli
    Zhen, Shenglai
    APPLIED GEOPHYSICS, 2024,
  • [30] Transfer Learning Based Convolutional Neural Network for Classification of Remote Sensing Images
    Ramasamy, Meena Prakash
    Krishnasamy, Valarmathi
    Ramapackiam, Shantha Selva Kumari
    ADVANCES IN ELECTRICAL AND COMPUTER ENGINEERING, 2023, 23 (04) : 31 - 40