A Frequency-Based Attention Neural Network and Subject-Adaptive Transfer Learning for sEMG Hand Gesture Classification

被引:2
|
作者
Nguyen, Phuc Thanh-Thien [1 ]
Su, Shun-Feng [1 ]
Kuo, Chung-Hsien [2 ]
机构
[1] Natl Taiwan Univ Sci & Technol, Dept Elect Taipei, Taipei 106, Taiwan
[2] Natl Taiwan Univ, Dept Mech Engn, Taipei 106, Taiwan
来源
IEEE ROBOTICS AND AUTOMATION LETTERS | 2024年 / 9卷 / 09期
关键词
Feature extraction; Transfer learning; Transforms; Gesture recognition; Neural networks; Muscles; Fast Fourier transforms; Frequency-based attention; fourier transform; short-time fourier transform; class-imbalanced classification; surface electromyography (sEMG);
D O I
10.1109/LRA.2024.3433748
中图分类号
TP24 [机器人技术];
学科分类号
080202 ; 1405 ;
摘要
This study introduces a novel approach for real-time hand gesture classification through the integration of a Frequency-based Attention Neural Network (FANN) with Subject-Adaptive Transfer Learning, specifically tailored for surface electromyography (sEMG) data. By utilizing the Fourier transform, the proposed methodology leverages the inherent frequency characteristics of sEMG signals to enhance the discriminative features for accurate gesture recognition. Additionally, the subject-adaptive transfer learning strategy is employed to improve model generalization across different individuals. The combination of these techniques results in an effective and versatile system for sEMG-based hand gesture classification, demonstrating promising performance in adapting individual variability and improving classification accuracy. The proposed method's performance is evaluated and compared with established approaches using the publicity available NinaPro DB5 dataset. Notably, the proposed simple model, coupled with frequency-based attention modules, achieves accuracies of 89.56% with a quick prediction time of 5ms, showcasing its potential for dexterous control of robots and bionic hands. The findings of this research contribute to the advancement of gesture recognition systems, particularly in the domains of human-computer interaction and prosthetic control.
引用
收藏
页码:7835 / 7842
页数:8
相关论文
共 50 条
  • [1] Deep Learning with Attention on Hand Gesture Recognition Based on sEMG
    Zhao, Huanjun
    Zheng, Bin
    Wang, Le
    2022 PROGNOSTICS AND HEALTH MANAGEMENT CONFERENCE, PHM-LONDON 2022, 2022, : 316 - 320
  • [2] Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG
    Shenyilang Zhang
    Yinfeng Fang
    Jiacheng Wan
    Guozhang Jiang
    Gongfa Li
    Journal of Medical and Biological Engineering, 2023, 43 : 672 - 688
  • [3] Transfer Learning Enhanced Cross-Subject Hand Gesture Recognition with sEMG
    Zhang, Shenyilang
    Fang, Yinfeng
    Wan, Jiacheng
    Jiang, Guozhang
    Li, Gongfa
    JOURNAL OF MEDICAL AND BIOLOGICAL ENGINEERING, 2023, 43 (06) : 672 - 688
  • [4] Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method
    Chen, Xiang
    Li, Yu
    Hu, Ruochen
    Zhang, Xu
    Chen, Xun
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (04) : 1292 - 1304
  • [5] A Transfer Learning Strategy for Cross-Subject and Cross-Time Hand Gesture Recognition Based on A-Mode Ultrasound
    Lian, Yue
    Lu, Zongxing
    Huang, Xin
    Shangguan, Qican
    Yao, Ligang
    Huang, Jie
    Liu, Zhoujie
    IEEE SENSORS JOURNAL, 2024, 24 (10) : 17183 - 17192
  • [6] DeepTPA-Net: A Deep Triple Attention Network for sEMG-Based Hand Gesture Recognition
    Li, Qingqing
    Luo, Zhirui
    Qi, Ruobin
    Zheng, Jun
    IEEE ACCESS, 2023, 11 : 96797 - 96807
  • [7] A Multi-Scale CNN for Transfer Learning in sEMG-Based Hand Gesture Recognition for Prosthetic Devices
    Fratti, Riccardo
    Marini, Niccolo
    Atzori, Manfredo
    Mueller, Henning
    Tiengo, Cesare
    Bassetto, Franco
    SENSORS, 2024, 24 (22)
  • [8] Subject-Adaptive Transfer Learning Using Resting State EEG Signals for Cross-Subject EEG Motor Imagery Classification
    An, Sion
    Kang, Myeongkyun
    Kim, Soopil
    Chikontwe, Philip
    Shen, Li
    Park, Sang Hyun
    MEDICAL IMAGE COMPUTING AND COMPUTER ASSISTED INTERVENTION - MICCAI 2024, PT XI, 2024, 15011 : 678 - 688
  • [9] Content-Adaptive and Attention-Based Network for Hand Gesture Recognition
    Cao, Zongjing
    Li, Yan
    Shin, Byeong-Seok
    APPLIED SCIENCES-BASEL, 2022, 12 (04):
  • [10] Multistage Spatial Attention-Based Neural Network for Hand Gesture Recognition
    Miah, Abu Saleh Musa
    Hasan, Md. Al Mehedi
    Shin, Jungpil
    Okuyama, Yuichi
    Tomioka, Yoichi
    COMPUTERS, 2023, 12 (01)