sEMG-Based Multi-view Feature-Constrained Representation Learning

被引:0
作者
Yan, Shuo [1 ]
Dai, Hongjun [1 ]
Wang, Ruomei [1 ]
Zhang, Long [1 ]
Wang, Guan [1 ]
机构
[1] Shandong Univ, Jinan, Peoples R China
来源
KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT I, KSEM 2024 | 2024年 / 14884卷
关键词
Surface electromyography; multi-view representation learning; patient classification; consensus and complementarity; adversarial training;
D O I
10.1007/978-981-97-5492-2_25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The information contained in sparse multi-channel sEMG signals is limited, which requires a high standard for feature representation learning. Based on this, some solutions involve using multiple features to construct multiple views in order to extract more information, but previous methods mostly focus on divergent learning and merging shared information, without considering the inherent characteristics of multi-view data, leading to often existing distribution gaps and information redundancy in feature representation. In view of this problem, we propose a multi-view feature constraint representation learning method based on sEMG, which is divided into three parts. The first part constructs a dedicated encoder for each view, the second part focuses on extracting the shared and specific representations of different views, and uses multiple constraints to balance the sharing, complementation, and redundancy of information. The third part constructs a multi-feature low-rank fusion module to get the final representation for different downstream tasks. We take patient classification as the downstream task. Experiments conducted on DB1, DB5, Myo three datasets show that our method has significant advantages.
引用
收藏
页码:322 / 333
页数:12
相关论文
共 23 条
[1]   Deep Learning with Convolutional Neural Networks Applied to Electromyography Data: A Resource for the Classification of Movements for Prosthetic Hands [J].
Atzori, Manfredo ;
Cognolato, Matteo ;
Mueller, Henning .
FRONTIERS IN NEUROROBOTICS, 2016, 10
[2]   Electromyography data for non-invasive naturally-controlled robotic hand prostheses [J].
Atzori, Manfredo ;
Gijsberts, Arjan ;
Castellini, Claudio ;
Caputo, Barbara ;
Hager, Anne-Gabrielle Mittaz ;
Elsig, Simone ;
Giatsidis, Giorgio ;
Bassetto, Franco ;
Muller, Henning .
SCIENTIFIC DATA, 2014, 1
[3]   Hand Gesture Recognition based on Surface Electromyography using Convolutional Neural Network with Transfer Learning Method [J].
Chen, Xiang ;
Li, Yu ;
Hu, Ruochen ;
Zhang, Xu ;
Chen, Xun .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2021, 25 (04) :1292-1304
[4]   Deep Learning for Electromyographic Hand Gesture Signal Classification Using Transfer Learning [J].
Cote-Allard, Ulysse ;
Fall, Cheikh Latyr ;
Drouin, Alexandre ;
Campeau-Lecours, Alexandre ;
Gosselin, Clement ;
Glette, Kyrre ;
Laviolette, Francois ;
Gosselin, Benoit .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2019, 27 (04) :760-771
[5]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[6]   MISA: Modality-Invariant and -Specific Representations for Multimodal Sentiment Analysis [J].
Hazarika, Devamanyu ;
Zimmermann, Roger ;
Poria, Soujanya .
MM '20: PROCEEDINGS OF THE 28TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, 2020, :1122-1131
[7]   A novel attention-based hybrid CNN-RN N architecture for sEMG-based gesture recognition [J].
Hu, Yu ;
Wong, Yongkang ;
Wei, Wentao ;
Du, Yu ;
Kankanhalli, Mohan ;
Geng, Weidong .
PLOS ONE, 2018, 13 (10)
[8]   Semi-Supervised Multi-View Deep Discriminant Representation Learning [J].
Jia, Xiaodong ;
Jing, Xiao-Yuan ;
Zhu, Xiaoke ;
Chen, Songcan ;
Du, Bo ;
Cai, Ziyun ;
He, Zhenyu ;
Yue, Dong .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (07) :2496-2509
[9]  
Li G., 2023, IEEE J. Biomed. Health Inform., P1
[10]   MVHANet: multi-view hierarchical aggregation network for skeleton-based hand gesture recognition [J].
Li, Shaochen ;
Liu, Zhenyu ;
Duan, Guifang ;
Tan, Jianrong .
SIGNAL IMAGE AND VIDEO PROCESSING, 2023, 17 (05) :2521-2529