EMG-based hand gesture classifier robust to daily variation: Recursive domain adversarial neural network with data synthesis

被引:7
作者
Lee, Donghee [1 ]
You, Dayoung [1 ]
Cho, Gyoungryul [1 ]
Lee, Hoirim [1 ]
Shin, Eunsoo [1 ]
Choi, Taehwan [1 ]
Kim, Sunghan [1 ]
Lee, Sangmin [1 ]
Nam, Woochul [1 ,2 ]
机构
[1] Chung Ang Univ, Dept Mech Engn, Seoul, South Korea
[2] Chung Ang Univ, Dept Mech Engn, 84 Heukseok Ro, Seoul 06974, South Korea
基金
新加坡国家研究基金会;
关键词
EMG; Daily variation; Domain adaptation; Data synthesis; Recursive domain adversarial neural network; PATTERN-RECOGNITION; ADAPTATION;
D O I
10.1016/j.bspc.2023.105600
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
Objective: If a supervised classification model is used to predict hand gestures using electromyography (EMG), the EMG signals for training should be labeled every day due to their daily variations. However, annotating these signals every day is time-consuming. Methods: To address this problem, this study proposes a new framework that updates the EMG classifier in a semisupervised manner; the classifier was optimized to a target day by using the labeled past EMG signals and the unlabeled signals of the target day. Specifically, the following models were integrated to maximize the classification accuracy: first, a domain-adversarial neural network (DANN) was used to account for the domain shift between the EMG signals of the past and target days. Second, the past dataset was augmented by a data synthesis model incorporated with clustering, random selection, and correlation (CRC). Lastly, a recursive DANN structure was developed to augment the unlabeled EMG signals of the target day.Results: The performance of the proposed framework was validated with EMG data of four subjects and five different days. The classification accuracies are 58.22% (without DANN), 66.65% (with DANN), and 73.67% (with recursive DANN and CRC), respectively. Conclusions: The recursive DANN with CRC enhances the domain adaptation effect, and thus it can address the daily variation problem of EMG.Significance: The proposed framework can also be extended to resolve a subject variation problem of EMG.
引用
收藏
页数:8
相关论文
共 38 条
[1]   Improving the Performance Against Force Variation of EMG Controlled Multifunctional Upper-Limb Prostheses for Transradial Amputees [J].
Al-Timemy, Ali H. ;
Khushaba, Rami N. ;
Bugmann, Guido ;
Escudero, Javier .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2016, 24 (06) :650-661
[2]   Mobile and wearable sensors for data-driven health monitoring system: State-of-the-art and future prospect [J].
Anikwe, Chioma Virginia ;
Nweke, Henry Friday ;
Ikegwu, Anayo Chukwu ;
Egwuonwu, Chukwunonso Adolphus ;
Onu, Fergus Uchenna ;
Alo, Uzoma Rita ;
Teh, Ying Wah .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 202
[3]  
Boschmann A., 2009, P 2 EUR C TECHN ASS, P18
[4]   Unsupervised Gait Phase Estimation With Domain-Adversarial Neural Network and Adaptive Window [J].
Choi, Wonseok ;
Yang, Wonseok ;
Na, Jaeyoung ;
Park, Juneil ;
Lee, Giuk ;
Nam, Woochul .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (07) :3373-3384
[5]   Investigation of Different Approaches to Real-Time Control of Prosthetic Hands With Electromyography Signals [J].
de Oliveira de Souza, Joao Olegario ;
Bloedow, Marcos Daniel ;
Rubo, Felipe Cezimbra ;
de Figueiredo, Rodrigo Marques ;
Pessin, Gustavo ;
Rigo, Sandro Jose .
IEEE SENSORS JOURNAL, 2021, 21 (18) :20674-20684
[6]   Surface EMG-Based Inter-Session Gesture Recognition Enhanced by Deep Domain Adaptation [J].
Du, Yu ;
Jin, Wenguang ;
Wei, Wentao ;
Hu, Yu ;
Geng, Weidong .
SENSORS, 2017, 17 (03)
[7]  
Ganin Y, 2016, J MACH LEARN RES, V17
[8]   Generative adversarial network and convolutional neural network-based EEG imbalanced classification model for seizure detection [J].
Gao, Bin ;
Zhou, Jiazheng ;
Yang, Yuying ;
Chi, Jinxin ;
Yuan, Qi .
BIOCYBERNETICS AND BIOMEDICAL ENGINEERING, 2022, 42 (01) :1-15
[9]   Robust EMG pattern recognition in the presence of confounding factors: features, classifiers and adaptive learning [J].
Gu, Yikun ;
Yang, Dapeng ;
Huang, Qi ;
Yang, Wei ;
Liu, Hong .
EXPERT SYSTEMS WITH APPLICATIONS, 2018, 96 :208-217
[10]   A Practical and Adaptive Method to Achieve EMG-Based Torque Estimation for a Robotic Exoskeleton [J].
Gui, Kai ;
Liu, Honghai ;
Zhang, Dingguo .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2019, 24 (02) :483-494