Foot Gesture Recognition Through Dual Channel Wearable EMG System

被引:29
作者
Maragliulo, Simone [1 ]
Lopes, Pedro Filipe Alhais [1 ]
Osorio, Luis Bica [1 ]
De Almeida, Anibal T. [1 ]
Tavakoli, Mahmoud [1 ]
机构
[1] Univ Coimbra, Inst Sistemas & Robot, P-3030194 Coimbra, Portugal
关键词
Electromyography; support vector machine; foot gesture classification; HMI; wearable sensing; hands-free control; HAND; ELECTROMYOGRAPHY; CLASSIFICATION; ELECTRODES; INTERFACE; WALKING; ARM;
D O I
10.1109/JSEN.2019.2931715
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface electromyography (sEMG)-based hand gesture recognition (HGR) is finding its application as a general-purpose wearable human machine interface (HMI). However, the same is rarely explored for foot gesture recognition (FGR). The FGR is interesting as a hands-free controller, e.g. in case of an electric guitar player who controls the musical effects by foot pedals. Yet, the FGR is challenging, since general leg movements such as walking can be classified as foot gestures. In this paper, the application of a minimalistic sEMG wearable footband is demonstrated as a hands-free HMI. With only two channels and a support vector machine (SVM) classifier, the system is able to classify five foot gestures. In addition, we added a locking/unlocking mechanism and also controlled by one of the gestures, which eliminates undesired gesture classification during general leg movements. We show that the gesture-controlled locking feature is robust, and system does not unlock during walking, jumping, climbing the stairs, and similar. This paper covers the system design, the real-time classification algorithm, the selection of the target muscles, and experimental results. Sessions independence, accuracy, and robustness of the device are tested in a total of 18 sessions with three volunteers having different usage skills. As case study, the system was interfaced with a Window 10 application developed for controlling musical effects with the foot wearable band as a hands-free alternative for the DJ mixer equipment.
引用
收藏
页码:10187 / 10197
页数:11
相关论文
共 35 条
[11]   Hydroprinted Electronics: Ultrathin Stretchable Ag-In-Ga E-Skin for Bioelectronics and Human-Machine Interaction [J].
Lopes, Pedro Alhais ;
Paisana, Hugo ;
De Almeida, Anibal T. ;
Majidi, Carmel ;
Tavakoli, Mahmoud .
ACS APPLIED MATERIALS & INTERFACES, 2018, 10 (45) :38760-38768
[12]   Controlling an artificial arm with foot movements [J].
Luzzio, CC .
NEUROREHABILITATION AND NEURAL REPAIR, 2000, 14 (03) :207-212
[13]  
LYONS L, 2015, WOMEN ASIA SER, P1
[14]   Reliable interfaces for EGaIn multi-layer stretchable circuits and microelectronics [J].
Marques, Daniel Green ;
Lopes, Pedro Alhais ;
de Almeida, Anibal T. ;
Majidi, Carmel ;
Tavakoli, Mahmoud .
LAB ON A CHIP, 2019, 19 (05) :897-906
[15]   Overground vs. treadmill walking on biomechanical energy harvesting: An energetics and EMG study [J].
Martin, Jean-Paul ;
Li, Qingguo .
GAIT & POSTURE, 2017, 52 :124-128
[16]   Twin SVM for Gesture Classification Using the Surface Electromyogram [J].
Naik, Ganesh R. ;
Kumar, Dinesh Kant ;
Jayadeva .
IEEE TRANSACTIONS ON INFORMATION TECHNOLOGY IN BIOMEDICINE, 2010, 14 (02) :301-308
[17]  
Nor MNM, 2016, 2016 IEEE SYMPOSIUM ON COMPUTER APPLICATIONS & INDUSTRIAL ELECTRONICS (ISCAIE), P226, DOI 10.1109/ISCAIE.2016.7575068
[18]   Portable EMG Data Acquisition Module for Upper Limb Prosthesis Application [J].
Pancholi, Sidharth ;
Joshi, Amit M. .
IEEE SENSORS JOURNAL, 2018, 18 (08) :3436-3443
[19]   A Smart Textile Based Facial EMG and EOG Computer Interface [J].
Paul, Gordon Mark ;
Cao, Fan ;
Torah, Russel ;
Yang, Kai ;
Beeby, Steve ;
Tudor, John .
IEEE SENSORS JOURNAL, 2014, 14 (02) :393-400
[20]  
Platt JC, 1999, ADVANCES IN KERNEL METHODS, P185