Foot Gesture Recognition Through Dual Channel Wearable EMG System

被引:29
作者
Maragliulo, Simone [1 ]
Lopes, Pedro Filipe Alhais [1 ]
Osorio, Luis Bica [1 ]
De Almeida, Anibal T. [1 ]
Tavakoli, Mahmoud [1 ]
机构
[1] Univ Coimbra, Inst Sistemas & Robot, P-3030194 Coimbra, Portugal
关键词
Electromyography; support vector machine; foot gesture classification; HMI; wearable sensing; hands-free control; HAND; ELECTROMYOGRAPHY; CLASSIFICATION; ELECTRODES; INTERFACE; WALKING; ARM;
D O I
10.1109/JSEN.2019.2931715
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Surface electromyography (sEMG)-based hand gesture recognition (HGR) is finding its application as a general-purpose wearable human machine interface (HMI). However, the same is rarely explored for foot gesture recognition (FGR). The FGR is interesting as a hands-free controller, e.g. in case of an electric guitar player who controls the musical effects by foot pedals. Yet, the FGR is challenging, since general leg movements such as walking can be classified as foot gestures. In this paper, the application of a minimalistic sEMG wearable footband is demonstrated as a hands-free HMI. With only two channels and a support vector machine (SVM) classifier, the system is able to classify five foot gestures. In addition, we added a locking/unlocking mechanism and also controlled by one of the gestures, which eliminates undesired gesture classification during general leg movements. We show that the gesture-controlled locking feature is robust, and system does not unlock during walking, jumping, climbing the stairs, and similar. This paper covers the system design, the real-time classification algorithm, the selection of the target muscles, and experimental results. Sessions independence, accuracy, and robustness of the device are tested in a total of 18 sessions with three volunteers having different usage skills. As case study, the system was interfaced with a Window 10 application developed for controlling musical effects with the foot wearable band as a hands-free alternative for the DJ mixer equipment.
引用
收藏
页码:10187 / 10197
页数:11
相关论文
共 35 条
[1]   Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography [J].
Al-Timemy, Ali H. ;
Bugmann, Guido ;
Escudero, Javier ;
Outram, Nicholas .
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2013, 17 (03) :608-618
[2]   Learning EMG control of a robotic hand: Towards active prostheses [J].
Bitzer, Sebastian ;
van der Smagt, Patrick .
2006 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), VOLS 1-10, 2006, :2819-+
[3]   An EMG-to-Force Processing Approach for Estimating in Vivo Hip Muscle Forces in Normal Human Walking [J].
Bogey, Ross A. ;
Barnes, Lee A. .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2017, 25 (08) :1172-1179
[4]   A wearable biomechatronic interface for controlling robots with voluntary foot movements [J].
Carrozza, Maria Chiara ;
Persichetti, Alessandro ;
Laschi, Cecilia ;
Vecchi, Fabrizio ;
Lazzarini, Roberto ;
Vacalebri, Pierpaolo ;
Dario, Paolo .
IEEE-ASME TRANSACTIONS ON MECHATRONICS, 2007, 12 (01) :1-11
[5]   Fuzzy EMG classification for prosthesis control [J].
Chan, FHY ;
Yang, YS ;
Lam, FK ;
Zhang, YT ;
Parker, PA .
IEEE TRANSACTIONS ON REHABILITATION ENGINEERING, 2000, 8 (03) :305-311
[6]   Online Myoelectric Control of a Dexterous Hand Prosthesis by Transradial Amputees [J].
Cipriani, Christian ;
Antfolk, Christian ;
Controzzi, Marco ;
Lundborg, Goran ;
Rosen, Birgitta ;
Carrozza, Maria Chiara ;
Sebelius, Fredrik .
IEEE TRANSACTIONS ON NEURAL SYSTEMS AND REHABILITATION ENGINEERING, 2011, 19 (03) :260-270
[7]  
Gabriele B., 2018, IEEE SENS J, V18, P5809
[8]   Multi-Channel Surface Electromyography Electrodes: A Review [J].
Kilby, Jeff ;
Prasad, Krishnamachar ;
Mawston, Grant .
IEEE SENSORS JOURNAL, 2016, 16 (14) :5510-5519
[9]   Comparison of Conductive Fabric Electrode With Electromyography to Evaluate Knee Joint Movement [J].
Lee, Byung Woo ;
Lee, Chungkeun ;
Kim, Jinkwon ;
Lee, Myoungho .
IEEE SENSORS JOURNAL, 2012, 12 (02) :410-411
[10]   Soft Bioelectronic Stickers: Selection and Evaluation of Skin-Interfacing Electrodes [J].
Lopes, Pedro Alhais ;
Gomes, Davide Vaz ;
Marques, Daniel Green ;
Faia, Pedro ;
Gois, Joana ;
Patricio, Tatiana F. ;
Coelho, Jorge ;
Serra, Armenio ;
de Almeida, Anibal T. ;
Majidi, Carmel ;
Tavakoli, Mahmoud .
ADVANCED HEALTHCARE MATERIALS, 2019, 8 (15)