Recognition of Libras Static Alphabet with Myo™ and Multi-Layer Perceptron

被引:6
作者
Alves Mendes Junior, Jose Jair [1 ]
Freitas, Melissa La Banca [2 ]
Stevan, Sergio Luiz, Jr. [2 ,3 ]
Pichorim, Sergio Francisco [1 ]
机构
[1] Fed Univ Technol, Parana UTFPR, Grad Program Elect & Comp Engn, CPGEI, BR-80230901 Curitiba, Parana, Brazil
[2] Fed Univ Technol, Parana UTFPR, Grad Sch Elect Engn, UTFPR PG, BR-84016210 Ponta Grossa, Parana, Brazil
[3] Fed Univ Technol, Parana UTFPR, Grad Program Elect Engn, PPGEE, BR-84016210 Ponta Grossa, Parana, Brazil
来源
XXVI BRAZILIAN CONGRESS ON BIOMEDICAL ENGINEERING, CBEB 2018, VOL. 2 | 2019年 / 70卷 / 02期
关键词
EMG; Libras; MLP; Recognition;
D O I
10.1007/978-981-13-2517-5_63
中图分类号
R318 [生物医学工程];
学科分类号
0831 ;
摘要
A Sign Language is a structured set of corporal gestures used as a communication system, which uses movements of the arm, hand, forearm, facial expressions, and lips movements to ease the communication among deaf and/or hearing people. In Brazil, the official Sign Language is called Libras. This work presents the recognition of static alphabet of Libras (20 letters) using the armband Myo (TM) and a Multi-Layer Perceptron. Myo (TM) captures Electromyography signals from forearm and these signals are used to classification. The data were acquired from one male subject, 42 times for each gesture. The signals were segmented in periods of 750 ms using onset technique and 10 features were extract from these segments. The built MLP has one hidden layer, one input layer, and one output layer, trained by the backpropagation algorithm. The number of neurons in hidden layer was tested from 10 to 300 and the best approximation for MLP was 230 neurons. The classification has an accuracy of 91.3 +/- 0.5% in training and 81.6 +/- 0.9 in the test. Finally, the gestures presented accuracies above 80%, except the gestures 'L', 'R', and 'W'.
引用
收藏
页码:413 / 419
页数:7
相关论文
共 22 条
[1]   Evaluating Sign Language Recognition Using the Myo Armband [J].
Abreu, Joao Gabriel ;
Teixeira, Joao Marcelo ;
Figueiredo, Lucas Silva ;
Teichrieb, Veronica .
2016 18TH SYMPOSIUM ON VIRTUAL AND AUGMENTED REALITY (SVR 2016), 2016, :64-70
[2]  
Al-Ahdal M. Ebrahim, 2012, 2012 IEEE Symposium on Computers & Informatics, P52, DOI 10.1109/ISCI.2012.6222666
[3]  
Bastos I.L.O., 2016, RECONHECIMENTO SINAI
[4]   Recognition of Static Gestures applied to Brazilian Sign Language (Libras) [J].
Bastos, Igor L. O. ;
Angelo, Michele F. ;
Loula, Angelo C. .
2015 28TH SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES, 2015, :305-312
[5]   An efficient static gesture recognizer embedded system based on ELM pattern recognition algorithm [J].
Cambuim, Lucas F. S. ;
Macieira, Rafael M. ;
Neto, Fernando M. P. ;
Barros, Edna ;
Ludermir, Teresa B. ;
Zanchettin, Cleber .
JOURNAL OF SYSTEMS ARCHITECTURE, 2016, 68 :1-16
[6]   A review of hand gesture and sign language recognition techniques [J].
Cheok, Ming Jin ;
Omar, Zaid ;
Jaward, Mohamed Hisham .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (01) :131-153
[7]  
Costa Filho Cicero Ferreira Fernandes, 2017, Res. Biomed. Eng., V33, P78, DOI 10.1590/2446-4740.03816
[8]  
Costanza E, 2007, CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, VOLS 1 AND 2, P819
[9]   The history of surface electromyography [J].
Cram, JR .
APPLIED PSYCHOPHYSIOLOGY AND BIOFEEDBACK, 2003, 28 (02) :81-91
[10]  
De Luca C., 2006, ENCY MED DEVICES INS, VVolume 2, P3666