Inertial Motion Sensing Glove for Sign Language Gesture Acquisition and Recognition

被引：89

作者：

Galka, Jakub ^{[1
]}

Masior, Mariusz ^{[1
]}

Zaborski, Mateusz ^{[1
]}

Barczewska, Katarzyna ^{[2
]}

机构：

[1] AGH Univ Sci & Technol, Dept Elect, Al Mickiewicza 30, PL-30059 Krakow, Poland

[2] AGH Univ Sci & Technol, Dept Automat & Biomed Engn, Al Mickiewicza 30, PL-30059 Krakow, Poland

来源：

IEEE SENSORS JOURNAL | 2016年 / 16卷 / 16期

关键词：

Inertial motion sensors; gesture analysis; sign language recognition; sensor glove; FRAMEWORK; SENSORS; FUSION;

D O I：

10.1109/JSEN.2016.2583542

中图分类号：

TM [电工技术]; TN [电子技术、通信技术];

学科分类号：

0808 ; 0809 ;

摘要：

The most popular systems for automatic sign language recognition are based on vision. They are user-friendly, but very sensitive to changes in regard to recording conditions. This paper presents a description of the construction of a more robust system-an accelerometer glove-as well as its application in the recognition of sign language gestures. The basic data regarding inertial motion sensors and the design of the gesture acquisition system as well as project proposals are presented. The evaluation of the solution presents the results of the gesture recognition attempt by using a selected set of sign language gestures with a described method based on Hidden Markov Model (HMM) and parallel HMM approaches. The proposed usage of parallel HMM for sensor-fusion modeling reduced the equal error rate by more than 60%, while preserving 99.75% recognition accuracy.

引用

页码：6310 / 6316

页数：7

共 26 条

[1] Feature extraction in Brazilian Sign Language Recognition based on phonological structure and using RGB-D sensors [J].

Almeida, Silvia Grasiella Moreira ;

Guimaraes, Frederico Gadelha ;

Ramirez, Jaime Arturo .

EXPERT SYSTEMS WITH APPLICATIONS, 2014, 41 (16) :7259-7271

[2]

[Anonymous], 2002, THESIS

[3] Hidden Markov model for human to computer interaction: a study on human hand gesture recognition [J].

Bilal, Sara ;

Akmeliawati, Rini ;

Shafie, Amir A. ;

Salami, Momoh Jimoh E. .

ARTIFICIAL INTELLIGENCE REVIEW, 2013, 40 (04) :495-516

[4]

Bourlard H, 1996, ICSLP 96 - FOURTH INTERNATIONAL CONFERENCE ON SPOKEN LANGUAGE PROCESSING, PROCEEDINGS, VOLS 1-4, P426

[5]

Bourlard H, 1997, INT CONF ACOUST SPEE, P1251, DOI 10.1109/ICASSP.1997.596172

[6] A Real-Time Human Action Recognition System Using Depth and Inertial Sensor Fusion [J].

Chen, Chen ;

Jafari, Roozbeh ;

Kehtarnavaz, Nasser .

IEEE SENSORS JOURNAL, 2016, 16 (03) :773-781

[7] FBG Sensing Glove for Monitoring Hand Posture [J].

da Silva, Alexandre Ferreira ;

Goncalves, Anselmo Filipe ;

Mendes, Paulo Mateus ;

Correia, Jose Higino .

IEEE SENSORS JOURNAL, 2011, 11 (10) :2442-2448

[8]

DEVIJVER PA, 1982, PATTERN RECOGNITION

[9]

Dijkstra E. J., 2010, S0142395 U TWENT DEP

[10] A Wearable Inertial Sensor Node for Body Motion Analysis [J].

Kan, Yao-Chiang ;

Chen, Chun-Kai .

IEEE SENSORS JOURNAL, 2012, 12 (03) :651-657

← 1 2 3 →