Gesture Recognition System For Isolated Word Sign Language Based On key-Point Trajectory Matrix

被引:1
作者
Fakhfakh, Sana [1 ]
Ben Jemaa, Yousra [1 ]
机构
[1] El Manar Univ, Signal & Syst Res Unit, ENIT, Tunis, Tunisia
来源
COMPUTACION Y SISTEMAS | 2018年 / 22卷 / 04期
关键词
Sign language recognition; isolated word; signer-independence; particular filter; key-point trajectory matrix;
D O I
10.13053/CyS-22-4-3046
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper suggests a new system to help the deaf and the hearing-impaired community improve their connection with the hearing world and communicate freely. The most important thing in this system is how to help the users be free and finally have a more natural way of communication. For this reason, we present a new process based on two levels: a static-level aiming to extract the most head/hands key points and a dynamic-level with the objective of accumulating the key-point trajectory matrix. Also our proposed approach takes into account the signer-independence constraint. A SIGNUM database is applied in the classification stage and our system performances have improved with a 94.3% recognition rate. Furthermore, a reduction in time processing is obtained when the removing of redundant frame step is applied. The obtained results prove the superiority of our system compared to the state-of-the-art methods in terms of recognition rate and execution time.
引用
收藏
页码:1415 / 1430
页数:16
相关论文
共 43 条
[11]   Hand and wrist localization approach for features extraction in Arabic Sign Language recognition [J].
Fakhfakh, Sana ;
Ben Jemaa, Yousra .
2017 IEEE/ACS 14TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2017, :774-780
[12]   Survey of Motion Tracking Methods Based on Inertial Sensors: A Focus on Upper Limb Human Motion [J].
Filippeschi, Alessandro ;
Schmitz, Norbert ;
Miezal, Markus ;
Bleser, Gabriele ;
Ruffaldi, Emanuele ;
Stricker, Didier .
SENSORS, 2017, 17 (06)
[13]  
Gonzalez G. S., 2018, COMPUTACION SISTEMAS, V22
[14]  
Gurung D., 2013, HAND GESTURES RECOGN
[15]   Australian sign language recognition [J].
Holden, EJ ;
Lee, G ;
Owens, R .
MACHINE VISION AND APPLICATIONS, 2005, 16 (05) :312-320
[16]  
Hussain I, 2014, ANNU IEEE IND CONF
[17]  
Jemaa Y. B, 2009, CORR
[18]  
Jmaa A. B., 2016, COMPUTACION SISTEMAS, V20
[19]   Bayesian filtering for keyframe-based visual SLAM [J].
Kim, Jungho ;
Yoon, Kuk-Jin ;
Kweon, In So .
INTERNATIONAL JOURNAL OF ROBOTICS RESEARCH, 2015, 34 (4-5) :517-531
[20]  
Krupka E., 2017, REALISTIC HANDS GEST