Gesture Recognition System For Isolated Word Sign Language Based On key-Point Trajectory Matrix

被引:1
作者
Fakhfakh, Sana [1 ]
Ben Jemaa, Yousra [1 ]
机构
[1] El Manar Univ, Signal & Syst Res Unit, ENIT, Tunis, Tunisia
来源
COMPUTACION Y SISTEMAS | 2018年 / 22卷 / 04期
关键词
Sign language recognition; isolated word; signer-independence; particular filter; key-point trajectory matrix;
D O I
10.13053/CyS-22-4-3046
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper suggests a new system to help the deaf and the hearing-impaired community improve their connection with the hearing world and communicate freely. The most important thing in this system is how to help the users be free and finally have a more natural way of communication. For this reason, we present a new process based on two levels: a static-level aiming to extract the most head/hands key points and a dynamic-level with the objective of accumulating the key-point trajectory matrix. Also our proposed approach takes into account the signer-independence constraint. A SIGNUM database is applied in the classification stage and our system performances have improved with a 94.3% recognition rate. Furthermore, a reduction in time processing is obtained when the removing of redundant frame step is applied. The obtained results prove the superiority of our system compared to the state-of-the-art methods in terms of recognition rate and execution time.
引用
收藏
页码:1415 / 1430
页数:16
相关论文
共 43 条
[1]  
Aran O., 2006, RECOGNIZING 2 HANDED, P159
[2]  
Balaji SR, 2017, PROCEEDINGS OF 2017 11TH INTERNATIONAL CONFERENCE ON INTELLIGENT SYSTEMS AND CONTROL (ISCO 2017), P469, DOI 10.1109/ISCO.2017.7856037
[3]  
BenTanfous A., 2018, IEEE COMPUTER VISION
[4]  
Cooper H, 2011, SIGN LANGUAGE RECOGN, P539, DOI DOI 10.1007/978-0-85729-997-027
[5]  
Corradini A, 2001, IEEE ICCV WORKSHOP ON RECOGNITION, ANALYSIS AND TRACKING OF FACES AND GESTURES IN REAL-TIME SYSTEMS, PROCEEDINGS, P82, DOI 10.1109/RATFG.2001.938914
[6]  
Da'san M, 2015, 2015 INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGY RESEARCH (ICTRC), P40, DOI 10.1109/ICTRC.2015.7156416
[7]   Efficient keyframe-based real-time camera tracking [J].
Dong, Zilong ;
Zhang, Guofeng ;
Jia, Jiaya ;
Bao, Hujun .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2014, 118 :97-110
[8]  
Du W., 2012, HAND MODELING TRACKI, P273
[9]   A proposed PCNN features quality optimization technique for pose-invariant 3D Arabic sign language recognition [J].
Elons, A. Samir ;
Abull-ela, Magdy ;
Tolba, M. F. .
APPLIED SOFT COMPUTING, 2013, 13 (04) :1646-1660
[10]   Real-Time Viola-Jones Face Detection in a Web Browser [J].
Ephraim, Theo ;
Himmelman, Tristan ;
Siddiqi, Kaleem .
2009 CANADIAN CONFERENCE ON COMPUTER AND ROBOT VISION, 2009, :321-+