ArSign: Toward a Mobile Based Arabic Sign Language Translator Using LMC

被引:7
作者
Kammoun, Slim [1 ,2 ]
Darwish, Dawlat [1 ]
Althubeany, Hanan [1 ]
Alfulh, Reem [1 ]
机构
[1] Taibah Univ, Informat Syst Dept, Medina, Saudi Arabia
[2] Univ Tunis, Res Lab Technol Informat & Commun & Elect Engn, Tunis, Tunisia
来源
UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION. APPLICATIONS AND PRACTICE, UAHCI 2020, PT II | 2020年 / 12189卷
关键词
Sign language recognition; Arabic Sign Language; Leap motion; Gesture recognition;
D O I
10.1007/978-3-030-49108-6_7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Communication connects people by allowing them to exchange messages, to express their feelings either verbally or non-verbally. To communicate with their surroundings, hearing impaired people or deaf use sign language. Unfortunately, practicing sign language is not common among society witch make barriers between peoples. In this work we propose a new system to convert Arabic sign language from gesture to written text. To do that we propose a system based on three main components: 1) The Leap motion controller as gesture recognition device to capture hand and finger movements. 2) A processing module to convert recognized gesture to alphabet using a comparison algorithm working on a pre-defined dataset of gesture. 3) A user interface to display the text or to convert it to speech through text to speech engine. The proposed system is implemented as a mobile application running into an android based device.
引用
收藏
页码:92 / 101
页数:10
相关论文
共 28 条
[1]  
Ahmed AA, 2014, I C ENG TECHNOL
[2]  
Ahmed M, 2016, PROCEEDINGS OF THE 2016 SAI COMPUTING CONFERENCE (SAI), P330, DOI 10.1109/SAI.2016.7556002
[3]   A Review on Systems-Based Sensory Gloves for Sign Language Recognition State of the Art between 2007 and 2017 [J].
Ahmed, Mohamed Aktham ;
Zaidan, Bilal Bahaa ;
Zaidan, Aws Alaa ;
Salih, Mahmood Maher ;
Bin Lakulu, Muhammad Modi .
SENSORS, 2018, 18 (07)
[4]   Recognizing postures in Vietnamese sign language with MEMS accelerometers [J].
Bui, The Duy ;
Nguyen, Long Thang .
IEEE SENSORS JOURNAL, 2007, 7 (5-6) :707-712
[5]  
Carneiro SB, 2016, IEEE SENSOR
[6]  
El-Jaber M., 2010, 7 INT S MECH ITS APP, P1
[7]  
López-Noriega JE, 2014, 2014 11TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING, COMPUTING SCIENCE AND AUTOMATIC CONTROL (CCE)
[8]   A Real-Time ASL Recognition System Using Leap Motion Sensors [J].
Fok, Kai-Yin ;
Ganganath, Nuwan ;
Cheng, Chi-Tsun ;
Tse, Chi K. .
2015 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY, 2015, :411-414
[9]  
Haq Endi Sailul, 2018, 2018 3rd International Conference on Information Technology, Information System and Electrical Engineering (ICITISEE), P313, DOI 10.1109/ICITISEE.2018.8720982
[10]  
Hayat Shoaib, 2019, 2019 IEEE 2nd International Conference on Electronics Technology (ICET), P1, DOI 10.1109/ELTECH.2019.8839402