A Real Time Arabic Sign Language Alphabets (ArSLA) Recognition Model Using Deep Learning Architecture

被引:16
作者
Alsaadi, Zaran [1 ]
Alshamani, Easa [1 ]
Alrehaili, Mohammed [1 ]
Alrashdi, Abdulmajeed Ayesh D. [1 ]
Albelwi, Saleh [1 ,2 ]
Elfaki, Abdelrahman Osman [1 ]
机构
[1] Univ Tabuk, Fac Comp & Informat Technol, Tabuk 71491, Saudi Arabia
[2] Univ Tabuk, Ind Innovat & Robot Ctr, Tabuk 71491, Saudi Arabia
关键词
deep learning; Arabic Sign Language alphabetic; AlexNet architecture; transfer learning; data augmentation; SYSTEM;
D O I
10.3390/computers11050078
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Currently, treating sign language issues and producing high quality solutions has attracted researchers and practitioners' attention due to the considerable prevalence of hearing disabilities around the world. The literature shows that Arabic Sign Language (ArSL) is one of the most popular sign languages due to its rate of use. ArSL is categorized into two groups: The first group is ArSL, where words are represented by signs, i.e., pictures. The second group is ArSl alphabetic (ArSLA), where each Arabic letter is represented by a sign. This paper introduces a real time ArSLA recognition model using deep learning architecture. As a methodology, the proceeding steps were followed. First, a trusted scientific ArSLA dataset was located. Second, the best deep learning architectures were chosen by investigating related works. Third, an experiment was conducted to test the previously selected deep learning architectures. Fourth, the deep learning architecture was selected based on extracted results. Finally, a real time recognition system was developed. The results of the experiment show that the AlexNet architecture is the best due to its high accuracy rate. The model was developed based on AlexNet architecture and successfully tested at real time with a 94.81% accuracy rate.
引用
收藏
页数:20
相关论文
共 33 条
[1]   Sign Language Translation Using Deep Convolutional Neural Networks [J].
Abiyev, Rahib H. ;
Arslan, Murat ;
Idok, John Bush .
KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2020, 14 (02) :631-653
[2]  
Alzohairi R, 2018, INT J ADV COMPUT SC, V9, P185
[3]   Review of deep learning: concepts, CNN architectures, challenges, applications, future directions [J].
Alzubaidi, Laith ;
Zhang, Jinglan ;
Humaidi, Amjad J. ;
Al-Dujaili, Ayad ;
Duan, Ye ;
Al-Shamma, Omran ;
Santamaria, J. ;
Fadhel, Mohammed A. ;
Al-Amidie, Muthana ;
Farhan, Laith .
JOURNAL OF BIG DATA, 2021, 8 (01)
[4]  
[Anonymous], 2017, CoRRabs/1712.04621
[5]  
[Anonymous], 2015, Scholarpedia
[6]   An Intelligent Arabic Sign Language Recognition System Using a Pair of LMCs With GMM Based Classification [J].
Deriche, Mohamed ;
Aliyu, Salihu O. ;
Mohandes, Mohamed .
IEEE SENSORS JOURNAL, 2019, 19 (18) :8067-8078
[7]  
El-Bendary Nashwa, 2010, 2010 International Conference on Computer Information Systems and Industrial Management Applications (CISIM 2010), P590, DOI 10.1109/CISIM.2010.5643519
[8]  
ElBadawy Menna, 2017, 2017 Eighth International Conference on Intelligent Computing and Information Systems (ICICIS). Proceedings, P66, DOI 10.1109/INTELCIS.2017.8260028
[9]  
Gangrade J., 2019, INT J COMPUT VIS ROB, V9, P329, DOI 10.1504/IJCVR.2019.101527
[10]  
Gordon-Rodriguez E., 2020, Uses and abuses of the cross-entropy loss: Case studies in modern deep learning