Arabic Sign Language Recognition Using Convolutional Neural Network and MobileNet

被引:19
作者
Aljuhani, Reem [1 ]
Alfaidi, Aseel [1 ]
Alshehri, Bushra [1 ]
Alwadei, Hajer [1 ]
Aldhahri, Eman [1 ]
Aljojo, Nahla [2 ]
机构
[1] Univ Jeddah, Coll Comp Sci & Engn, Dept Comp Sci & Artificial Intelligence, Jeddah, Saudi Arabia
[2] Univ Jeddah, Coll Comp Sci & Engn, Dept Informat Syst & Technol, Jeddah, Saudi Arabia
关键词
Arabic sign language; Sign language recognition; MobileNet; Convolutional neural network;
D O I
10.1007/s13369-022-07144-2
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Individuals who are deaf or those having hearing problems can communicate through alternative modes of communication, such as sign language, both within and outside their community. As a result, the sign serves as a tool that mediated communication goals. With the aid of recent advances in computer vision, there has been promising progress in the fields of motion and gesture detection using deep learning. In this work, convolutional neural networks are utilised to develop a model for recognising the Arabic language's alphabet signs in order to aid communication goal. The research used the Arabic Alphabets Sign Language Dataset (ArASL2018), which contains sets of images indicating each specific sign for each letter of the alphabet. Experimental analysis was carried out using the proposed model. The results of the analysis reveal a recognition accuracy of 94.46%. Furthermore, the comparative analysis with the previous studies indicates that the proposed model outperformed all of them in terms of recognition accuracy.
引用
收藏
页码:2147 / 2154
页数:8
相关论文
共 23 条
[1]  
Aich D., 2019, DEEP LEARNING APPROA
[2]  
Al-Fityani K., 2010, Sign languages, P433, DOI [10.1017/CBO9780511712203.020, DOI 10.1017/CBO9780511712203.020]
[3]  
Alawwad R.A., ARABIC SIGN LANGUAGE
[4]  
Althagafi A, 2020, INT J COMPUT SCI NET, V20, P124
[5]   User-Independent American Sign Language Alphabet Recognition Based on Depth Image and PCANet Features [J].
Aly, Walaa ;
Aly, Saleh ;
Almotairi, Sultan .
IEEE ACCESS, 2019, 7 :123138-123150
[6]  
[Anonymous], 2015, KERAS DEEP LEARNING
[7]   CNN based feature extraction and classification for sign language [J].
Barbhuiya, Abul Abbas ;
Karsh, Ram Kumar ;
Jain, Rahul .
MULTIMEDIA TOOLS AND APPLICATIONS, 2021, 80 (02) :3051-3069
[8]   Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective [J].
Bragg, Danielle ;
Koller, Oscar ;
Bellard, Mary ;
Berke, Larwan ;
Boudreault, Patrick ;
Braffort, Annelies ;
Caselli, Naomi ;
Huenerfauth, Matt ;
Kacorri, Hernisa ;
Verhoef, Tessa ;
Vogler, Christian ;
Morris, Meredith Ringel .
ASSETS'19: THE 21ST INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2019, :16-31
[9]   A review of hand gesture and sign language recognition techniques [J].
Cheok, Ming Jin ;
Omar, Zaid ;
Jaward, Mohamed Hisham .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (01) :131-153
[10]  
Cooper H., 2011, Visual Analysis of Humans, P539, DOI [DOI 10.1007/978-0-85729-997-0_27, 10.1007/978-0-85729-997-027, DOI 10.1007/978-0-85729-997-027]