Exploring CNN-based transfer learning approaches for Arabic alphabets sign language recognition using the ArSL2018 dataset

被引:1
作者
Lahiani, Houssem [1 ]
Frikha, Mondher [2 ]
机构
[1] Univ Sfax, Natl Sch Elect & Telecommun, Sfax, Tunisia
[2] Technopk Sfax, Adv Technol Image & Signal Proc ATISP Lab, PO, Tunis Rd 10 km,POB 1163,SFAX 3021, Sfax, Tunisia
关键词
convolutional neural network; CNN; HMI; transfer learning; Arabic alphabets sign language; ArASL; CLASSIFICATION;
D O I
10.1504/IJIEI.2024.138858
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Arabic alphabets sign language (ArASL) recognition is an important topic that has gotten insufficient attention regardless of its significance in the Arab world. This research compares CNN-based transfer learning models for Arabic alphabets sign language (ArASL) recognition using the ArSL2018 dataset, which comprises 54,049 pictures representing 32 sign and letter classes. Three pre-trained models are examined (InceptionV3, VGG16, and MobileNetV2) and compared using a training and evaluation dataset split. We use transfer learning to fine-tune these models on the ArSL2018 dataset and compare their performance. Our experimental findings indicate that the MobileNetV2 model exceeds the other models in terms of accuracy, achieving an overall accuracy of 96%, which exceeds the state-of-the-art results, reported in previous works. Our study demonstrates that transfer learning is an effective approach for recognising Arabic alphabets sign language using CNN-based models and provides insights into the suitability of different pre-trained models for this task.
引用
收藏
页码:236 / 260
页数:26
相关论文
共 24 条
[1]   A Transfer Learning Evaluation of Deep Neural Networks for Image Classification [J].
Abou Baker, Nermeen ;
Zengeler, Nico ;
Handmann, Uwe .
MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 2022, 4 (01) :22-41
[2]  
Alawwad RA, 2021, INT J ADV COMPUT SC, V12, P692
[3]  
Aljuhani R, 2023, ARAB J SCI ENG, V48, P2147, DOI 10.1007/s13369-022-07144-2
[4]  
Alzohairi R, 2018, INT J ADV COMPUT SC, V9, P185
[5]   Adaptive and effective spatio-temporal modelling for offensive video classification using deep neural network [J].
Chelliah, Balika J. J. ;
Harshitha, K. ;
Pandey, Saharsh .
INTERNATIONAL JOURNAL OF INTELLIGENT ENGINEERING INFORMATICS, 2023, 11 (01) :19-34
[6]  
Davis J., 2006, P 23 INT C MACH LEAR, P233, DOI DOI 10.1145/1143844.1143874
[7]  
Howard AG, 2017, Arxiv, DOI arXiv:1704.04861
[8]  
Hayani S., 2019, P 2019 INT C COMP SC, P1, DOI [10.1109/ICCSRE.2019.8807586, DOI 10.1109/ICCSRE.2019.8807586]
[9]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[10]  
Jamwal SS, 2021, INT J INTELL ENG INF, V9, P412