Comparative Analysis of Image Classification Models for Norwegian Sign Language Recognition

被引:5
作者
Svendsen, Benjamin [1 ]
Kadry, Seifedine [1 ]
机构
[1] Noroff Univ Coll, Dept Appl Data Sci, N-4612 Kristiansand, Norway
关键词
Norwegian Sign Language recognition; machine learning; image classification; assistive technologies; fingerspelling; NEURAL-NETWORKS;
D O I
10.3390/technologies11040099
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Communication is integral to every human's life, allowing individuals to express themselves and understand each other. This process can be challenging for the hearing-impaired population, who rely on sign language for communication due to the limited number of individuals proficient in sign language. Image classification models can be used to create assistive systems to address this communication barrier. This paper conducts a comprehensive literature review and experiments to find the state of the art in sign language recognition. It identifies a lack of research in Norwegian Sign Language (NSL). To address this gap, we created a dataset from scratch containing 24,300 images of 27 NSL alphabet signs and performed a comparative analysis of various machine learning models, including the Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Convolutional Neural Network (CNN) on the dataset. The evaluation of these models was based on accuracy and computational efficiency. Based on these metrics, our findings indicate that SVM and CNN were the most effective models, achieving accuracies of 99.9% with high computational efficiency. Consequently, the research conducted in this report aims to contribute to the field of NSL recognition and serve as a foundation for future studies in this area.
引用
收藏
页数:25
相关论文
共 30 条
[1]  
Abadi M., 2016, TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems, DOI DOI 10.48550/ARXIV.1603.04467
[2]  
Abadi M, 2016, PROCEEDINGS OF OSDI'16: 12TH USENIX SYMPOSIUM ON OPERATING SYSTEMS DESIGN AND IMPLEMENTATION, P265
[3]   Machine learning methods for sign language recognition: A critical review and analysis [J].
Adeyanju, I. A. ;
Bello, O. O. ;
Adegboye, M. A. .
INTELLIGENT SYSTEMS WITH APPLICATIONS, 2021, 12
[4]  
[Anonymous], 2018, WHO Deafness and hearing loss
[5]  
[Anonymous], 2014, P 2014 C EMP METH NA, DOI DOI 10.3115/V1/D14-1179
[6]  
[Anonymous], 2017, P INT C NEURAL INFOR
[7]   A review of hand gesture and sign language recognition techniques [J].
Cheok, Ming Jin ;
Omar, Zaid ;
Jaward, Mohamed Hisham .
INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (01) :131-153
[8]  
Chung JY, 2014, Arxiv, DOI [arXiv:1412.3555, DOI 10.48550/ARXIV.1412.3555]
[9]   Sign language interpreting services A quick fix for inclusion? [J].
De Meulder, Maartje ;
Haualand, Hilde .
TRANSLATION AND INTERPRETING STUDIES, 2021, 16 (01) :19-40
[10]  
Glorot X., 2010, JMLR WORKSHOP C P, P249