KU-BdSL: An open dataset for Bengali sign language recognition

被引:3
作者
Jim, Abdullah Al Jaid [1 ]
Rafi, Ibrahim [1 ]
Akon, Md. Zahid [2 ]
Biswas, Uzzal [1 ]
Nahid, Abdullah-Al [1 ]
机构
[1] Khulna Univ, Elect & Commun Engn Discipline, Khulna 9208, Bangladesh
[2] Univ Global Village, Comp Sci & Engn Dept, Barishal 8200, Bangladesh
关键词
Bengali sign language; Computer vision; Deep learning; Machine learning; Sign language recognition;
D O I
10.1016/j.dib.2023.109797
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
Sign language is a form of communication medium for speech and hearing disabled people. It has various forms with different troublesome patterns, which are difficult for the general mass to comprehend. Bengali sign language (BdSL) is one of the difficult sign languages due to its im-mense number of alphabet, words, and expression tech-niques. Machine translation can ease the difficulty for dis-abled people to communicate with generals. From the ma-chine learning (ML) domain, computer vision can be the solution for them, and every ML solution requires a opti-mized model and a proper dataset. Therefore, in this research work, we have created a BdSL dataset and named 'KU-BdSL', which consists of 30 classes describing 38 consonants ('ban-jonborno') of the Bengali alphabet. The dataset includes 1500 images of hand signs in total, each representing Bengali con-sonant(s). Thirty-nine participants (30 males and 9 females) of different ages (21-38 years) participated in the creation of this dataset. We adopted smartphones to capture the im-ages due to the availability of their high-definition cameras. We believe that this dataset can be beneficial to the deaf and dumb (D&D) community. Identification of Bengali consonants of BdSL from images or videos is feasible using the dataset. It can also be employed for a human-machine interface for disabled people. In the future, we will work on the vowels and word level of BdSL.(c) 2023 The Authors. Published by Elsevier Inc. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)
引用
收藏
页数:11
相关论文
共 16 条
[1]   Recognition of On-line Arabic Handwritten Characters Using Structural Features [J].
Al-Taani, Ahmad T. ;
Al-Haj, Saeed .
JOURNAL OF PATTERN RECOGNITION RESEARCH, 2010, 5 (01) :23-37
[2]   The Egyptian origin of the Greek alphabetic numerals [J].
Chrisomalis, S .
ANTIQUITY, 2003, 77 (297) :485-496
[3]  
Cordeau J.-P., 1989, Canadian Acoustics, V17, P3
[4]  
David D, 2023, Applied Data Science and Analysis, V2023, P59
[5]  
Pavel D.S.H., 2003, ICCIT
[6]   Image-based Bengali Sign Language Alphabet Recognition for Deaf and Dumb Community [J].
Rafi, Abdul Muntakim ;
Nawal, Nowshin ;
Bayev, Nur Sultan Nazar ;
Nima, Lusain ;
Shahnaz, Celia ;
Fattah, Shaikh Anowarul .
2019 IEEE GLOBAL HUMANITARIAN TECHNOLOGY CONFERENCE (GHTC), 2019, :218-224
[7]  
Rahim F.M., 2010, Int. J. Eng. Comput. Sci. Math, V1, P43
[8]  
Ramyachitra D., 2014, International Journal of Computing and Business Research (IJCBR), V5, P1, DOI DOI 10.18533/IJBSR.V4I4.470
[9]   A New Convolutional Neural Network for Recognizing Handwritten Letters of the Russian Alphabet [J].
Safonova, Anastasiia ;
Levkov, Andrey ;
Kaplun, Dmitry .
2022 45TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS AND SIGNAL PROCESSING, TSP, 2022, :272-275
[10]  
Sarkar B., 2009, 2009 ANN IEEE IND C