Classification of American Sign Language by Applying a Transfer Learned Deep Convolutional Neural Network

被引:3
作者
Hasan, Md Mehedi [1 ]
Srizon, Azmain Yakin [1 ]
Sayeed, Abu [1 ]
Hasan, Md Al Mehedi [1 ]
机构
[1] Rajshahi Univ Engn & Technol, Dept Comp Sci & Engn, Rajshahi, Bangladesh
来源
2020 23RD INTERNATIONAL CONFERENCE ON COMPUTER AND INFORMATION TECHNOLOGY (ICCIT 2020) | 2020年
关键词
American Sign Language; Alphabets and Digits Recognition; Deep Convolutional Neural Network; InceptionV3; Augmentation; RECOGNITION;
D O I
10.1109/ICCIT51783.2020.9392703
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Having the community with more than 500,000 deaf and mute English speaking people, sign alphabet detection has become a domain of interest among the researchers for the last decade. Previously, a lot of signs of progress have been made in accurate recognition of the American Sign Language. Both convolutional neural networks and traditional machine learning classifiers have been applied formerly for the recognition process. In this study, we've considered an American Sign Language dataset having 36 classes of English characters and digits. The latest research on this real-world dataset achieved an accuracy of 90%. However, in our research, we introduced modified inceptionV3 architecture for the detection of American Sign characters and obtained overall correctness of 98.81% which outperformed all the previous studies by a notable margin.
引用
收藏
页数:6
相关论文
共 33 条
  • [1] Barczak A., 2011, A new 2D static hand gesture colour image dataset for ASL gestures
  • [2] Bloice M. D., 2017, ARXIV PREPRINT ARXIV
  • [3] Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective
    Bragg, Danielle
    Koller, Oscar
    Bellard, Mary
    Berke, Larwan
    Boudreault, Patrick
    Braffort, Annelies
    Caselli, Naomi
    Huenerfauth, Matt
    Kacorri, Hernisa
    Verhoef, Tessa
    Vogler, Christian
    Morris, Meredith Ringel
    [J]. ASSETS'19: THE 21ST INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2019, : 16 - 31
  • [4] Solutions to Some Important Issues in Strain Gage Based Determination of Stress Intensity Factors
    Chakraborty, D.
    Murthy, K. S. R. K.
    [J]. PROCEEDINGS OF THE 12TH INTERNATIONAL CONFERENCE ON MECHANICAL ENGINEERING (ICME 2017), 2018, 1980
  • [5] A review of hand gesture and sign language recognition techniques
    Cheok, Ming Jin
    Omar, Zaid
    Jaward, Mohamed Hisham
    [J]. INTERNATIONAL JOURNAL OF MACHINE LEARNING AND CYBERNETICS, 2019, 10 (01) : 131 - 153
  • [6] Collobert R., 2008, P 25 INT C MACH LEAR, P160, DOI DOI 10.1145/1390156.1390177
  • [7] A Deep Neural Framework for Continuous Sign Language Recognition by Iterative Training
    Cui, Runpeng
    Liu, Hu
    Zhang, Changshui
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (07) : 1880 - 1891
  • [8] Dong C, 2015, IEEE COMPUT SOC CONF
  • [9] E. Britannica and E. Britannica Inc, 2012, ENCY BRITANNICA
  • [10] Garcia B., 2016, Convolutional Neural Networks for Visual Recognition, V2, P225