Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
来源
PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2024, VOL 3 | 2024年 / 1013卷
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [21] A machine learning-driven web application for sign language learning
    Orovwode, Hope
    Ibukun, Oduntan
    Abubakar, John Amanesi
    FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2024, 7
  • [22] Using Convolutional Neural Networks for Visual Sign Language Recognition Towards a system that provides instant feedback to learners of sign language
    Aldahir, Rami
    Grau, Ronald R.
    21ST INTERNATIONAL WEB FOR ALL CONFERENCE, W4A2024, 2024, : 70 - 74
  • [23] The Comparison of Some Hidden Markov Models for Sign Language Recognition
    Suharjito
    Gunawan, Herman
    Thiracitta, Narada
    Witjaksono, Gunawan
    2018 INDONESIAN ASSOCIATION FOR PATTERN RECOGNITION INTERNATIONAL CONFERENCE (INAPR), 2018, : 6 - 10
  • [24] Recognition of Sign Language using Capsule Networks
    Beser, Fuat
    Kizrak, Merve Ayyuce
    Bolat, Bulent
    Yildirim, Tulay
    2018 26TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS CONFERENCE (SIU), 2018,
  • [25] LEARNING ACOUSTIC FRAME LABELING FOR SPEECH RECOGNITION WITH RECURRENT NEURAL NETWORKS
    Sak, Hasim
    Senior, Andrew
    Rao, Kanishka
    Irsoy, Ozan
    Graves, Alex
    Beaufays, Francoise
    Schalkwyk, Johan
    2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP), 2015, : 4280 - 4284
  • [26] A Comprehensive Review of Recent Advances in Deep Neural Networks for Lipreading With Sign Language Recognition
    Rathipriya, N.
    Maheswari, N.
    IEEE ACCESS, 2024, 12 : 136846 - 136879
  • [27] Interpretation of Swedish Sign Language Using Convolutional Neural Networks and Transfer Learning
    Halvardsson G.
    Peterson J.
    Soto-Valero C.
    Baudry B.
    SN Computer Science, 2021, 2 (3)
  • [28] A Deep Learning based Recognition System for Yemeni Sign Language
    Dabwan, Basel A.
    Jadhav, Mukti E.
    2021 INTERNATIONAL CONFERENCE OF MODERN TRENDS IN INFORMATION AND COMMUNICATION TECHNOLOGY INDUSTRY (MTICTI 2021), 2021, : 20 - 24
  • [29] Interperforming in AI: question of 'natural' in machine learning and recurrent neural networks
    Yalur, Tolga
    AI & SOCIETY, 2020, 35 (03) : 737 - 745
  • [30] Efficient Indian sign language recognition and classification using enhanced machine learning approach
    Soji, Edwin Shalom
    Kamalakannan, T.
    INTERNATIONAL JOURNAL OF CRITICAL INFRASTRUCTURES, 2024, 20 (02) : 125 - 138