Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
来源
PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2024, VOL 3 | 2024年 / 1013卷
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [1] Machine Learning Models Applied in Sign Language Recognition
    Novillo Quinde, Esteban Gustavo
    Saldana Torres, Juan Pablo
    Alvarez Valdez, Michael Andres
    Llivicota Leon, John Santiago
    Hurtado Ortiz, Remigio Ismael
    PATTERN RECOGNITION, MCPR 2023, 2023, 13902 : 263 - 272
  • [2] Peruvian Sign Language Recognition Using Recurrent Neural Networks
    Barrientos-Villalta, Geraldine Fiorella
    Quiroz, Piero
    Ugarte, Willy
    ADVANCED RESEARCH IN TECHNOLOGIES, INFORMATION, INNOVATION AND SUSTAINABILITY, ARTIIS 2022, PT I, 2022, 1675 : 459 - 473
  • [3] Sign Language Recognition Using Machine Learning
    Soundarya, M.
    Yazhini, M.
    Sree, Thirumala N. S.
    Sornamalaya, N. M.
    Vinitha, C.
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,
  • [4] Automatic Recognition of Mexican Sign Language Using a Depth Camera and Recurrent Neural Networks
    Mejia-Perez, Kenneth
    Cordova-Esparza, Diana-Margarita
    Terven, Juan
    Herrera-Navarro, Ana-Marcela
    Garcia-Ramirez, Teresa
    Ramirez-Pedraza, Alfonso
    APPLIED SCIENCES-BASEL, 2022, 12 (11):
  • [5] SIGN LANGUAGE DETECTION "IN THE WILD" WITH RECURRENT NEURAL NETWORKS
    Borg, Mark
    Camilleri, Kenneth P.
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 1637 - 1641
  • [6] Sign Language Recognition with CW Radar and Machine Learning
    Lu, Yilong
    Lang, Yue
    2020 21ST INTERNATIONAL RADAR SYMPOSIUM (IRS 2020), 2020, : 31 - 34
  • [7] Optimized Hybrid Convolution Neural Network with Machine Learning for Arabic Sign Language Recognition
    Mahmoud, Ahmed Osman
    Ziedan, Aibrahim
    Zamel, Amr A.
    TRAITEMENT DU SIGNAL, 2024, 41 (04) : 1835 - 1846
  • [8] Recognition of sign language gestures using neural networks
    Vamplew, Simon
    NEUROPSYCHOLOGICAL TRENDS, 2007, (01) : 31 - 41
  • [9] Machine Learning Techniques for Indian Sign Language Recognition
    Dutta, Kusumika Krori
    Bellary, Sunny Arokia Swamy
    2017 INTERNATIONAL CONFERENCE ON CURRENT TRENDS IN COMPUTER, ELECTRICAL, ELECTRONICS AND COMMUNICATION (CTCEEC), 2017, : 333 - 336
  • [10] Exploiting Recurrent Neural Networks and Leap Motion Controller for the Recognition of Sign Language and Semaphoric Hand Gestures
    Avola, Danilo
    Bernardi, Marco
    Cinque, Luigi
    Foresti, Gian Luca
    Massaroni, Cristiano
    IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (01) : 234 - 245