Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
来源
PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2024, VOL 3 | 2024年 / 1013卷
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [41] Recognition of Sign Language System for Indonesian Language Using Long Short-Term Memory Neural Networks
    Rakun, Erdefi
    Arymurthy, Aniati M.
    Stefanus, Lim Y.
    Wicaksono, Alfan F.
    Wisesa, I. Wayan W.
    ADVANCED SCIENCE LETTERS, 2018, 24 (02) : 999 - 1004
  • [42] Video Recognition of American Sign Language Using Two-Stream Convolution Neural Networks
    Nugraha, Fikri
    Djamal, Esmeralda C.
    PROCEEDING OF 2019 INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING AND INFORMATICS (ICEEI), 2019, : 400 - 405
  • [43] Application of Wearable Gloves for Assisted Learning of Sign Language Using Artificial Neural Networks
    Kim, Hyeon-Jun
    Baek, Soo-Whang
    PROCESSES, 2023, 11 (04)
  • [44] Recognition of American Sign Language Gestures Based On Electromyogram (EMG) Signal With XGBoost Machine Learning
    Chen, Hanrui
    Qin, Tianyu
    Zhang, Yuehan
    Guan, Biqiang
    2021 3RD INTERNATIONAL CONFERENCE ON MACHINE LEARNING, BIG DATA AND BUSINESS INTELLIGENCE (MLBDBI 2021), 2021, : 24 - 29
  • [45] American Sign Language Recognition using Deep Learning and Computer Vision
    Bantupalli, Kshitij
    Xie, Ying
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 4896 - 4899
  • [46] SIGNIFY: Leveraging Machine Learning and Gesture Recognition for Sign Language Teaching Through a Serious Game
    Ulrich, Luca
    Carmassi, Giulio
    Garelli, Paolo
    Lo Presti, Gianluca
    Ramondetti, Gioele
    Marullo, Giorgia
    Innocente, Chiara
    Vezzetti, Enrico
    Future Internet, 2024, 16 (12):
  • [47] A pattern recognition model for static gestures in malaysian sign language based on machine learning techniques
    Alrubayi, Ali H.
    Ahmed, M. A.
    Zaidan, A. A.
    Albahri, A. S.
    Zaidan, B. B.
    Albahri, O. S.
    Alamoodi, A. H.
    Alazab, Mamoun
    COMPUTERS & ELECTRICAL ENGINEERING, 2021, 95
  • [48] RETRACTED ARTICLE: Machine learning based sign language recognition: a review and its research frontier
    R. Elakkiya
    Journal of Ambient Intelligence and Humanized Computing, 2021, 12 : 7205 - 7224
  • [49] Sign Language Recognition Using Leap Motion Based on Time-Frequency Characterization and Conventional Machine Learning Techniques
    Lopez-Alban, D.
    Lopez-Barrera, A.
    Mayorca-Torres, D.
    Peluffo-Ordonez, D.
    APPLIED INFORMATICS (ICAI 2021), 2021, 1455 : 55 - 67
  • [50] Developing an Offline and Real-Time Indian Sign Language Recognition System with Machine Learning and Deep Learning
    Priya K.
    Sandesh B.J.
    SN Computer Science, 5 (3)