Recurrent Neural Networks and Machine Learning Models Applied in Sign Language Recognition

被引:0
|
作者
Novillo Quinde, Esteban Gustavo [1 ]
Saldana Torres, Juan Pablo [1 ]
Alvarez Valdez, Michael Andres [1 ]
Llivicota Leon, John Santiago [1 ]
Hurtado Ortiz, Remigio Ismael [1 ]
机构
[1] Univ Politecn Salesiana, Cuenca, Ecuador
来源
PROCEEDINGS OF NINTH INTERNATIONAL CONGRESS ON INFORMATION AND COMMUNICATION TECHNOLOGY, ICICT 2024, VOL 3 | 2024年 / 1013卷
关键词
Data science; Machine learning; Sign language; Random forest; RNN; RF with DataAugm; RNN with DataAugm; Voting;
D O I
10.1007/978-981-97-3559-4_49
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This research is dedicated to promoting the inclusion of individuals with hearing disabilities, addressing their unique communication needs through the development of a sign language translation system. Efficiently predicting the gestures of non-hearing individuals is essential for breaking barriers and facilitating smooth communication in their daily lives. To achieve this goal, we propose a three-phase method that involves data preparation and cleaning. For modeling, we leverage cutting-edge techniques, including random forest with data augmentation, recurrent neural networks (RNNs), and a voting system to combine the best-performing models. Our approach is centered on the 'Australian Sign Language signs' dataset, which offers a valuable resource for sign language recognition. By incorporating these advanced methods, we strive to achieve unparalleled accuracy, precision, recall, and F1-score in predicting signs within the Australian sign language using this dataset. Moreover, our work sets the foundation for future research, encouraging the exploration of advanced supervised modeling techniques to further elevate the obtained results. We envision that the integration of RNN, random forest with data augmentation, and the voting system will enable us to break new ground in sign language translation, empowering individuals with hearing disabilities to engage fully in their personal and professional endeavors with improved accessibility and inclusivity.
引用
收藏
页码:615 / 624
页数:10
相关论文
共 50 条
  • [31] Combinatorial Bionic Hierarchical Flexible Strain Sensor for Sign Language Recognition with Machine Learning
    Zong, Xuanjie
    Zhang, Nianqiang
    Wang, Jilai
    Zong, Hangfan
    Zhang, Chengpeng
    Xu, Guogang
    ACS APPLIED MATERIALS & INTERFACES, 2024, 16 (29) : 38780 - 38791
  • [32] Instant Sign Language Recognition by WAR Strategy Algorithm Based Tuned Machine Learning
    Abd Al-Latief, Shahad Thamear
    Yussof, Salman
    Ahmad, Azhana
    Khadim, Saif Mohanad
    Abdulhasan, Raed Abdulkareem
    INTERNATIONAL JOURNAL OF NETWORKED AND DISTRIBUTED COMPUTING, 2024, 12 (02) : 344 - 361
  • [33] Machine Learning Approach to Recognize and Classify Indian Sign Language
    Pillai, Smriti
    Anand, Adithya
    Jishnu, M. Sai
    Ganesh, Siddarth
    Thara, S.
    INVENTIVE COMPUTATION AND INFORMATION TECHNOLOGIES, ICICIT 2021, 2022, 336 : 373 - 382
  • [34] The Efficiency of Sign Language Recognition using 3D Convolutional Neural Networks
    Soodtoetong, Nantinee
    Gedkhaw, Eakbodin
    2018 15TH INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY (ECTI-CON), 2018, : 70 - 73
  • [35] Interperforming in AI: question of ‘natural’ in machine learning and recurrent neural networks
    Tolga Yalur
    AI & SOCIETY, 2020, 35 : 737 - 745
  • [36] American Sign Language Recognition Using Leap Motion Controller with Machine Learning Approach
    Chong, Teak-Wei
    Lee, Boon-Giin
    SENSORS, 2018, 18 (10)
  • [37] Machine Learning and Deep Learning Approaches for Arabic Sign Language Recognition: A Decade Systematic Literature Review
    Alayed, Asmaa
    SENSORS, 2024, 24 (23)
  • [38] Sign Language Recognition Using Deep Learning
    Ray, Anushka
    Syed, Shahbaz
    Poornima, S.
    Pushpalatha, M.
    JOURNAL OF PHARMACEUTICAL NEGATIVE RESULTS, 2022, 13 : 421 - 428
  • [39] Sign Language Detection Using Machine Learning
    Ilanchezhian, P.
    Singh, I. Amit Kumar
    Balaji, M.
    Kumar, A. Manoj
    Yaseen, S. Muhamad
    SEMANTIC INTELLIGENCE, ISIC 2022, 2023, 964 : 135 - 143
  • [40] Kurdish Sign Language Recognition Using Pre-Trained Deep Learning Models
    Alsaud, Ali A.
    Yousif, Raghad Z.
    Aziz, Marwan. M.
    Kareem, Shahab W.
    Maho, Amer J.
    JOURNAL OF ELECTRICAL SYSTEMS, 2024, 20 (06) : 1334 - 1344