Real-Time Recognition and Translation of Kinyarwanda Sign Language into Kinyarwanda Text

被引:0
|
作者
Semindu, Erick [1 ]
Niyizamwiyitira, Christine [2 ]
机构
[1] Carnegie Mellon Univ Africa, Cylab Africa Upanzi Network, Kigali, Rwanda
[2] Carnegie Mellon Univ Africa, Kigali, Rwanda
来源
SAIEE AFRICA RESEARCH JOURNAL | 2025年 / 116卷 / 01期
基金
美国安德鲁·梅隆基金会;
关键词
Computer vision; Kinyarwanda; LSTM; Machine learning; MediaPipe; Reduced Inequalities; Sign Language;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
significant technological advancements, there continues to be a considerable communication gap between individuals with hearing disabilities and the rest of society. This gap is exacerbated by the fact that the development and research of technologies, such as caption glasses, aimed at bridging this divide, primarily focus on sign languages used in countries with prominent tech industries, including European countries and USA. Consequently, there is a lack of resources and attention devoted to sign language recognition and translation systems for languages spoken in Africa. This research addresses this issue by concentrating on twenty-two common gestures in Kinyarwanda sign language. Through extensive exploration and evaluation of various machine learning algorithms, the study identifies the most effective approach for recognizing and translating these gestures. To validate the effectiveness of the developed system, real-world Kinyarwanda sign language video data is utilized for thorough training and testing. The research successfully culminates in the creation of a functional web application capable of accurately recognizing the 22 Kinyarwanda sign language gestures, both in live video feeds and recorded videos. This achievement represents a significant outcome of the research, as it addresses the specific needs of the Kinyarwanda signing community. By providing a reliable and accessible tool for gesture recognition and translation, the research contributes to narrowing the communication gap between individuals with hearing disabilities who use Kinyarwanda sign language and the wider society.
引用
收藏
页码:4 / 13
页数:10
相关论文
共 50 条
  • [1] A Real-Time Automatic Translation of Text to Sign Language
    Sanaullah, Muhammad
    Ahmad, Babar
    Kashif, Muhammad
    Safdar, Tauqeer
    Hassan, Mehdi
    Hasan, Mohd Hilmi
    Aziz, Norshakirah
    CMC-COMPUTERS MATERIALS & CONTINUA, 2022, 70 (02): : 2471 - 2488
  • [2] Towards Real-Time Sign Language Recognition and Translation on Edge Devices
    Gan, Shiwei
    Yin, Yafeng
    Jiang, Zhiwei
    Xie, Lei
    Lu, Sanglu
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 4502 - 4512
  • [3] An Approach to Real-Time Indian Sign Language Recognition and Braille Script Translation
    Tiwari, Shubham
    Sethia, Yash
    Tanwar, Ashwani
    Kumar, Harsh
    Dwivedi, Rudresh
    2022 16TH INTERNATIONAL CONFERENCE ON SIGNAL-IMAGE TECHNOLOGY & INTERNET-BASED SYSTEMS, SITIS, 2022, : 267 - 274
  • [4] Real-Time Isolated Sign Language Recognition
    Hori, Noriaki
    Yamamoto, Masahito
    FRONTIERS OF ARTIFICIAL INTELLIGENCE, ETHICS, AND MULTIDISCIPLINARY APPLICATIONS, FAIEMA 2023, 2024, : 445 - 458
  • [5] Real-Time Sign Language Recognition System
    Sen, Sanjukta
    Narang, Shreya
    Gouthaman, P.
    2023 ADVANCED COMPUTING AND COMMUNICATION TECHNOLOGIES FOR HIGH PERFORMANCE APPLICATIONS, ACCTHPA, 2023,
  • [6] Real-Time Mexican Sign Language Recognition
    Obdulia Sosa-Jimenez, Candy
    Vladimir Rios-Figueroa, Homero
    Janet Rechy-Ramirez, Ericka
    Marin-Hernandez, Antonio
    Solis Gonzalez-Cosio, Ana Luisa
    2017 IEEE INTERNATIONAL AUTUMN MEETING ON POWER, ELECTRONICS AND COMPUTING (ROPEC), 2017,
  • [7] Real-Time Recognition of Indian Sign Language
    Mariappan, Muthu H.
    Gomathi, V
    2019 SECOND INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE IN DATA SCIENCE (ICCIDS 2019), 2019,
  • [8] A Real-time Portable Sign Language Translation System
    Kau, Lih-Jen
    Su, Wan-Lin
    Yu, Pei-Ju
    Wei, Sin-Jhan
    2015 IEEE 58TH INTERNATIONAL MIDWEST SYMPOSIUM ON CIRCUITS AND SYSTEMS (MWSCAS), 2015,
  • [9] Real-time Indian Sign Language (ISL) Recognition
    Shenoy, Kartik
    Dastane, Tejas
    Rao, Varun
    Vyavaharkar, Devendra
    2018 9TH INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT), 2018,
  • [10] Real-time Sign Language Recognition using Computer Vision
    Raval, Jinalee Jayeshkumar
    Gajjar, Ruchi
    ICSPC'21: 2021 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND COMMUNICATION (ICPSC), 2021, : 542 - 546