Deep learning pathways for automatic sign language processing

被引:0
|
作者
Toshpulatov, Mukhiddin [1 ,3 ]
Lee, Wookey [1 ]
Jun, Jaesung [1 ]
Lee, Suan [2 ]
机构
[1] Inha Univ, Dept Ind & Biomed Sci Engn, 100 Inha Ro, Incheon 22212, South Korea
[2] Semyung Univ, Sch Comp Sci, 65 Semyung Ro, Jecheon 27136, South Korea
[3] Korea Adv Inst Sci & Technol, SpaceTop Res Ctr, 291 Deahak Ro, Daejeon 34141, South Korea
关键词
Sign language; Sign language processing; Sign language recognition; Sign language translation; Sign language production; Sign language dataset;
D O I
10.1016/j.patcog.2025.111475
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study provides a comprehensive review of the current state of the sign language processing (SLP) field, encompassing sign language recognition (SLR), translation (SLT), production (SLPn), and the associated datasets (SLD). It analyzes the advancements and challenges in each area, highlighting key methodologies and technologies. The authors explore feature extraction techniques, model architectures, and multimodal data integration in SLR. For SLT, they examine neural machine translation and sequence-to-sequence frameworks, emphasizing the need for context-aware systems. In SLPn, they review avatar-based systems and motion capture techniques, identifying gaps in generating natural and expressive sign language. The survey of SLD evaluates existing datasets and underscores the importance of comprehensive data collection. It also discusses current SLP systems' limitations and proposes future research directions to enhance accuracy, naturalness, and user-centric applications.
引用
收藏
页数:15
相关论文
共 50 条
  • [41] Sign Language Gloss Translation using Deep Learning Models
    Amin, Mohamed
    Hefny, Hesahm
    Mohammed, Ammar
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2021, 12 (11) : 686 - 692
  • [42] A Deep Learning based Recognition System for Yemeni Sign Language
    Dabwan, Basel A.
    Jadhav, Mukti E.
    2021 INTERNATIONAL CONFERENCE OF MODERN TRENDS IN INFORMATION AND COMMUNICATION TECHNOLOGY INDUSTRY (MTICTI 2021), 2021, : 20 - 24
  • [43] Arabic Sign Language Recognition Using Deep Machine Learning
    Suliman, Wael
    Deriche, Mohamed
    Luqman, Hamzah
    Mohandes, Mohamed
    2021 4TH INTERNATIONAL SYMPOSIUM ON ADVANCED ELECTRICAL AND COMMUNICATION TECHNOLOGIES (ISAECT), 2021,
  • [44] Deep Learning for American Sign Language Fingerspelling Recognition System
    Nguyen, Huy B. D.
    Hung Ngoc Do
    2019 26TH INTERNATIONAL CONFERENCE ON TELECOMMUNICATIONS (ICT), 2019, : 314 - 318
  • [45] Sign Language Recognition: A Comparative Analysis of Deep Learning Models
    Premkumar, Aswathi
    Krishna, R. Hridya
    Chanalya, Nikita
    Meghadev, C.
    Varma, Utkrist Arvind
    Anjali, T.
    Rani, S. Siji
    INVENTIVE COMPUTATION AND INFORMATION TECHNOLOGIES, ICICIT 2021, 2022, 336 : 1 - 13
  • [46] Enhancing communication: Deep learning for Arabic sign language translation
    Hassan, Mosab A.
    Ali, Alaa H.
    Sabri, Atheer A.
    OPEN ENGINEERING, 2024, 14 (01):
  • [47] A Study for Sign Language Detection Using Deep Learning Methods
    Tewari, Dhruv
    Mishra, Siddharth
    Kumar, Ashutosh
    Chaudhry, Rashmi
    PROCEEDINGS OF THIRD DOCTORAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE, DOSCI 2022, 2023, 479 : 493 - 501
  • [48] Deepsign: Sign Language Detection and Recognition Using Deep Learning
    Kothadiya, Deep
    Bhatt, Chintan
    Sapariya, Krenil
    Patel, Kevin
    Gil-Gonzalez, Ana-Belen
    Corchado, Juan M.
    ELECTRONICS, 2022, 11 (11)
  • [49] Automatic Recognition of Indian Sign Language using Image Processing and Computer Vision
    Kuanr, Gaurahari
    Chaudhury, Saurabh
    INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND ENERGY TECHNOLOGIES (ICECET 2021), 2021, : 1469 - 1474
  • [50] Interactive Sign Language Learning System Using Computer Vision and Deep Learning
    Murugan, Suganiya
    Ali, Mir Kasif
    Singari, Dhanvanth
    Kumar, S. Pradeep
    2024 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATION AND APPLIED INFORMATICS, ACCAI 2024, 2024,