Deep learning pathways for automatic sign language processing

被引:0
|
作者
Toshpulatov, Mukhiddin [1 ,3 ]
Lee, Wookey [1 ]
Jun, Jaesung [1 ]
Lee, Suan [2 ]
机构
[1] Inha Univ, Dept Ind & Biomed Sci Engn, 100 Inha Ro, Incheon 22212, South Korea
[2] Semyung Univ, Sch Comp Sci, 65 Semyung Ro, Jecheon 27136, South Korea
[3] Korea Adv Inst Sci & Technol, SpaceTop Res Ctr, 291 Deahak Ro, Daejeon 34141, South Korea
关键词
Sign language; Sign language processing; Sign language recognition; Sign language translation; Sign language production; Sign language dataset;
D O I
10.1016/j.patcog.2025.111475
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This study provides a comprehensive review of the current state of the sign language processing (SLP) field, encompassing sign language recognition (SLR), translation (SLT), production (SLPn), and the associated datasets (SLD). It analyzes the advancements and challenges in each area, highlighting key methodologies and technologies. The authors explore feature extraction techniques, model architectures, and multimodal data integration in SLR. For SLT, they examine neural machine translation and sequence-to-sequence frameworks, emphasizing the need for context-aware systems. In SLPn, they review avatar-based systems and motion capture techniques, identifying gaps in generating natural and expressive sign language. The survey of SLD evaluates existing datasets and underscores the importance of comprehensive data collection. It also discusses current SLP systems' limitations and proposes future research directions to enhance accuracy, naturalness, and user-centric applications.
引用
收藏
页数:15
相关论文
共 50 条
  • [31] Deep Structured Learning for Natural Language Processing
    Li, Yong
    Yang, Xiaojun
    Zuo, Min
    Jin, Qingyu
    Li, Haisheng
    Cao, Qian
    ACM TRANSACTIONS ON ASIAN AND LOW-RESOURCE LANGUAGE INFORMATION PROCESSING, 2021, 20 (03)
  • [32] Deep Learning on Graphs for Natural Language Processing
    Wu, Lingfei
    Chen, Yu
    Ji, Heng
    Liu, Bang
    SIGIR '21 - PROCEEDINGS OF THE 44TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2021, : 2651 - 2653
  • [33] AUTOMATIC SIGN LANGUAGE IDENTIFICATION
    Gebre, Binyam Gebrekidan
    Wittenburg, Peter
    Heskes, Tom
    2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, : 2626 - 2630
  • [34] Deep Learning Technology to Recognize American Sign Language Alphabet
    Alsharif, Bader
    Altaher, Ali Salem
    Altaher, Ahmed
    Ilyas, Mohammad
    Alalwany, Easa
    SENSORS, 2023, 23 (18)
  • [35] Sign Language Recognition with Multimodal Sensors and Deep Learning Methods
    Lu, Chenghong
    Kozakai, Misaki
    Jing, Lei
    ELECTRONICS, 2023, 12 (23)
  • [36] Development of Sign Language Recognition Application Using Deep Learning
    Rajalakshmi, N. R.
    NEXT GENERATION OF INTERNET OF THINGS, 2023, 445 : 299 - 308
  • [37] Deep Learning-Based Standard Sign Language Discrimination
    Zhang, Menglin
    Yang, Shuying
    Zhao, Min
    IEEE ACCESS, 2023, 11 : 125822 - 125834
  • [38] Alphabet Sign Language Image Classification Using Deep Learning
    Daroya, Rangel
    Peralta, Daryl
    Naval, Prospero, Jr.
    PROCEEDINGS OF TENCON 2018 - 2018 IEEE REGION 10 CONFERENCE, 2018, : 0646 - 0650
  • [39] An approach based on deep learning for Indian sign language translation
    Mistree, Kinjal Bhargavkumar
    Thakor, Devendra
    Bhatt, Brijesh
    INTERNATIONAL JOURNAL OF INTELLIGENT COMPUTING AND CYBERNETICS, 2023, 16 (03) : 397 - 419
  • [40] Arabic Sign Language Recognition Using Deep Learning Models
    Al-Barham, Muhammad
    Abu Sa'aleek, Ahmad
    Al-Odat, Mohammad
    Hamad, Ghada
    Al-Yaman, Musa
    Elnagar, Ashraf
    2022 13TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2022, : 226 - 231