A survey on recent advances in Sign Language Production

被引:8
作者
Rastgoo, Razieh [1 ]
Kiani, Kourosh [1 ]
Escalera, Sergio [2 ,3 ]
Athitsos, Vassilis [4 ]
Sabokrou, Mohammad [5 ]
机构
[1] Semnan Univ, Elect & Comp Engn Dept, Semnan 3513119111, Iran
[2] Univ Barcelona, Dept Math & Informat, Barcelona, Spain
[3] Comp Vis Ctr, Barcelona, Spain
[4] Univ Texas Arlington, Arlington, TX 76019 USA
[5] Inst Res Fundamental Sci IPM, Tehran 193955746, Iran
关键词
Sign Language Production; Sign Language Recognition; Sign Language Translation; Deep learning; Survey; Deaf; MOTION CAPTURE;
D O I
10.1016/j.eswa.2023.122846
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Sign Language is the dominant form of communication language used in the Deaf and hearing-impaired community. To make easy and mutual communication between the hearing-impaired and the hearing communities, building a robust system capable of translating the spoken language into sign language and vice versa is fundamental. To this end, sign language recognition and production are two necessary parts for making such a two-way system. Sign language recognition and production need to cope with some critical challenges. In this survey, we review recent advances in Sign Language Production (SLP) and related areas using deep learning. To have more realistic perspectives to sign language, we present an introduction to the Deaf culture, Deaf centers, the psychological perspective of sign language, and the main differences between spoken language and sign language. Furthermore, we present the fundamental components of a bi-directional sign language translation system, discussing the main challenges in this area. Also, the backbone architectures and methods in SLP are briefly introduced and the proposed taxonomy of SLP is presented. Finally, a general framework for SLP and performance evaluation, and also a discussion on the recent developments, advantages, and limitations of SLP, commenting on possible lines for future research are presented.
引用
收藏
页数:23
相关论文
共 212 条
[1]   Hand Gesture Recognition for Sign Language Using 3DCNN [J].
Al-Hammadi, Muneer ;
Muhammad, Ghulam ;
Abdul, Wadood ;
Alsulaiman, Mansour ;
Bencherif, Mohamed A. ;
Mekhtiche, Mohamed Amine .
IEEE ACCESS, 2020, 8 :79491-79509
[2]  
Angus B., 1999, 2 HIGH DESERT STUDEN, P23
[3]  
Ankith B., 2022, International Journal of Software Science and Computational Intelligence (IJSSCI), V14, P1
[4]  
[Anonymous], 2022, Facebook Messenger
[5]  
[Anonymous], 2022, WhatsApp Messenger
[6]  
[Anonymous], 2016, ICLR, DOI DOI 10.48550/ARXIV.1511.05440
[7]  
[Anonymous], 2022, Deafness and hearing
[8]  
[Anonymous], 2022, World Health Organization
[9]  
[Anonymous], 2022, shopping-and-auslan
[10]  
Arikan O, 2002, ACM T GRAPHIC, V21, P483, DOI 10.1145/566570.566606