Sign Language Translation: A Survey of Approaches and Techniques

被引：11
作者：
Liang, Zeyu [1 ]
Li, Huailing [1 ]
Chai, Jianping [1 ]
机构：
[1] Commun Univ China, Sch Data Sci & Intelligent Media, Beijing 100024, Peoples R China
来源：
ELECTRONICS | 2023年 / 12卷 / 12期
关键词：
sign language translation; transformer; DHH; sign language recognition; RECOGNITION;
D O I：
10.3390/electronics12122678
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
Sign language is the main communication way for deaf and hard-of-hearing (i.e., DHH) people, which is unfamiliar to most non-deaf and hard-of-hearing (non-DHH) people. To break down the communication barriers between DHH and non-DHH people and to better promote communication among DHH individuals, we have summarized the research progress on sign language translation. We provide the necessary background on sign language translation and introduce its four subtasks (i.e., sign2gloss2text, sign2text, sign2(gloss+text), and gloss2text). We distill the basic mode of sign language translation (SLT) and introduce the transformer-based framework of SLT. We analyze the main challenges of SLT and propose possible directions for its development.
引用
收藏
页数：18
相关论文
共 100 条
[41]  
Kim S, 2020, I C INF COMM TECH CO, P1303, DOI [10.1109/ictc49870.2020.9289551, 10.1109/ICTC49870.2020.9289551]
[42]   Neural Sign Language Translation Based on Human Keypoint Estimation [J].
Ko, Sang-Ki ;
Kim, Chang Jo ;
Jung, Hyedong ;
Cho, Choongsang .
APPLIED SCIENCES-BASEL, 2019, 9 (13)
[43]  
Koller O, 2020, Arxiv, DOI arXiv:2008.09918
[44]   Deep Sign: Enabling Robust Statistical Continuous Sign Language Recognition via Hybrid CNN-HMMs [J].
Koller, Oscar ;
Zargaran, Sepehr ;
Ney, Hermann ;
Bowden, Richard .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2018, 126 (12) :1311-1325
[45]   Deep Hand: How to Train a CNN on 1 Million Hand Images When Your Data Is Continuous and Weakly Labelled [J].
Koller, Oscar ;
Ney, Hermann ;
Bowden, Richard .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :3793-3802
[46]   Continuous sign language recognition: Towards large vocabulary statistical recognition systems handling multiple signers [J].
Koller, Oscar ;
Forster, Jens ;
Ney, Hermann .
COMPUTER VISION AND IMAGE UNDERSTANDING, 2015, 141 :108-125
[47]   Time Series Neural Networks For Real Time Sign Language Translation [J].
Kumar, Sujay S. ;
Wangyal, Tenzin ;
Saboo, Varun ;
Srinath, Ramamoorthy .
2018 17TH IEEE INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND APPLICATIONS (ICMLA), 2018, :243-248
[48]   Temporal Convolutional Networks for Action Segmentation and Detection [J].
Lea, Colin ;
Flynn, Michael D. ;
Vidal, Rene ;
Reiter, Austin ;
Hager, Gregory D. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :1003-1012
[49]  
Li D., 2020, Adv. Neural Inf. Process. Syst., V33, P12034
[50]  
Li DX, 2020, IEEE WINT CONF APPL, P1448, DOI [10.1109/WACV45572.2020.9093512, 10.1109/wacv45572.2020.9093512]
12345678910