Automated Sign Language Translation: The Role of Artificial Intelligence Now and in the Future

被引：8
作者：
Baumgaertner, Lea [1 ]
Jauss, Stephanie [1 ]
Maucher, Johannes [1 ]
Zimmermann, Gottfried [1 ]
机构：
[1] Hsch Medien, Nobelstr 10, D-70569 Stuttgart, Germany
来源：
PROCEEDINGS OF THE 4TH INTERNATIONAL CONFERENCE ON COMPUTER-HUMAN INTERACTION RESEARCH AND APPLICATIONS (CHIRA) | 2020年
关键词：
Sign Language Translation; Sign Language Recognition; Sign Language Generation; Artificial Intelligence;
D O I：
10.5220/0010143801700177
中图分类号：
TP3 [计算技术、计算机技术];
学科分类号：
0812 ;
摘要：
Sign languages are the primary language of many people worldwide. To overcome communication barriers between the Deaf and the hearing community, artificial intelligence technologies have been employed, aiming to develop systems for automated sign language recognition and generation. Particularities of sign languages have to be considered - though sharing some characteristics of spoken languages - since they differ in others. After providing the linguistic foundations, this paper gives an overview of state-of-the-art machine learning approaches to develop sign language translation systems and outlines the challenges in this area that have yet to be overcome. Obstacles do not only include technological issues but also interdisciplinary considerations of development, evaluation and adoption of such technologies. Finally, opportunities and future visions of automated sign language translation systems are discussed.
引用
收藏
页码：170 / 177
页数：8
相关论文
共 26 条
[1]   ASL-Pro: American Sign Language Animation with Prosodic Elements [J].
Adamo-Villani, Nicoletta ;
Wilbur, Ronnie B. .
UNIVERSAL ACCESS IN HUMAN-COMPUTER INTERACTION: ACCESS TO INTERACTION, PT II, 2015, 9176 :307-318
[2]   Modeling the Speed and Timing of American Sign Language to Generate Realistic Animations [J].
Al-khazraji, Sedeeq ;
Berke, Larwan ;
Kafle, Sushant ;
Yeung, Peter ;
Huenerfauth, Matt .
ASSETS'18: PROCEEDINGS OF THE 20TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2018, :259-270
[3]  
Bavelier D., 2003, CHILDREN NEED NATURA
[4]   Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective [J].
Bragg, Danielle ;
Koller, Oscar ;
Bellard, Mary ;
Berke, Larwan ;
Boudreault, Patrick ;
Braffort, Annelies ;
Caselli, Naomi ;
Huenerfauth, Matt ;
Kacorri, Hernisa ;
Verhoef, Tessa ;
Vogler, Christian ;
Morris, Meredith Ringel .
ASSETS'19: THE 21ST INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2019, :16-31
[5]   SubUNets: End-to-end Hand Shape and Continuous Sign Language Recognition [J].
Camgoz, Necati Cihan ;
Hadfield, Simon ;
Koller, Oscar ;
Bowden, Richard .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :3075-3084
[6]   Neural Sign Language Translation [J].
Camgoz, Necati Cihan ;
Hadfield, Simon ;
Koller, Oscar ;
Ney, Hermann ;
Bowden, Richard .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :7784-7793
[7]   Signing avatars: making education more inclusive [J].
De Martino, Jose Mario ;
Silva, Ivani Rodrigues ;
Bolognini, Carmen Zink ;
Paro Costa, Paula Dornhofer ;
Oliveira Kumada, Kate Mamhy ;
Coradine, Luis Claudius ;
da Silva Brito, Patrick Henrique ;
do Amaral, Wanessa Machado ;
Benetti, Angelo Brandao ;
Poeta, Enzo Telles ;
Guertzenstein Angare, Leandro Martin ;
Ferreira, Carolina Monteiro ;
De Conti, Davi Faria .
UNIVERSAL ACCESS IN THE INFORMATION SOCIETY, 2017, 16 (03) :793-808
[8]   Augmented Sign Language Modeling(ASLM) with interaction design on smartphone - an assistive learning and communication tool for inclusive classroom [J].
Deb, Suman ;
Suraksha ;
Bhattacharya, Paritosh .
6TH INTERNATIONAL CONFERENCE ON SMART COMPUTING AND COMMUNICATIONS, 2018, 125 :492-500
[9]  
Deutscher Gehorlosen-Bund e.V. (DGB), GEH
[10]   Cross-modal Neural Sign Language Translation [J].
Duarte, Amanda .
PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, :1650-1654
123