Chat in the Hat: A Portable Interpreter for Sign Language Users

被引：5

作者：

Berke, Larwan ^{[1
]}

Thies, William ^{[2
]}

Bragg, Danielle ^{[3
]}

机构：

[1] Gallaudet Univ, Washington, DC 20002 USA

[2] Microsoft Res, Bangalore, Karnataka, India

[3] Microsoft Res, Cambridge, MA USA

来源：

22ND INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY (ASSETS '20) | 2020年

关键词：

Video Remote Interpreting (VRI); Deaf; DHH; Accessibility; Augmented Reality;

D O I：

10.1145/3373625.3417026

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

Many Deaf and Hard-of-Hearing (DHH) individuals rely on sign language interpreting to communicate with hearing peers. If onsite interpreting is not available, DHH individuals may use remote interpreting over a smartphone video-call. However, this solution requires the DHH individual to give up either 1) the use of one signing hand by holding the smartphone or 2) their ability to multitask and move around by propping the smartphone up in a fixed location. We explore this problem within the context of the workplace, and present a prototype hands-free device using augmented reality glasses with a hat-mounted fisheye camera and mic/speaker. To explore the validity of our design, we conducted 1) a video interpretability experiment, and 2) a user study with 18 participants (9 DHH, 9 hearing) in a workplace environment. Our results suggest that a hands-free device can support accurate interpretation while enhancing personal interactions.

引用

页数：11

共 26 条

[1]

Bangor A, 2009, J USABILITY STUD, V4, P114

[2] Design and Psychometric Evaluation of American Sign Language Translations of Usability Questionnaires [J].

Berke, Larwan ;

Huenerfauth, Matt ;

Patel, Kasmira .

ACM TRANSACTIONS ON ACCESSIBLE COMPUTING, 2019, 12 (02)

[3] Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspective [J].

Bragg, Danielle ;

Koller, Oscar ;

Bellard, Mary ;

Berke, Larwan ;

Boudreault, Patrick ;

Braffort, Annelies ;

Caselli, Naomi ;

Huenerfauth, Matt ;

Kacorri, Hernisa ;

Verhoef, Tessa ;

Vogler, Christian ;

Morris, Meredith Ringel .

ASSETS'19: THE 21ST INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, 2019, :16-31

[4]

Brooke J., 1996, USABILITY EVALUATION, P189

[5]

Cavender A., 2006, Proceedings of the Sixth International ACM SIGACCESS Conference on Computers and Accessibility, P71, DOI [DOI 10.1145/1168987.1169001, 10.1145/1168987.1169001]

[6]

Cavender AC, 2009, ASSETS'09: PROCEEDINGS OF THE 11TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY, P67

[7] The Impact of Assistive Technology on Communication Quality Between Deaf and Hearing Individuals [J].

Gugenheimer, Jan ;

Plaumann, Katrin ;

Schaub, Florian ;

San Vito, Patrizia Di Campli ;

Duck, Saskia ;

Rabus, Melanie ;

Rukzio, Enrico .

CSCW'17: PROCEEDINGS OF THE 2017 ACM CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK AND SOCIAL COMPUTING, 2017, :669-682

[8] Design and Psychometric Evaluation of an American Sign Language Translation of the System Usability Scale [J].

Huenerfauth, Matt ;

Patel, Kasmira ;

Berke, Larwan .

PROCEEDINGS OF THE 19TH INTERNATIONAL ACM SIGACCESS CONFERENCE ON COMPUTERS AND ACCESSIBILITY (ASSETS'17), 2017, :175-184

[9] Remote Sign Language interpretation using the internet [J].

Hughes, G ;

Hudgins, B ;

MacDougall, J .

SECOND ANNUAL CONFERENCE ON COMMUNICATION NETWORKS AND SERVICES RESEARCH, PROCEEDINGS, 2004, :345-350

[10]

Kokko J., 2007, 4th International Conference on Universal Access in Human-Computer Interaction, UAHCI 2007, P716

← 1 2 3 →