Automatic Speech Recognition for Supporting Endangered Language Documentation

被引:0
作者
Prud'hommeaux, Emily [1 ]
Jimerson, Robbie [2 ]
Hatcher, Richard [3 ]
Michelson, Karin [3 ]
机构
[1] Boston Coll, Chestnut Hill, MA 02167 USA
[2] Rochester Inst Technol, Rochester, NY USA
[3] Univ Buffalo, Buffalo, NY USA
来源
LANGUAGE DOCUMENTATION & CONSERVATION | 2021年 / 15卷
基金
美国国家科学基金会;
关键词
UNDER-RESOURCED LANGUAGES; NEURAL-NETWORKS; TRANSCRIPTION; ALIGNMENT; ASR;
D O I
暂无
中图分类号
H0 [语言学];
学科分类号
030303 ; 0501 ; 050102 ;
摘要
Generating accurate word-level transcripts of recorded speech for language documentation is difficult and time-consuming, even for skilled speakers of the target language. Automatic speech recognition (ASR) has the potential to streamline transcription efforts for endangered language documentation, but the practical utility of ASR for this purpose has not been fully explored. In this paper, we present results of a study in which both linguists and community members, with varying levels of language proficiency, transcribe audio recordings of an endangered language under timed conditions with and without the assistance of ASR. We find that both time-to-transcribe and transcription error rates are significantly reduced when correcting ASR for language learners of all levels. Despite these improvements, most community members in our study express a preference for unassisted transcription, highlighting the need for developers to directly engage with stakeholders when designing and deploying technologies for supporting language documentation.
引用
收藏
页码:491 / 513
页数:23
相关论文
共 78 条
[61]   Computer-based speech recognition as a replacement for medical transcription [J].
Rosenthal, DI ;
Chew, FS ;
Dupuy, DE ;
Kattapuram, SV ;
Palmer, WE ;
Yap, RM ;
Levine, LA .
AMERICAN JOURNAL OF ROENTGENOLOGY, 1998, 170 (01) :23-25
[62]   English Conversational Telephone Speech Recognition by Humans and Machines [J].
Saon, George ;
Kurata, Gakuto ;
Sercu, Tom ;
Audhkhasi, Kartik ;
Thomas, Samuel ;
Dimitriadis, Dimitrios ;
Cui, Xiaodong ;
Ramabhadran, Bhuvana ;
Picheny, Michael ;
Lim, Lynn-Li ;
Roomi, Bergul ;
Hall, Phil .
18TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2017), VOLS 1-6: SITUATED INTERACTION, 2017, :132-136
[63]  
Scharenborg O, 2017, P INT C NAT LANG SIG, P26
[64]   wav2vec: Unsupervised Pre-training for Speech Recognition [J].
Schneider, Steffen ;
Baevski, Alexei ;
Collobert, Ronan ;
Auli, Michael .
INTERSPEECH 2019, 2019, :3465-3469
[65]   Language documentation twenty-five years on [J].
Seifart, Frank ;
Evans, Nicholas ;
Hammarstrom, Harald ;
Levinson, Stephen C. .
LANGUAGE, 2018, 94 (04) :E324-E345
[66]  
Simons Gary F., 2019, Proc Ling Soc, V27, P1
[67]   Transcribing against time [J].
Sperber, Matthias ;
Neubig, Graham ;
Niehues, Jan ;
Nakamura, Satoshi ;
Waibel, Alex .
SPEECH COMMUNICATION, 2017, 93 :20-30
[68]  
Sperber Matthias, 2016, P 10 INT C LANG RES
[69]  
Stoian MC, 2020, INT CONF ACOUST SPEE, P7909, DOI [10.1109/ICASSP40776.2020.9053847, 10.1109/icassp40776.2020.9053847]
[70]  
Strunk J, 2014, LREC 2014 - NINTH INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION, P3940