Air traffic control speech recognition system cross-task & speaker adaptation

被引:12
作者
de Cordoba, R. [1 ]
Ferreiros, J. [1 ]
San-Segundo, R. [1 ]
Macias-Guarasa, J. [1 ]
Montero, J. M. [1 ]
Fernandez, F. [1 ]
D'Haro, L. F. [1 ]
Pardo, J. M. [1 ]
机构
[1] Univ Politecn Madrid, Speech Technol Grp, Dept Elect Engn, ETSI Telecomunicat, E-28040 Madrid, Spain
关键词
D O I
10.1109/MAES.2006.1705165
中图分类号
V [航空、航天];
学科分类号
08 ; 0825 ;
摘要
We present an overview of the most common techniques used in automatic speech recognition to adapt a general system to a different environment (known as cross-task adaptation) such as in an air traffic control system (ATC). The conditions present in ATC are very specific: very spontaneous, the presence of noise, and high speed speech. So, with a typical speech recognizer the recognition results are unsatisfactory. We have to decide on the best option for the modeling: to develop acoustic models specific to those conditions from scratch using the data available for the new environment, or to carry out cross-task adaptation starting from reliable MUM models (usually requiring less data in the target domain). We begin with a description of the main techniques considered for cross-task adaptation, namely Maximum A Posteriori (MAP), Maximum Likelihood Linear Regression (MLLR), and the two together. We have applied each in two speech recognizers for air traffic. control tasks, one for spontaneous speech and the other for a command interface. We show the performance of these techniques and compare them with the development of a new system from scratch. We also show the results obtained for speaker adaptation using a variable amount of adaptation data. The main conclusion is that MLLR can outperform MAP when a large number of transforms is used, and MLLR followed by MAP is the best option. All of these techniques are better than developing a new system from scratch, showing the effectiveness of mean and variance adaptation.
引用
收藏
页码:12 / 17
页数:6
相关论文
共 50 条
[31]   SPEAKER ADAPTATION USING SPECTRAL INTERPOLATION FOR SPEECH RECOGNITION [J].
SHINODA, K ;
ISO, KI ;
WATANABE, T .
ELECTRONICS AND COMMUNICATIONS IN JAPAN PART III-FUNDAMENTAL ELECTRONIC SCIENCE, 1994, 77 (10) :1-11
[32]   LSTM based Cross-corpus and Cross-task Acoustic Emotion Recognition [J].
Kaya, Heysem ;
Fedotov, Dmitrii ;
Yesilkanat, Ali ;
Verkholyak, Oxana ;
Zhang, Yang ;
Karpov, Alexey .
19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6: SPEECH RESEARCH FOR EMERGING MARKETS IN MULTILINGUAL SOCIETIES, 2018, :521-525
[33]   Meta-Modulation: A General Learning Framework for Cross-Task Adaptation [J].
Lu, Jiang ;
Xiao, Changming ;
Zhang, Changshui .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2025, 36 (04) :6407-6421
[34]   Adaptation of hidden Markov model for telephone speech recognition and speaker adaptation [J].
Natl Tsing Hua Univ, Hsinchu, Taiwan .
IEE Proc Vision Image Signal Proc, 3 (129-135)
[35]   Adaptation of hidden Markov model for telephone speech recognition and speaker adaptation [J].
Chien, JT ;
Wang, HC .
IEE PROCEEDINGS-VISION IMAGE AND SIGNAL PROCESSING, 1997, 144 (03) :129-135
[36]   Speaker adaptation techniques for speech recognition with a speaker-independent phonetic recognizer [J].
Kim, WG ;
Jang, M .
COMPUTATIONAL INTELLIGENCE AND SECURITY, PT 1, PROCEEDINGS, 2005, 3801 :95-100
[37]   SPEAKER ADAPTATION OF RNN-BLSTM FOR SPEECH RECOGNITION BASED ON SPEAKER CODE [J].
Huang, Zhiying ;
Tang, Jian ;
Xue, Shaofei ;
Dai, Lirong .
2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS, 2016, :5305-5309
[38]   Speech GAU: A Single Head Attention for Mandarin Speech Recognition for Air Traffic Control [J].
Zhang, Shiyu ;
Kong, Jianguo ;
Chen, Chao ;
Li, Yabin ;
Liang, Haijun .
AEROSPACE, 2022, 9 (08)
[39]   A Unified Framework for Multilingual Speech Recognition in Air Traffic Control Systems [J].
Lin, Yi ;
Guo, Dongyue ;
Zhang, Jianwei ;
Chen, Zhengmao ;
Yang, Bo .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021, 32 (08) :3608-3620
[40]   Unsupervised Learning for Automatic Speech Recognition in Air Traffic Control Environment [J].
Formoe, Lars ;
Mygind, Dan Bruun ;
Lokke, Espen ;
Ogul, Hasan .
TEXT, SPEECH, AND DIALOGUE, TSD 2023, 2023, 14102 :239-248