Robust speech recognition in reverberant environments by using an optimal synthetic room impulse response model

被引:8
作者
Liu, Jindong [1 ]
Yang, Guang-Zhong [1 ]
机构
[1] Univ London Imperial Coll Sci Technol & Med, Hamlyn Ctr, London, England
关键词
Speech recognition; Reverberant environment; Artificial synthetic room impulse response;
D O I
10.1016/j.specom.2014.11.004
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This paper presents a practical technique for Automatic speech recognition (ASR) in multiple reverberant environment selection. Multiple ASR models are trained with artificial synthetic room impulse responses (IRs), i.e. simulated room IRs, with different reverberation time (T(60)(Model)s) and tested on real room IRs with varying T(60)(Room)s. To apply our method, the biggest challenge is to choose a proper artificial room IR model for training ASR models. In this paper, a generalised statistical IR model with attenuated reverberation after an early reflection period, named attenuated IR model, has been adopted based on three time-domain statistical IR models. Its optimal values of the reverberation-attenuation factor and the early reflection period on the recognition rate have been searched and determined. Extensive testing has been performed over four real room IR sets (63 IRs in total) with variant T(60)(Room)s and speaker microphone distances (SMDs). The optimised attenuated IR model had the best performance in terms of recognition rate over others. Specific considerations of the practical use of the method have been taken into account including: (i) the maximal training step of T-60(Model) in order to get the minimal number of models with acceptable performance; (ii) the impact of selection errors on the ASR caused by the estimation error of T-60(Room); and (iii) the performance over SMD and direct-to-reverberation energy Ratio (DRR). It is shown that recognition rates of over 80 similar to 90% are achieved in most cases. One important advantage of the method is that T-60(Room) can be estimated either from reverberant sound directly (Takeda et al., 2009; Falk and Chan, 2010; Lollmann et al., 2010) or from an IR measured from any point of the room as it remains constant in the same room (Kuttruff, 2000), thus it is particularly suited to mobile applications. Compared to many classical dereverberation methods, the proposed method is more suited to ASR tasks in multiple reverberant environments, such as human-robot interaction. (C) 2014 Elsevier B.V. All rights reserved.
引用
收藏
页码:65 / 77
页数:13
相关论文
共 39 条
  • [1] IMAGE METHOD FOR EFFICIENTLY SIMULATING SMALL-ROOM ACOUSTICS
    ALLEN, JB
    BERKLEY, DA
    [J]. JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1979, 65 (04) : 943 - 950
  • [2] [Anonymous], 2000, Room acoustics
  • [3] [Anonymous], 16 EUR SIGN PROC C E
  • [4] [Anonymous], 1 ANN C INT SPEECH C
  • [5] [Anonymous], ISO3382
  • [6] [Anonymous], HTK BOOK HTK V2 0
  • [7] [Anonymous], FORUM ACUSTICUM
  • [8] [Anonymous], 2008, 16 EUR SIGN PROC C E
  • [9] [Anonymous], IEEE T ACOUST SPEECH
  • [10] Updated MINDS Report on Speech Recognition and Understanding, Part 2
    Baker, Janet M.
    Deng, Li
    Khudanpur, Sanjeev
    Lee, Chin-Hui
    Glass, James R.
    Morgan, Nelson
    O'Shaughnessy, Douglas
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2009, 26 (04) : 78 - 85