Phase Processing for Single-Channel Speech Enhancement

被引:185
作者
Gerkmann, Timo [1 ,2 ,3 ]
Krawczyk-Becker, Martin [1 ]
Le Roux, Jonathan [4 ,5 ]
机构
[1] Siemens Corp Res, Princeton, NJ USA
[2] Royal Inst Technol, Stockholm, Sweden
[3] Carl von Ossietzky Univ Oldenburg, D-26111 Oldenburg, Germany
[4] Mitsubishi Elect Res Labs, Cambridge, MA USA
[5] Nippon Telegraph & Tel Commun Sci Labs, Kyoto, Japan
关键词
SPECTRAL MAGNITUDE ESTIMATION; TIME FOURIER-TRANSFORM; SIGNAL ESTIMATION; VOCODER; AUDIO;
D O I
10.1109/MSP.2014.2369251
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the advancement of technology, both assisted listening devices and speech communication devices are becoming more portable and also more frequently used. As a consequence, users of devices such as hearing aids, cochlear implants, and mobile telephones, expect their devices to work robustly anywhere and at any time. This holds in particular for challenging noisy environments like a cafeteria, a restaurant, a subway, a factory, or in traffic. One way to making assisted listening devices robust to noise is to apply speech enhancement algorithms. To improve the corrupted speech, spatial diversity can be exploited by a constructive combination of microphone signals (so-called beamforming), and by exploiting the different spectro-temporal properties of speech and noise. Here, we focus on single-channel speech enhancement algorithms which rely on spectrotemporal properties. On the one hand, these algorithms can be employed when the miniaturization of devices only allows for using a single microphone. On the other hand, when multiple microphones are available, single-channel algorithms can be employed as a postprocessor at the output of a beamformer. To exploit the short-term stationary properties of natural sounds, many of these approaches process the signal in a time-frequency representation, most frequently the short-time discrete Fourier transform (STFT) domain. In this domain, the coefficients of the signal are complex-valued, and can therefore be represented by their absolute value (referred to in the literature both as STFT magnitude and STFT amplitude) and their phase. While the modeling and processing of the STFT magnitude has been the center of interest in the past three decades, phase has been largely ignored. In this article, we review the role of phase processing for speech enhancement in the context of assisted listening and speech communication devices. We explain why most of the research conducted in this field used to focus on estimating spectral magnitudes in the STFT domain, and why recently phase processing is attracting increasing interest in the speech enhancement community. Furthermore, we review both early and recent methods for phase processing in speech enhancement. We aim to show that phase processing is an exciting field of research with the potential to make assisted listening and speech communication devices more robust in acoustically challenging environments.
引用
收藏
页码:55 / 66
页数:12
相关论文
共 30 条
  • [1] A tutorial on onset detection in music signals
    Bello, JP
    Daudet, L
    Abdallah, S
    Duxbury, C
    Davies, M
    Sandler, MB
    [J]. IEEE TRANSACTIONS ON SPEECH AND AUDIO PROCESSING, 2005, 13 (05): : 1035 - 1047
  • [2] Parameterized MMSE spectral magnitude estimation for the enhancement of noisy speech
    Breithaupt, Colin
    Krawczyk, Martin
    Martin, Rainer
    [J]. 2008 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING, VOLS 1-12, 2008, : 4037 - 4040
  • [3] SPEECH ENHANCEMENT USING A MINIMUM MEAN-SQUARE ERROR SHORT-TIME SPECTRAL AMPLITUDE ESTIMATOR
    EPHRAIM, Y
    MALAH, D
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1984, 32 (06): : 1109 - 1121
  • [4] PHASE VOCODER
    FLANAGAN, JL
    GOLDEN, RM
    [J]. BELL SYSTEM TECHNICAL JOURNAL, 1966, 45 (09): : 1493 - +
  • [5] Bayesian Estimation of Clean Speech Spectral Coefficients Given a Priori Knowledge of the Phase
    Gerkmann, Timo
    [J]. IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2014, 62 (16) : 4199 - 4208
  • [6] MMSE-Optimal Spectral Amplitude Estimation Given the STFT-Phase
    Gerkmann, Timo
    Krawczyk, Martin
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (02) : 129 - 132
  • [7] Gnann V., 2010, P INT C DIG AUD EFF
  • [8] Griffin D. W., 1983, THESIS MIT
  • [9] SIGNAL ESTIMATION FROM MODIFIED SHORT-TIME FOURIER-TRANSFORM
    GRIFFIN, DW
    LIM, JS
    [J]. IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1984, 32 (02): : 236 - 243
  • [10] Iterative Phase Estimation for the Synthesis of Separated Sources From Single-Channel Mixtures
    Gunawan, David
    Sen, D.
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2010, 17 (05) : 421 - 424