Phase Processing for Single-Channel Speech Enhancement

被引:184
|
作者
Gerkmann, Timo [1 ,2 ,3 ]
Krawczyk-Becker, Martin [1 ]
Le Roux, Jonathan [4 ,5 ]
机构
[1] Siemens Corp Res, Princeton, NJ USA
[2] Royal Inst Technol, Stockholm, Sweden
[3] Carl von Ossietzky Univ Oldenburg, D-26111 Oldenburg, Germany
[4] Mitsubishi Elect Res Labs, Cambridge, MA USA
[5] Nippon Telegraph & Tel Commun Sci Labs, Kyoto, Japan
关键词
SPECTRAL MAGNITUDE ESTIMATION; TIME FOURIER-TRANSFORM; SIGNAL ESTIMATION; VOCODER; AUDIO;
D O I
10.1109/MSP.2014.2369251
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the advancement of technology, both assisted listening devices and speech communication devices are becoming more portable and also more frequently used. As a consequence, users of devices such as hearing aids, cochlear implants, and mobile telephones, expect their devices to work robustly anywhere and at any time. This holds in particular for challenging noisy environments like a cafeteria, a restaurant, a subway, a factory, or in traffic. One way to making assisted listening devices robust to noise is to apply speech enhancement algorithms. To improve the corrupted speech, spatial diversity can be exploited by a constructive combination of microphone signals (so-called beamforming), and by exploiting the different spectro-temporal properties of speech and noise. Here, we focus on single-channel speech enhancement algorithms which rely on spectrotemporal properties. On the one hand, these algorithms can be employed when the miniaturization of devices only allows for using a single microphone. On the other hand, when multiple microphones are available, single-channel algorithms can be employed as a postprocessor at the output of a beamformer. To exploit the short-term stationary properties of natural sounds, many of these approaches process the signal in a time-frequency representation, most frequently the short-time discrete Fourier transform (STFT) domain. In this domain, the coefficients of the signal are complex-valued, and can therefore be represented by their absolute value (referred to in the literature both as STFT magnitude and STFT amplitude) and their phase. While the modeling and processing of the STFT magnitude has been the center of interest in the past three decades, phase has been largely ignored. In this article, we review the role of phase processing for speech enhancement in the context of assisted listening and speech communication devices. We explain why most of the research conducted in this field used to focus on estimating spectral magnitudes in the STFT domain, and why recently phase processing is attracting increasing interest in the speech enhancement community. Furthermore, we review both early and recent methods for phase processing in speech enhancement. We aim to show that phase processing is an exciting field of research with the potential to make assisted listening and speech communication devices more robust in acoustically challenging environments.
引用
收藏
页码:55 / 66
页数:12
相关论文
共 50 条
  • [21] EFFECTIVE POST-PROCESSING FOR SINGLE-CHANNEL FREQUENCY-DOMAIN SPEECH ENHANCEMENT
    Li, Weifeng
    2008 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-4, 2008, : 149 - 152
  • [22] CompNet: Complementary network for single-channel speech enhancement
    Fan, Cunhang
    Zhang, Hongmei
    Li, Andong
    Xiang, Wang
    Zheng, Chengshi
    Lv, Zhao
    Wu, Xiaopei
    NEURAL NETWORKS, 2023, 168 : 508 - 517
  • [23] Single-channel speech enhancement using colored spectrograms
    Gul, Sania
    Khan, Muhammad Salman
    Fazeel, Muhammad
    COMPUTER SPEECH AND LANGUAGE, 2024, 86
  • [24] Comparative Studies of Single-Channel Speech Enhancement Techniques
    Kumar, Bittu
    Kumar, Neeraj
    Kumar, Manoj
    Prasad, S. V. S.
    Varma, Ashwini Kumar
    Ravi, Banoth
    IETE JOURNAL OF RESEARCH, 2024, 70 (06) : 5704 - 5720
  • [25] Single-Channel Speech Enhancement Using Double Spectrum
    Blass, Martin
    Mowlaee, Pejman
    Kleijn, W. Bastiaan
    17TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2016), VOLS 1-5: UNDERSTANDING SPEECH PROCESSING IN HUMANS AND MACHINES, 2016, : 1740 - 1744
  • [26] A spectral conversion approach to single-channel speech enhancement
    Mouchtaris, Athanasios
    Van der Spiegel, Jan
    Mueller, Paul
    Tsakalides, Panagiotis
    IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2007, 15 (04): : 1180 - 1193
  • [27] UltraSE: Single-Channel Speech Enhancement Using Ultrasound
    Sun, Ke
    Zhang, Xinyu
    PROCEEDINGS OF THE 27TH ACM ANNUAL INTERNATIONAL CONFERENCE ON MOBILE COMPUTING AND NETWORKING (ACM MOBICOM '21), 2021, : 160 - 173
  • [28] Harmonic Phase Estimation in Single-Channel Speech Enhancement Using Phase Decomposition and SNR Information
    Mowlaee, Pejman
    Kulmer, Josef
    IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (09) : 1521 - 1532
  • [29] Iterative Closed-Loop Phase-Aware Single-Channel Speech Enhancement
    Mowlaee, Pejman
    Saeidi, Rahim
    IEEE SIGNAL PROCESSING LETTERS, 2013, 20 (12) : 1235 - 1239
  • [30] Adaptive recurrent nonnegative matrix factorization with phase compensation for Single-Channel speech enhancement
    Tank, Vanita Raj
    Mahajan, Shrinivas Padmakar
    MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (20) : 28249 - 28294