Multichannel Linear Prediction-Based Speech Dereverberation Considering Sparse and Low-Rank Priors

被引:1
作者
Wang, Taihui [1 ,2 ]
Yang, Feiran [3 ]
Yang, Jun [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Noise & Vibrat Res, Inst Acoust, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, State Key Lab Acoust, Inst Acoust, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Speech processing; Reverberation; Microphones; Time-frequency analysis; Shape; Indexes; Cost function; Speech dereverberation; multichannel linear prediction; weighted prediction error; complex generalized Gaussian; nonnegative matrix factorization; TIME; REVERBERATION; MASKING; DOMAIN; SYSTEM; NOISE;
D O I
10.1109/TASLP.2024.3369535
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This article addresses the multi-channel linear prediction (MCLP)-based speech dereverberation problem by jointly considering the sparsity and low-rank priors of speech spectrograms. We utilize the complex generalized Gaussian (CGG) distribution as the source model and the generalized nonnegative matrix factorization (NMF) as the spectral model. The difference between the presented model and existing ones for MCLP is twofold. First, we adopt the CGG distribution with a time-frequency-variant scale parameter instead of that with a time-frequency-invariant scale parameter. Second, the time-frequency-varying scale parameter is approximated by NMF in a low-rank manner. Based on the maximum-likelihood criterion, speech dereverberation is formulated as an optimization problem that minimizes the prediction error weighted by the reciprocal of sparse and low-rank parameters. A convergence-guaranteed algorithm is derived to estimate the parameters using the majorization-minimization technology. The WPE, NMF-based WPE and CGG-based WPE can be treated as special cases of the proposed method with different shape and domain parameters. As a byproduct, the proposed method provides a simple and elegant way to derive the CGG-based WPE algorithm. A series of experiments show the superiority of the proposed method over WPE, NMF-based WPE and CGG-based WPE methods.
引用
收藏
页码:1724 / 1735
页数:12
相关论文
共 35 条
[11]  
Ito Nobutaka, 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), P5167, DOI 10.1109/ICASSP.2014.6854588
[12]   A General Framework for Incorporating Time-Frequency Domain Sparsity in Multichannel Speech Dereverberation [J].
Jukic, Ante ;
van Waterschoot, Toon ;
Gerkmann, Timo ;
Doclo, Simon .
JOURNAL OF THE AUDIO ENGINEERING SOCIETY, 2017, 65 (1-2) :17-30
[13]  
Jukic A, 2015, INT CONF ACOUST SPEE, P96, DOI 10.1109/ICASSP.2015.7177939
[14]   Multi-Channel Linear Prediction-Based Speech Dereverberation With Sparse Priors [J].
Jukic, Ante ;
van Waterschoot, Toon ;
Gerkmann, Timo ;
Doclo, Simon .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2015, 23 (09) :1509-1520
[15]   Suppression of Late Reverberation Effect on Speech Signal Using Long-Term Multiple-step Linear Prediction [J].
Kinoshita, Keisuke ;
Delcroix, Marc ;
Nakatani, Tomohiro ;
Miyoshi, Masato .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2009, 17 (04) :1-12
[16]   SkipConvNet: Skip Convolutional Neural Network for Speech Dereverberation using Optimally Smoothed Spectral Mapping [J].
Kothapally, Vinay ;
Xia, Wei ;
Ghorbani, Shahram ;
Hansen, John H. L. ;
Xue, Wei ;
Huang, Jing .
INTERSPEECH 2020, 2020, :3935-3939
[17]   Single-channel dereverberation and denoising based on lower band trained SA-LSTMs [J].
Li, Yi ;
Sun, Yang ;
Naqvi, Syed Mohsen .
IET SIGNAL PROCESSING, 2020, 14 (10) :774-782
[18]   Robust Multichannel Dereverberation using Relaxed Multichannel Least Squares [J].
Lim, Felicia ;
Zhang, Wancheng ;
Habets, Emanuel A. P. ;
Naylor, Patrick A. .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2014, 22 (09) :1379-1390
[19]  
Malik S., 2012, IEEE Signal Processing Letters, V19, P511, DOI 10.1109/LSP.2012.2204873
[20]   Speech Dereverberation Based on Maximum-Likelihood Estimation With Time-Varying Gaussian Source Model [J].
Nakatani, Tomohiro ;
Juang, Biing-Hwang ;
Yoshioka, Takuya ;
Kinoshita, Keisuke ;
Delcroix, Marc ;
Miyoshi, Masato .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2008, 16 (08) :1512-1527