Multichannel Linear Prediction-Based Speech Dereverberation Considering Sparse and Low-Rank Priors

被引:1
作者
Wang, Taihui [1 ,2 ]
Yang, Feiran [3 ]
Yang, Jun [1 ,2 ]
机构
[1] Chinese Acad Sci, Key Lab Noise & Vibrat Res, Inst Acoust, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, State Key Lab Acoust, Inst Acoust, Beijing 100190, Peoples R China
基金
中国国家自然科学基金;
关键词
Speech processing; Reverberation; Microphones; Time-frequency analysis; Shape; Indexes; Cost function; Speech dereverberation; multichannel linear prediction; weighted prediction error; complex generalized Gaussian; nonnegative matrix factorization; TIME; REVERBERATION; MASKING; DOMAIN; SYSTEM; NOISE;
D O I
10.1109/TASLP.2024.3369535
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
This article addresses the multi-channel linear prediction (MCLP)-based speech dereverberation problem by jointly considering the sparsity and low-rank priors of speech spectrograms. We utilize the complex generalized Gaussian (CGG) distribution as the source model and the generalized nonnegative matrix factorization (NMF) as the spectral model. The difference between the presented model and existing ones for MCLP is twofold. First, we adopt the CGG distribution with a time-frequency-variant scale parameter instead of that with a time-frequency-invariant scale parameter. Second, the time-frequency-varying scale parameter is approximated by NMF in a low-rank manner. Based on the maximum-likelihood criterion, speech dereverberation is formulated as an optimization problem that minimizes the prediction error weighted by the reciprocal of sparse and low-rank parameters. A convergence-guaranteed algorithm is derived to estimate the parameters using the majorization-minimization technology. The WPE, NMF-based WPE and CGG-based WPE can be treated as special cases of the proposed method with different shape and domain parameters. As a byproduct, the proposed method provides a simple and elegant way to derive the CGG-based WPE algorithm. A series of experiments show the superiority of the proposed method over WPE, NMF-based WPE and CGG-based WPE methods.
引用
收藏
页码:1724 / 1735
页数:12
相关论文
共 35 条
[1]   IMAGE METHOD FOR EFFICIENTLY SIMULATING SMALL-ROOM ACOUSTICS [J].
ALLEN, JB ;
BERKLEY, DA .
JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA, 1979, 65 (04) :943-950
[2]   System identification in the short-time Fourier transform domain with crossband filtering [J].
Avargel, Yekutiel ;
Cohen, Israel .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2007, 15 (04) :1305-1319
[3]   Speech Enhancement via Attention Masking Network (SEAMNET): An End-to-End System for Joint Suppression of Noise and Reverberation [J].
Borgstrom, Bengt J. ;
Brandstein, Michael S. .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2021, 29 :515-526
[4]   Joint NN-Supported Multichannel Reduction of Acoustic Echo, Reverberation and Noise [J].
Carbajal, Guillaume ;
Serizel, Romain ;
Vincent, Emmanuel ;
Humbert, Eric .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2020, 28 (28) :2158-2173
[5]   Late Reverberation Cancellation Using Bayesian Estimation of Multi-Channel Linear Predictors and Student's t-Source Prior [J].
Chetupalli, Srikanth Raj ;
Sreenivas, Thippur, V .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2019, 27 (06) :1007-1018
[6]   Precise dereverberation using multichannel linear prediction [J].
Delcroix, Marc ;
Hikichi, Takafumi ;
Miyoshi, Masato .
IEEE TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2007, 15 (02) :430-440
[7]   Nonnegative Matrix Factorization with the Itakura-Saito Divergence: With Application to Music Analysis [J].
Fevotte, Cedric ;
Bertin, Nancy ;
Durrieu, Jean-Louis .
NEURAL COMPUTATION, 2009, 21 (03) :793-830
[8]   METRICGAN-U: UNSUPERVISED SPEECH ENHANCEMENT/ DEREVERBERATION BASED ONLY ON NOISY/ REVERBERATED SPEECH [J].
Fu, Szu-Wei ;
Yu, Cheng ;
Hung, Kuo-Hsuan ;
Ravanelli, Mirco ;
Tsao, Yu .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :7412-7416
[9]  
Grais EM, 2013, INTERSPEECH, P3278
[10]   Kronecker Product Multichannel Linear Filtering for Adaptive Weighted Prediction Error-Based Speech Dereverberation [J].
Huang, Gongping ;
Benesty, Jacob ;
Cohen, Israel ;
Chen, Jingdong .
IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING, 2022, 30 :1277-1289