Nonstationary Source Separation Using Sequential and Variational Bayesian Learning

被引:30
作者
Chien, Jen-Tzung [1 ]
Hsieh, Hsin-Lung [1 ]
机构
[1] Natl Chiao Tung Univ, Dept Elect & Comp Engn, Hsinchu 300, Taiwan
关键词
Bayes procedure; blind source separation (BSS); Gaussian process (GP); independent component analysis (ICA); online learning; variational method; BLIND SOURCE SEPARATION; HIDDEN MARKOV-MODELS; MIXTURE;
D O I
10.1109/TNNLS.2013.2242090
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Independent component analysis (ICA) is a popular approach for blind source separation where the mixing process is assumed to be unchanged with a fixed set of stationary source signals. However, the mixing system and source signals are non-stationary in real-world applications, e. g., the source signals may abruptly appear or disappear, the sources may be replaced by new ones or even moving by time. This paper presents an online learning algorithm for the Gaussian process (GP) and establishes a separation procedure in the presence of nonstationary and temporally correlated mixing coefficients and source signals. In this procedure, we capture the evolved statistics from sequential signals according to online Bayesian learning. The activity of nonstationary sources is reflected by an automatic relevance determination, which is incrementally estimated at each frame and continuously propagated to the next frame. We employ the GP to characterize the temporal structures of time-varying mixing coefficients and source signals. A variational Bayesian inference is developed to approximate the true posterior for estimating the nonstationary ICA parameters and for characterizing the activity of latent sources. The differences between this ICA method and the sequential Monte Carlo ICA are illustrated. In the experiments, the proposed algorithm outperforms the other ICA methods for the separation of audio signals in the presence of different nonstationary scenarios.
引用
收藏
页码:681 / 694
页数:14
相关论文
共 52 条
[1]  
Ahmed A, 2000, INT CONF ACOUST SPEE, P3148, DOI 10.1109/ICASSP.2000.861205
[2]   Joint Blind Source Separation With Multivariate Gaussian Model: Algorithms and Performance Analysis [J].
Anderson, Matthew ;
Adali, Tuelay ;
Li, Xi-Lin .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2012, 60 (04) :1672-1683
[3]  
[Anonymous], 2003, Multivariate Bayesian Statistics
[4]  
[Anonymous], 2006, Pattern recognition and machine learning
[5]  
[Anonymous], VARIATIONAL BAYESIAN
[6]   AN INFORMATION MAXIMIZATION APPROACH TO BLIND SEPARATION AND BLIND DECONVOLUTION [J].
BELL, AJ ;
SEJNOWSKI, TJ .
NEURAL COMPUTATION, 1995, 7 (06) :1129-1159
[7]   Smoothing Neural Network for Constrained Non-Lipschitz Optimization With Applications [J].
Bian, Wei ;
Chen, Xiaojun .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (03) :399-411
[8]   Variational and stochastic inference for Bayesian source separation [J].
Cemgil, A. Taylan ;
Fevotte, Cedric ;
Godsill, Simon J. .
DIGITAL SIGNAL PROCESSING, 2007, 17 (05) :891-913
[9]   Variational learning of clusters of undercomplete nonsymmetric independent components [J].
Chan, K ;
Lee, TW ;
Sejnowski, TJ .
JOURNAL OF MACHINE LEARNING RESEARCH, 2003, 3 (01) :99-114
[10]  
Chien J.-T., 2012, P ANN C INT SPEECH C