SPARSITY AWARE MINIMUM ERROR ENTROPY ALGORITHMS

被引:0
作者
Ma, Wentao [1 ]
Qu, Hua [1 ]
Zhao, Jihong [1 ]
Chen, Badong [1 ]
Principe, Jose C. [1 ,2 ]
机构
[1] Xi An Jiao Tong Univ, Sch EIE, Xian 710049, Shaanxi, Peoples R China
[2] Univ Florida, Dept ECE, Gainesville, FL 32611 USA
来源
2015 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING (ICASSP) | 2015年
关键词
Sparse estimation; minimum error entropy; correntropy induced metric; impulsive noise; CONSTRAINT LMS ALGORITHM; SYSTEM; CORRENTROPY;
D O I
暂无
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
Sparse estimation has received a lot of attention due to its broad applicability. In sparse channel estimation, the parameter vector with sparsity characteristic can be well estimated from noisy measurements through sparse adaptive filters. In previous studies, most works use the mean square error (MSE) based cost to develop sparse filters, which is rational under the assumption of Gaussian distributions. However, Gaussian assumption does not always hold in real-world environments. To address this issue, we incorporate in this work l(1)-norm and reweighted l(1)-norm into the minimum error entropy (MEE) criterion to develop new sparse adaptive filters, which may perform much better than the MSE based methods especially in non-Gaussian situations, since the error entropy can capture higher-order statistics of the errors. Furthermore, a new appro ximator of l(0)-norm based on the Correntropy Induced Metric (CIM) is also used as a sparsity penalty term (SPT). Simulation results show the excellent performance of the proposed algorithms.
引用
收藏
页码:2179 / 2183
页数:5
相关论文
共 32 条
[1]  
Aliyu M L, 2014, SIGNAL IMAGE VIDEO P, P1
[2]  
[Anonymous], 1983, MATRIX COMPUTATION
[3]   SPARLS: The Sparse RLS Algorithm [J].
Babadi, Behtash ;
Kalouptsidis, Nicholas ;
Tarokh, Vahid .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2010, 58 (08) :4013-4025
[4]   Stochastic gradient algorithm under (h,φ)-entropy criterion [J].
Chen, B. ;
Hu, J. ;
Pu, L. ;
Sun, Z. .
CIRCUITS SYSTEMS AND SIGNAL PROCESSING, 2007, 26 (06) :941-960
[5]  
Chen B, 2013, ELSEV INSIGHT, P1
[6]   Kernel minimum error entropy algorithm [J].
Chen, Badong ;
Yuan, Zejian ;
Zheng, Nanning ;
Principe, Jose C. .
NEUROCOMPUTING, 2013, 121 :160-169
[7]   Some Further Results on the Minimum Error Entropy Estimation [J].
Chen, Badong ;
Principe, Jose C. .
ENTROPY, 2012, 14 (05) :966-977
[8]   Mean-Square Convergence Analysis of ADALINE Training With Minimum Error Entropy Criterion [J].
Chen, Badong ;
Zhu, Yu ;
Hu, Jinchun .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2010, 21 (07) :1168-1179
[9]  
Chen YL, 2009, INT CONF ACOUST SPEE, P3125, DOI 10.1109/ICASSP.2009.4960286
[10]   Generalized information potential criterion for adaptive system training [J].
Erdogmus, D ;
Principe, JC .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2002, 13 (05) :1035-1044