Complex-Valued Filtering Based on the Minimization of Complex-Error Entropy

被引:29
作者
Huang, Songyan [1 ]
Li, Chunguang [1 ]
Liu, Yiguang [2 ]
机构
[1] Zhejiang Univ, Dept Informat Sci & Elect Engn, Hangzhou 310027, Peoples R China
[2] Sichuan Univ, Sch Comp Sci & Engn, Chengdu 610064, Peoples R China
基金
中国国家自然科学基金;
关键词
Complex-valued filtering; entropy bound minimization; minimization of complex-error entropy; neural network; BASIS FUNCTION NETWORK; INDEPENDENT COMPONENT ANALYSIS; RENYIS ENTROPY; EQUALIZATION; GRADIENT;
D O I
10.1109/TNNLS.2013.2241788
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we consider the training of complex-valued filter based on the information theoretic method. We first generalize the error entropy criterion to complex domain to present the complex error entropy criterion (CEEC). Due to the difficulty in estimating the entropy of complex-valued error directly, the entropy bound minimization (EBM) method is used to compute the upper bounds of the entropy of the complex-valued error, and the tightest bound selected by the EBM algorithm is used as the estimator of the complex-error entropy. Then, based on the minimization of complex-error entropy (MCEE) and the complex gradient descent approach, complex-valued learning algorithms for both the (linear) transverse filter and the (nonlinear) neural network are derived. The algorithms are applied to complex-valued linear filtering and complex-valued nonlinear channel equalization to demonstrate their effectiveness and advantages.
引用
收藏
页码:695 / 708
页数:14
相关论文
共 45 条
[1]   Complex ICA using nonlinear functions [J].
Adali, Tuelay ;
Li, Hualiang ;
Novey, Mike ;
Cardoso, Jean-Francois .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (09) :4536-4544
[2]   Complex-Valued Signal Processing: The Proper Way to Deal With Impropriety [J].
Adali, Tulay ;
Schreier, Peter J. ;
Scharf, Louis L. .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2011, 59 (11) :5101-5125
[3]  
[Anonymous], 2010, Adaptive Signal Processing: Next Generation Solutions
[4]  
[Anonymous], 1968, INFORM THEORY STAT
[5]   ON THE COMPLEX BACKPROPAGATION ALGORITHM [J].
BENVENUTO, N ;
PIAZZA, F .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1992, 40 (04) :967-968
[6]   Adaptive Learning in Complex Reproducing Kernel Hilbert Spaces Employing Wirtinger's Subgradients [J].
Bouboulis, Pantelis ;
Slavakis, Konstantinos ;
Theodoridis, Sergios .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2012, 23 (03) :425-438
[7]  
BRANDWOOD DH, 1983, IEE PROC-F, V130, P11
[8]   CHANNEL EQUALIZATION USING ADAPTIVE COMPLEX RADIAL BASIS FUNCTION NETWORKS [J].
CHA, I ;
KASSAM, SA .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 1995, 13 (01) :122-131
[9]   COMPLEX-VALUED RADIAL BASIS FUNCTION NETWORK .2. APPLICATION TO DIGITAL-COMMUNICATIONS CHANNEL EQUALIZATION [J].
CHEN, S ;
MCLAUGHLIN, S ;
MULGREW, B .
SIGNAL PROCESSING, 1994, 36 (02) :175-188
[10]   COMPLEX-VALUED RADIAL BASIS FUNCTION NETWORK .1. NETWORK ARCHITECTURE AND LEARNING ALGORITHMS [J].
CHEN, S ;
MCLAUGHLIN, S ;
MULGREW, B .
SIGNAL PROCESSING, 1994, 35 (01) :19-31