Blind source separation using Renyi's mutual information

被引:96
|
作者
Hild, KE [1 ]
Erdogmus, D [1 ]
Príncipe, J [1 ]
机构
[1] Univ Florida, Computat NeuroEngn Lab, Dept Elect & Comp Engn, Gainesville, FL 32611 USA
基金
美国国家科学基金会;
关键词
blind source separation; component analysis; Givens rotations; mutual information; Renyi's entropy; Renyi's information;
D O I
10.1109/97.923043
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
A blind source separation algorithm is proposed that is based on minimizing Renyi's mutual information by means of nonparametric probability density function (PDF) estimation. The two-stage process consists of spatial whitening and a series of Givens rotations and produces a cost function consisting only of marginal entropies, This formulation avoids the problems of PDF inaccuracy due to truncation of series expansion and the estimation of joint PDFs in high-dimensional spaces given the typical paucity of data, Simulations illustrate the superior efficiency, in terms of data length, of the proposed method compared to fast independent component analysis (FastICA), Comon's minimum mutual information, and Bell and Sejnowski's Infomax.
引用
收藏
页码:174 / 176
页数:3
相关论文
共 50 条
  • [1] On blind source separation using mutual information criterion
    Zhi-Quan Luo
    Jun Lu
    Mathematical Programming, 2003, 97 : 587 - 603
  • [2] Blind source separation using Renyi's α-marginal entropies
    Erdogmus, D
    Hild, KE
    Principe, JC
    NEUROCOMPUTING, 2002, 49 : 25 - 38
  • [3] On the risk of using Renyi's entropy for blind source separation
    Pham, Dinh-Tuan
    Vrins, Frederic
    Verleysen, Michel
    IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2008, 56 (10) : 4611 - 4620
  • [4] Correlated Postfiltering and Mutual Information in Pseudoanechoic Model Based Blind Source Separation
    Leandro Ezequiel Di Persia
    Diego Humberto Milone
    Masuzo Yanagida
    Journal of Signal Processing Systems, 2011, 63 : 333 - 344
  • [5] Correlated Postfiltering and Mutual Information in Pseudoanechoic Model Based Blind Source Separation
    Ezequiel Di Persia, Leandro
    Humberto Milone, Diego
    Yanagida, Masuzo
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2011, 63 (03): : 333 - 344
  • [6] Criteria based on mutual information minimization for blind source separation in post nonlinear mixtures
    Achard, S
    Pham, DT
    Jutten, C
    SIGNAL PROCESSING, 2005, 85 (05) : 965 - 974
  • [7] A general approach for mutual information minimization and its application to blind source separation
    Babaie-Zadeh, M
    Jutten, C
    SIGNAL PROCESSING, 2005, 85 (05) : 975 - 995
  • [8] Convolutive blind source separation by minimizing mutual information between segments of signals
    Hild, KE
    Pinto, D
    Erdogmus, D
    Principe, JC
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS I-REGULAR PAPERS, 2005, 52 (10) : 2188 - 2196
  • [9] Blind source separation based on constant modulus criterion and signal mutual information
    Xiang, Yong
    COMPUTERS & ELECTRICAL ENGINEERING, 2008, 34 (05) : 416 - 422
  • [10] Blind source separation using algorithmic information theory
    Pajunen, P
    NEUROCOMPUTING, 1998, 22 (1-3) : 35 - 48