Efficient variant of algorithm FastICA for independent component analysis attaining the Cramer-Rao lower bound

被引:217
作者
Koldovsky, Zbynek [1 ]
Tichavsky, Petr
Oja, Erkki
机构
[1] Czech Tech Univ, Fac Nucl Sci & Phys Engn, Prague 12000 2, Czech Republic
[2] Inst Informat Theory & Automat, Prague 18208 8, Czech Republic
[3] Aalto Univ, Neural Networks Res Ctr, Helsinki 02015, Finland
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2006年 / 17卷 / 05期
关键词
algorithm FastICA; blind deconvolution; blind source separation; Cramer-Rao lower bound (CRB); independent component analysis (ICA);
D O I
10.1109/TNN.2006.875991
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
FastICA is one of the most popular algorithms for independent component analysis (ICA), demixing a set of statistically independent sources that have been mixed linearly. A key question is how accurate the method is for finite data samples. We propose an improved version of the FastICA algorithm which is asymptotically efficient, i.e., its accuracy given by the residual error variance attains the Cramer-Rao lower bound (CRB). The error is thus as small as possible. This result is rigorously proven under the assumption that the probability distribution of the independent signal components belongs to the class of generalized Gaussian (GG) distributions with parameter alpha, denoted GG(alpha) for alpha > 2. We name the algorithm efficient FastICA (EFICA). Computational complexity of a Matlab implementation of the algorithm is shown to be only slightly (about three times) higher than that of the standard symmetric FastICA. Simulations corroborate these claims and show superior performance of the algorithm compared with algorithm JADE of Cardoso and Souloumiac and non-parametric ICA of Boscolo et al on separating sources with distribution G G (alpha) with arbitrary alpha, as well as on sources with bimodal distribution, and a good performance in separating linearly mixed speech signals.
引用
收藏
页码:1265 / 1277
页数:13
相关论文
共 26 条
[1]   Blind source separation - Semiparametric statistical approach [J].
Amari, S ;
Cardoso, JF .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1997, 45 (11) :2692-2700
[2]   Superefficiency in blind source separation [J].
Amari, S .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1999, 47 (04) :936-944
[3]  
[Anonymous], PROC EUSIPCO
[4]   Independent component analysis based on nonparametric density estimation [J].
Boscolo, R ;
Pan, H ;
Roychowdhury, VP .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 2004, 15 (01) :55-65
[5]   BLIND BEAMFORMING FOR NON-GAUSSIAN SIGNALS [J].
CARDOSO, JF ;
SOULOUMIAC, A .
IEE PROCEEDINGS-F RADAR AND SIGNAL PROCESSING, 1993, 140 (06) :362-370
[6]   Blind signal separation: Statistical principles [J].
Cardoso, JF .
PROCEEDINGS OF THE IEEE, 1998, 86 (10) :2009-2025
[7]  
CICHOCKI A, 2002, ADAPTIVE SIGNAL IMAG
[8]   INDEPENDENT COMPONENT ANALYSIS, A NEW CONCEPT [J].
COMON, P .
SIGNAL PROCESSING, 1994, 36 (03) :287-314
[9]   A fast fixed-point algorithm for independent component analysis [J].
Hyvarinen, A ;
Oja, E .
NEURAL COMPUTATION, 1997, 9 (07) :1483-1492
[10]   Fast and robust fixed-point algorithms for independent component analysis [J].
Hyvärinen, A .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (03) :626-634