The FastICA algorithm revisited: Convergence analysis

被引:133
作者
Oja, Erkki [1 ]
Yuan, Zhijian [1 ]
机构
[1] Aalto Univ, Adapt Informat Res Ctr, Helsinki 02015, Finland
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2006年 / 17卷 / 06期
关键词
convergence analysis; cubic convergence; FastICA; independent component analysis (ICA);
D O I
10.1109/TNN.2006.880980
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The fast independent component analysis (FastICA) algorithm is one of the most popular methods to solve problems in ICA and blind source separation. It has been shown experimentally that it outperforms most of the commonly used ICA algorithms in convergence speed. A rigorous local convergence analysis has been presented only for the so-called one-unit case, in which just one of the rows of the separating matrix,is considered. However, in the FastICA algorithm, there is also an explicit normalization step, and it may be questioned whether the extra rotation caused by the normalization will affect the convergence speed. The purpose of this paper is to show that this is not the case and the good convergence properties of the one-unit case are also shared by the full algorithm with symmetrical normalization. A local convergence analysis is given for the general case, and the global behavior is illustrated numerically for two sources and two mixtures in several typical cases.
引用
收藏
页码:1370 / 1381
页数:12
相关论文
共 25 条
  • [1] Stability analysis of learning algorithms for blind source separation
    Amari, S
    Chen, TP
    Cichocki, A
    [J]. NEURAL NETWORKS, 1997, 10 (08) : 1345 - 1351
  • [2] [Anonymous], 2002, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications
  • [3] CARDOSO JF, 1990, INT CONF ACOUST SPEE, P2655, DOI 10.1109/ICASSP.1990.116165
  • [4] INDEPENDENT COMPONENT ANALYSIS, A NEW CONCEPT
    COMON, P
    [J]. SIGNAL PROCESSING, 1994, 36 (03) : 287 - 314
  • [5] ADAPTIVE BLIND SEPARATION OF INDEPENDENT SOURCES - A DEFLATION APPROACH
    DELFOSSE, N
    LOUBATON, P
    [J]. SIGNAL PROCESSING, 1995, 45 (01) : 59 - 83
  • [6] Donoho D., 1981, Applied Time Series Analysis, VII, P565
  • [7] DOUGLAS S, 2003, P 4 S IND COMP AN BL, P409
  • [8] Giannakopoulos X., 1999, INT J NEURAL SYST, V9, P651
  • [9] GIROLAMI M, 2000, ADV INDEPENDENT COMP
  • [10] A fast fixed-point algorithm for independent component analysis
    Hyvarinen, A
    Oja, E
    [J]. NEURAL COMPUTATION, 1997, 9 (07) : 1483 - 1492