An alternative approach to infomax and independent component analysis

被引:4
|
作者
Hyvärinen, A [1 ]
机构
[1] Helsinki Univ Technol, Neural Networks Res Ctr, FIN-02015 Helsinki, Finland
关键词
independent component analysis; sparse coding; infomax; noise model;
D O I
10.1016/S0925-2312(02)00424-1
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Infomax means maximization of information flow in a neural system. A nonlinear version of infomax has been shown to be connected to independent component analysis and the receptive fields of neurons in the visual cortex. Here we show a problem of nonrobustness of nonlinear infomax: it is very sensitive to the choice the nonlinear neuronal transfer function. We consider an alternative approach in which the system is linear. but the noise level depends on the mean of the signal, as in a Poisson neuron model. This gives similar predictions as the nonlinear infomax, but seems to be more robust. (C) 2002 Published by Elsevier Science B.V.
引用
收藏
页码:1089 / 1097
页数:9
相关论文
共 50 条
  • [1] An Introduction to Independent Component Analysis: InfoMax and FastICA algorithms
    Langlois, Dominic
    Chartier, Sylvain
    Gosselin, Dominique
    TUTORIALS IN QUANTITATIVE METHODS FOR PSYCHOLOGY, 2010, 6 (01) : 31 - 38
  • [2] An improved Infomax algorithm of independent component analysis applied to fMRI data
    Wu, X
    Yao, L
    Long, ZY
    Wu, H
    MEDICAL IMAGING 2004: IMAGE PROCESSING, PTS 1-3, 2004, 5370 : 1880 - 1889
  • [3] Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources
    Lee, TW
    Girolami, M
    Sejnowski, TJ
    NEURAL COMPUTATION, 1999, 11 (02) : 417 - 441
  • [4] A simplified approach to independent component analysis
    Singh, Y
    Rai, CS
    NEURAL COMPUTING & APPLICATIONS, 2003, 12 (3-4): : 173 - 177
  • [5] A simplified approach to independent component analysis
    Yogesh Singh
    C. S. Rai
    Neural Computing & Applications, 2003, 12 : 173 - 177
  • [6] A variant of logistic transfer function in Infomax and a postprocessing procedure for independent component analysis applied to fMRI data
    Wu, Xia
    Yao, Li
    Long, Zhi-ying
    Chen, Kewei
    MAGNETIC RESONANCE IMAGING, 2007, 25 (05) : 703 - 711
  • [7] An alternative perspective on adaptive independent component analysis algorithms
    Girolami, M
    NEURAL COMPUTATION, 1998, 10 (08) : 2103 - 2114
  • [8] An alternative switching criterion for independent component analysis (ICA)
    Gao, DP
    Ma, JW
    Cheng, QS
    NEUROCOMPUTING, 2005, 68 : 267 - 272
  • [9] Auxiliary function approach to independent component analysis and independent vector analysis
    Ono, N.
    INDEPENDENT COMPONENT ANALYSES, COMPRESSIVE SAMPLING, LARGE DATA ANALYSES (LDA), NEURAL NETWORKS, BIOSYSTEMS, AND NANOENGINEERING XIII, 2015, 9496
  • [10] An ensemble learning approach to independent component analysis
    Choudrey, R
    Penny, WD
    Roberts, SJ
    NEURAL NETWORKS FOR SIGNAL PROCESSING X, VOLS 1 AND 2, PROCEEDINGS, 2000, : 435 - 444