A class of neural networks for independent component analysis

被引:239
作者
Karhunen, J
Oja, E
Wang, LY
Vigario, R
Joutsensalo, J
机构
[1] Helsinki University of Technology, Laboratory of Computer and Information Science
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 1997年 / 8卷 / 03期
关键词
blind source separation; independent component analysis; neural networks; principal component analysis; signal processing; unsupervised learning;
D O I
10.1109/72.572090
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Independent component analysis (ICA) is a recently developed, useful extension of standard principal component analysis (PCA). The ICA model is utilized mainly in blind separation of unknown source signals from their linear mixtures, In this application only the source signals which correspond to the coefficients of the ICA expansion are of interest. In this paper, we propose neural structures related to multilayer feedforward networks for performing complete ICA, The basic ICA network consists of whitening, separation, and basis vector estimation layers, It can be used for both blind source separation and estimation of the basis vectors of ICA, We consider learning algorithms for each layer, and modify our previous nonlinear PCA type algorithms so that their separation capabilities are greatly improved, The proposed class of networks yields good results in test examples with both artificial and real-world data.
引用
收藏
页码:486 / 504
页数:19
相关论文
共 52 条
[1]  
Amari S, 1996, ADV NEUR IN, V8, P757
[2]  
[Anonymous], MATH PROPERTIES NEUR
[3]  
[Anonymous], P ART NEUR NETW
[4]   NEURAL NETWORKS AND PRINCIPAL COMPONENT ANALYSIS - LEARNING FROM EXAMPLES WITHOUT LOCAL MINIMA [J].
BALDI, P ;
HORNIK, K .
NEURAL NETWORKS, 1989, 2 (01) :53-58
[5]   LEARNING IN LINEAR NEURAL NETWORKS - A SURVEY [J].
BALDI, PF ;
HORNIK, K .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (04) :837-858
[6]   AN INFORMATION MAXIMIZATION APPROACH TO BLIND SEPARATION AND BLIND DECONVOLUTION [J].
BELL, AJ ;
SEJNOWSKI, TJ .
NEURAL COMPUTATION, 1995, 7 (06) :1129-1159
[7]   Learning the higher-order structure of a natural sound [J].
Bell, AJ ;
Sejnowski, TJ .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1996, 7 (02) :261-267
[8]  
BELL AJ, 1997, ADV NEURAL INFORMATI, V9
[9]   BLIND SEPARATION OF SOURCES - A NONLINEAR NEURAL ALGORITHM [J].
BUREL, G .
NEURAL NETWORKS, 1992, 5 (06) :937-947
[10]  
BUREL G, 1993, P 1993 IEEE INT C SY, P601