A "nonnegative PCA" algorithm for independent component analysis

被引:75
作者
Plumbley, MD
Oja, E
机构
[1] Queen Mary Univ London, Dept Elect Engn, London E1 4NS, England
[2] Aalto Univ, Lab Comp & Informat Sci, Helsinki 02015, Finland
来源
IEEE TRANSACTIONS ON NEURAL NETWORKS | 2004年 / 15卷 / 01期
基金
芬兰科学院; 英国工程与自然科学研究理事会;
关键词
independent component analysis (ICA); nonlinear principal component analysis (nonlinear PCA); nonnegative matrix factorization; subspace learning rule;
D O I
10.1109/TNN.2003.820672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We consider the task of independent component analysis when the independent sources are known to be nonnegative and well-grounded, so that they have a nonzero probability density function (pdf) in the region of zero. We propose the use of a "nonnegative principal component analysis (nonnegative PCA)" algorithm, which is a special case of the nonlinear PCA algorithm, but with a rectification nonlinearity, and we conjecture that this algorithm will find such nonnegative well-grounded independent sources, under reasonable initial conditions. While the algorithm has proved difficult to analyze in the general case, we give some analytical results that are consistent with this conjecture and some numerical simulations that illustrate its operation.
引用
收藏
页码:66 / 76
页数:11
相关论文
共 29 条
[1]  
[Anonymous], P INT C ART NEUR NET
[2]   Equivariant adaptive source separation [J].
Cardoso, JF ;
Laheld, BH .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1996, 44 (12) :3017-3030
[3]   Modelling multiple-cause structure using rectification constraints [J].
Charles, D ;
Fyfe, C .
NETWORK-COMPUTATION IN NEURAL SYSTEMS, 1998, 9 (02) :167-182
[4]  
Cichocki A, 2003, IEICE T FUND ELECTR, VE86A, P522
[5]  
Diamantaras KI, 1996, Principal Component Neural Networks: Theory and Applications
[6]  
FYFE C, 1993, NERUAL COMPUTING RES, V2, P47
[7]  
HARPUR GF, 1997, THESIS U CAMBRIDGE C
[8]   Multivariate receptor models - current practice and future trends [J].
Henry, RC .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2002, 60 (1-2) :43-48
[9]   CONVERGENCE ANALYSIS OF LOCAL FEATURE-EXTRACTION ALGORITHMS [J].
HORNIK, K ;
KUAN, CM .
NEURAL NETWORKS, 1992, 5 (02) :229-240
[10]   Emergence of phase- and shift-invariant features by decomposition of natural images into independent feature subspaces [J].
Hyvärinen, A ;
Hoyer, P .
NEURAL COMPUTATION, 2000, 12 (07) :1705-1720