Stability analysis of dynamical systems for minor and principal component analysis

被引:0
|
作者
Hasan, Mohammed A. [1 ]
机构
[1] Univ Minnesota, Dept Elect & Comp Engn, Duluth, MN 55812 USA
来源
2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12 | 2006年 / 1-12卷
关键词
dynamical flow; gradient flow; asymptotic stability; global stability; optimization over Stiefel manifold; PCA; MCA; PSA; MSA; Oja's Rule; analytic solutions; exact solutions;
D O I
10.1109/ACC.2006.1657277
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Algorithms that extract the principal or minor components of a signal are widely used in signal processing and control applications. This paper explores new frameworks for generating learning rules for iteratively computing the principal and minor components (or subspaces) of a given matrix. Stability analysis using Liapunov theory and La Salle invariance principle is provided to determine regions of attraction of these learning rules. Among many derivations, it is specifically shown that Oja's rule and many variations of it are asymptotically globally stable. Liapunov stability theory is also applied to weighted learning rules. Some of the essential features for the proposed MCA/PCA learning rules are that they are self normalized and can be applied to non-symmetric matrices. Exact solutions for some nonlinear dynamical systems are also provided.
引用
收藏
页码:3600 / 3605
页数:6
相关论文
共 50 条
  • [1] Dynamical systems for principal and minor component analysis
    Manton, JH
    Helmke, U
    Mareels, IMY
    42ND IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-6, PROCEEDINGS, 2003, : 1863 - 1868
  • [2] Dynamical systems for principal and minor component analysis
    Manton, Jonathan H.
    Helmke, Uwe
    Mareels, Iven M.Y.
    Proceedings of the IEEE Conference on Decision and Control, 2003, 2 : 1863 - 1868
  • [3] Dynamical systems for joint principal and minor component analysis
    Hasan, Mohammed A.
    2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 2274 - 2279
  • [4] Dynamical systems for joint principal and minor component analysis
    Hasan, Mohammed A.
    2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12, 2006, 1-12 : 4591 - 4596
  • [5] Analysis of dynamical systems for generalized principal and minor component extraction
    Hasan, Mohammed A.
    2006 IEEE SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP PROCEEDINGS, VOLS 1 AND 2, 2006, : 531 - 535
  • [6] New dynamical systems for principal and minor subspace analysis
    Hasan, Mohammed A.
    PROCEEDINGS OF THE 45TH IEEE CONFERENCE ON DECISION AND CONTROL, VOLS 1-14, 2006, : 5180 - 5185
  • [7] A class of learning algorithms for principal component analysis and minor component analysis
    Zhang, QF
    Leung, YW
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (01): : 200 - 204
  • [8] A class of learning algorithms for principal component analysis and minor component analysis
    Zhang, QF
    Leung, YW
    IEEE TRANSACTIONS ON NEURAL NETWORKS, 2000, 11 (02): : 529 - 533
  • [9] Sanger's like systems for generalized principal and minor component analysis
    Hasan, Mohammed A.
    2006 IEEE SENSOR ARRAY AND MULTICHANNEL SIGNAL PROCESSING WORKSHOP PROCEEDINGS, VOLS 1 AND 2, 2006, : 425 - 429
  • [10] Principal and minor component analysis for web link structures
    Matsukubo, J
    Hayashi, Y
    KNOWLEDGE-BASED INTELLIGENT INFORMATION ENGINEERING SYSTEMS & ALLIED TECHNOLOGIES, PTS 1 AND 2, 2001, 69 : 1560 - 1564