Stability analysis of dynamical systems for minor and principal component analysis

被引:0
作者
Hasan, Mohammed A. [1 ]
机构
[1] Univ Minnesota, Dept Elect & Comp Engn, Duluth, MN 55812 USA
来源
2006 AMERICAN CONTROL CONFERENCE, VOLS 1-12 | 2006年 / 1-12卷
关键词
dynamical flow; gradient flow; asymptotic stability; global stability; optimization over Stiefel manifold; PCA; MCA; PSA; MSA; Oja's Rule; analytic solutions; exact solutions;
D O I
10.1109/ACC.2006.1657277
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Algorithms that extract the principal or minor components of a signal are widely used in signal processing and control applications. This paper explores new frameworks for generating learning rules for iteratively computing the principal and minor components (or subspaces) of a given matrix. Stability analysis using Liapunov theory and La Salle invariance principle is provided to determine regions of attraction of these learning rules. Among many derivations, it is specifically shown that Oja's rule and many variations of it are asymptotically globally stable. Liapunov stability theory is also applied to weighted learning rules. Some of the essential features for the proposed MCA/PCA learning rules are that they are self normalized and can be applied to non-symmetric matrices. Exact solutions for some nonlinear dynamical systems are also provided.
引用
收藏
页码:3600 / 3605
页数:6
相关论文
共 50 条
[21]   Schrodinger principal-component analysis: On the duality between principal-component analysis and the Schrodinger equation [J].
Liu, Ziming ;
Qian, Sitian ;
Wang, Yixuan ;
Yan, Yuxuan ;
Yang, Tianyi .
PHYSICAL REVIEW E, 2021, 104 (02)
[22]   Sea surface temperature patterns in the Tropical Atlantic: Principal component analysis and nonlinear principal component analysis [J].
Kenfack, Christian Sadem ;
Mkankam, Francois Kamga ;
Alory, Gael ;
du Penhoat, Yves ;
Hounkonnou, Mahouton Norbert ;
Vondou, Derbetini Appolinaire ;
Nfor, Bawe Gerard, Jr. .
TERRESTRIAL ATMOSPHERIC AND OCEANIC SCIENCES, 2017, 28 (03) :395-410
[23]   Backwards Principal Component Analysis and Principal Nested Relations [J].
Damon, James ;
Marron, J. S. .
JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2014, 50 (1-2) :107-114
[24]   Double robust principal component analysis [J].
Wang, Qianqian ;
Gao, QuanXue ;
Sun, Gan ;
Ding, Chris .
NEUROCOMPUTING, 2020, 391 :119-128
[25]   Hierarchical disjoint principal component analysis [J].
Cavicchia, Carlo ;
Vichi, Maurizio ;
Zaccaria, Giorgia .
ASTA-ADVANCES IN STATISTICAL ANALYSIS, 2023, 107 (03) :537-574
[26]   Efficient fair principal component analysis [J].
Kamani, Mohammad Mahdi ;
Haddadpour, Farzin ;
Forsati, Rana ;
Mahdavi, Mehrdad .
MACHINE LEARNING, 2022, 111 (10) :3671-3702
[27]   Streaming Sparse Principal Component Analysis [J].
Yang, Wenzhuo ;
Xu, Huan .
INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 37, 2015, 37 :494-503
[28]   Principal component analysis for interval data [J].
Billard, L. ;
Le-Rademacher, J. .
WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2012, 4 (06) :535-540
[29]   Principal component analysis in the wavelet domain [J].
Lim, Yaeji ;
Kwon, Junhyeon ;
Oh, Hee-Seok .
PATTERN RECOGNITION, 2021, 119
[30]   Sparse Generalised Principal Component Analysis [J].
Smallman, Luke ;
Artemiou, Andreas ;
Morgan, Jennifer .
PATTERN RECOGNITION, 2018, 83 :443-455