An Evolutionary Orthogonal Component Analysis Method for Incremental Dimensionality Reduction

被引:2
作者
Zhang, Tianyue [1 ]
Shen, Furao [1 ]
Zhu, Tao [1 ]
Zhao, Jian [2 ]
机构
[1] Nanjing Univ, Natl Key Lab Novel Software Technol, Dept Comp Sci & Technol, Nanjing 210023, Peoples R China
[2] Nanjing Univ, Sch Elect Sci & Engn, Nanjing 210023, Peoples R China
基金
中国国家自然科学基金;
关键词
Dimensionality reduction; Matrix decomposition; Learning systems; Feature extraction; Principal component analysis; Data mining; Estimation; incremental learning; orthogonal component (OC); subspace learning; LINEAR DISCRIMINANT-ANALYSIS; PRINCIPAL COMPONENTS; CLASSIFICATION; REPRESENTATION; ALGORITHMS; PCA;
D O I
10.1109/TNNLS.2020.3027852
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In order to quickly discover the low-dimensional representation of high-dimensional noisy data in online environments, we transform the linear dimensionality reduction problem into the problem of learning the bases of linear feature subspaces. Based on that, we propose a fast and robust dimensionality reduction framework for incremental subspace learning named evolutionary orthogonal component analysis (EOCA). By setting adaptive thresholds to automatically determine the target dimensionality, the proposed method extracts the orthogonal subspace bases of data incrementally to realize dimensionality reduction and avoids complex computations. Besides, EOCA can merge two learned subspaces that are represented by their orthonormal bases to a new one to eliminate the outlier effects, and the new subspace is proved to be unique. Extensive experiments and analysis demonstrate that EOCA is fast and achieves competitive results, especially for noisy data.
引用
收藏
页码:392 / 405
页数:14
相关论文
共 53 条
[1]  
Artac M, 2002, INT C PATT RECOG, P781, DOI 10.1109/ICPR.2002.1048133
[2]  
Bjorck A, 1967, BIT, V7, P1, DOI [DOI 10.1007/BF01934122, 10.1007/BF01934122]
[3]  
Cai D., 2005, SIGIR 2005. Proceedings of the Twenty-Eighth Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P3, DOI 10.1145/1076034.1076039
[4]  
Cunningham JP, 2015, J MACH LEARN RES, V16, P2859
[5]   Face recognition using IPCA-ICA algorithm [J].
Dagher, I ;
Nachar, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (06) :996-1000
[6]  
Díaz-Chita K, 2010, LECT NOTES COMPUT SC, V6475, P304, DOI 10.1007/978-3-642-17691-3_28
[7]   An overview of incremental feature extraction methods based on linear subspaces [J].
Diaz-Chito, Katerine ;
Ferri, Francesc J. ;
Hernandez-Sabate, Aura .
KNOWLEDGE-BASED SYSTEMS, 2018, 145 :219-235
[8]   Vehicle classification in distributed sensor networks [J].
Duarte, MF ;
Hu, YH .
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, 2004, 64 (07) :826-838
[9]  
Elnaggar O, 2019, 2019 1ST INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE IN INFORMATION AND COMMUNICATION (ICAIIC 2019), P92, DOI [10.1109/ICAIIC.2019.8669051, 10.1109/icaiic.2019.8669051]
[10]  
Fisher R. A, 2005, ANN EUGENIC, V27, P684