Unsupervised Adaptive Embedding for Dimensionality Reduction

被引:15
作者
Wang, Jingyu [1 ,2 ]
Xie, Fangyuan [1 ]
Nie, Feiping [2 ]
Li, Xuelong [2 ,3 ]
机构
[1] Northwestern Polytech Univ, Sch Astronaut, Xian 710072, Peoples R China
[2] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect iOPEN, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Minist Ind & Informat Technol, Key Lab Intelligent Interact & Applicat, Xian 710072, Peoples R China
基金
中国国家自然科学基金;
关键词
Kernel; Clustering algorithms; Manifolds; Learning systems; Principal component analysis; Dimensionality reduction; Optimization; Adaptive neighbors; graph embedding; linear dimensionality reduction (DR); unsupervised; FRAMEWORK; FACE;
D O I
10.1109/TNNLS.2021.3083695
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
High-dimensional data are highly correlative and redundant, making it difficult to explore and analyze. Amount of unsupervised dimensionality reduction (DR) methods has been proposed, in which constructing a neighborhood graph is the primary step of DR methods. However, there exist two problems: 1) the construction of graph is usually separate from the selection of projection direction and 2) the original data are inevitably noisy. In this article, we propose an unsupervised adaptive embedding (UAE) method for DR to solve these challenges, which is a linear graph-embedding method. First, an adaptive allocation method of neighbors is proposed to construct the affinity graph. Second, the construction of affinity graph and calculation of projection matrix are integrated together. It considers the local relationship between samples and global characteristic of high-dimensional data, in which the cleaned data matrix is originally proposed to remove noise in subspace. The relationship between our method and local preserving projections (LPPs) is also explored. Finally, an alternative iteration optimization algorithm is derived to solve our model, the convergence and computational complexity of which are also analyzed. Comprehensive experiments on synthetic and benchmark datasets illustrate the superiority of our method.
引用
收藏
页码:6844 / 6855
页数:12
相关论文
共 57 条
  • [1] Generalized discriminant analysis using a kernel approach
    Baudat, G
    Anouar, FE
    [J]. NEURAL COMPUTATION, 2000, 12 (10) : 2385 - 2404
  • [2] Belkin M, 2002, ADV NEUR IN, V14, P585
  • [3] Bezdek J.C., 1981, PATTERN RECOGN, P43, DOI 10.1007/978-1-4757-0450-1
  • [4] Boyd S., 2004, CONVEX OPTIMIZATION
  • [5] Cai D., 2007, Proceedings of the 15th international conference on Multimedia, P403, DOI DOI 10.1145/1291233.1291329
  • [6] Duplex Metric Learning for Image Set Classification
    Cheng, Gong
    Zhou, Peicheng
    Han, Junwei
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) : 281 - 292
  • [7] Faaeq A, 2018, SIG PROCESS COMMUN
  • [8] Locality Sensitive Discriminative Unsupervised Dimensionality Reduction
    Gao, Yun-Long
    Luo, Si-Zhe
    Wang, Zhi-Hao
    Chen, Chih-Cheng
    Pan, Jin-Yan
    [J]. SYMMETRY-BASEL, 2019, 11 (08):
  • [9] He X., 2020, PROC 28 ACM INT C MU, P3541
  • [10] He XF, 2005, IEEE I CONF COMP VIS, P1208