t-SNE for Complex Multi-Manifold High-Dimensional Data

被引:0
作者
Bian R. [1 ]
Zhang J. [2 ]
Zhou L. [3 ]
Jiang P. [4 ]
Chen B. [1 ]
Wang Y. [1 ]
机构
[1] School of Computer Science and Technology, Shandong University, Qingdao
[2] Computer Network Information Center, Chinese Academy of Sciences, Beijing
[3] Scientific Computing and Imaging Institute, University of Utah, Salt Lake City
[4] School of Qilu Transportation, Shandong University, Jinan
来源
Jisuanji Fuzhu Sheji Yu Tuxingxue Xuebao/Journal of Computer-Aided Design and Computer Graphics | 2021年 / 33卷 / 11期
关键词
Dimensionality reduction; Local principal component analysis; Multi-manifold; Visualization;
D O I
10.3724/SP.J.1089.2021.18806
中图分类号
学科分类号
摘要
To solve the problem that the t-SNE method cannot distinguish multiple manifolds that intersect each other well, a visual dimensionality reduction method is proposed. Based on the t-SNE method, Euclidean metric and local PCA are considered when calculating high-dimensional probability to distinguish different manifolds. Then the t-SNE gradient solution method can be directly used to get the dimensionality reduction result. Finally, three generated data and two real data are used to test proposed method, and quantitatively evaluate the discrimination of different manifolds and the degree of neighborhood preservation within the manifold in the dimensionality reduction results. These results show that proposed method is more useful when processing multi-manifold data, and can keep the neighborhood structure of each manifold well. © 2021, Beijing China Science Journal Publishing Co. Ltd. All right reserved.
引用
收藏
页码:1746 / 1754
页数:8
相关论文
共 21 条
  • [1] Zhou Zhihua, Machine learning, pp. 225-246, (2016)
  • [2] Hotelling H., Analysis of a complex of statistical variables into principal components, Journal of Educational Psychology, 24, 6, pp. 417-441, (1933)
  • [3] Torgerson W S., Multidimensional scaling of similarity, Psychometrika, 30, 4, pp. 379-393, (1965)
  • [4] Tenenbaum J B, de Silva V, Langford J C., A global geometric framework for nonlinear dimensionality reduction, Science, 29, 5500, pp. 2319-2323, (2000)
  • [5] Saul L K, Roweis S T., Think globally, fit locally: unsupervised learning of low dimensional manifolds, Journal of Machine Learning Research, 4, pp. 119-155, (2003)
  • [6] van der Maaten L, Hinton G., Visualizing data using t-SNE, Journal of Machine Learning Research, 9, 86, pp. 2579-2605, (2008)
  • [7] Yang B, Xiang M, Zhang Y P., Multi-manifold discriminant Isomap for visualization and classification, Pattern Recognition, 55, pp. 215-230, (2016)
  • [8] Hettiarachchi R, Peters J F., Multi-manifold LLE learning in pattern recognition, Pattern Recognition, 48, 9, pp. 2947-2960, (2015)
  • [9] Bishop C M., Pattern recognition and machine learning, pp. 559-603, (2006)
  • [10] Arias-Castro E, Lerman G, Zhang T., Spectral clustering based on local PCA, Journal of Machine Learning Research, 18, 9, pp. 1-57, (2017)