Learning by Autonomous Manifold Deformation with an Intrinsic Deforming Field

被引:1
作者
Zhuang, Xiaodong [1 ]
Mastorakis, Nikos [2 ]
机构
[1] Qingdao Univ, Elect Informat Coll, Qingdao 266071, Peoples R China
[2] Tech Univ Sofia, Dept Ind Engn, Blvd Sveti Kliment Ohridski 8, Sofia 1000, Bulgaria
来源
SYMMETRY-BASEL | 2023年 / 15卷 / 11期
关键词
dimension reduction; manifold learning; manifold deformation; emergent behavior; feature extraction; NONLINEAR DIMENSIONALITY REDUCTION;
D O I
10.3390/sym15111995
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
A self-organized geometric model is proposed for data dimension reduction to improve the robustness of manifold learning. In the model, a novel mechanism for dimension reduction is presented by the autonomous deforming of data manifolds. The autonomous deforming vector field is proposed to guide the deformation of the data manifold. The flattening of the data manifold is achieved as an emergent behavior under the virtual elastic and repulsive interaction between the data points. The manifold's topological structure is preserved when it evolves to the shape of lower dimension. The soft neighborhood is proposed to overcome the uneven sampling and neighbor point misjudging problems. The simulation experiment results of data sets prove its effectiveness and also indicate that implicit features of data sets can be revealed. In the comparison experiments, the proposed method shows its advantage in robustness.
引用
收藏
页数:21
相关论文
共 37 条
[1]   Overview and comparative study of dimensionality reduction techniques for high dimensional data [J].
Ayesha, Shaeela ;
Hanif, Muhammad Kashif ;
Talib, Ramzan .
INFORMATION FUSION, 2020, 59 :44-58
[2]   Laplacian eigenmaps for dimensionality reduction and data representation [J].
Belkin, M ;
Niyogi, P .
NEURAL COMPUTATION, 2003, 15 (06) :1373-1396
[3]  
Bengio Y., 2005, P ADV NEURAL INFORM, V18, P115
[4]  
Bengio Y.., 2004, P ADV NEUR INF PROC, P129
[5]   Nonlocal estimation of manifold structure [J].
Bengio, Yoshua ;
Monperrus, Martin ;
Larochelle, Hugo .
NEURAL COMPUTATION, 2006, 18 (10) :2509-2528
[6]   Separability and geometry of object manifolds in deep neural networks [J].
Cohen, Uri ;
Chung, SueYeon ;
Lee, Daniel D. ;
Sompolinsky, Haim .
NATURE COMMUNICATIONS, 2020, 11 (01)
[7]  
Columbia University Image Library, About us
[8]  
cvl, Object Pose Estimation Database
[9]  
Donoho D.L., 2000, P AMS MATH CHALL 21, P1
[10]   From few to many: Illumination cone models for face recognition under variable lighting and pose [J].
Georghiades, AS ;
Belhumeur, PN ;
Kriegman, DJ .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2001, 23 (06) :643-660