Connectivity-Optimized Representation Learning via Persistent Homology

被引:0
|
作者
Hofer, Christoph D. [1 ]
Kwitt, Roland [1 ]
Dixit, Mandar [2 ]
Niethammer, Marc [3 ]
机构
[1] Salzburg Univ, Dept Comp Sci, Salzburg, Austria
[2] Microsoft, Redmond, WA USA
[3] UNC, Chapel Hill, NC USA
基金
奥地利科学基金会;
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We study the problem of learning representations with controllable connectivity properties. This is beneficial in situations when the imposed structure can be leveraged upstream. In particular, we control the connectivity of an autoencoder's latent space via a novel type of loss, operating on information from persistent homology. Under mild conditions, this loss is differentiable and we present a theoretical analysis of the properties induced by the loss. We choose one-class learning as our upstream task and demonstrate that the imposed structure enables informed parameter selection for modeling the in-class distribution via kernel density estimators. Evaluated on computer vision data, these one-class models exhibit competitive performance and, in a low sample size regime, outperform other methods by a large margin. Notably, our results indicate that a single autoencoder, trained on auxiliary (unlabeled) data, yields a mapping into latent space that can be reused across datasets for one-class learning.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Topological Regularization for Representation Learning via Persistent Homology
    Chen, Muyi
    Wang, Daling
    Feng, Shi
    Zhang, Yifei
    MATHEMATICS, 2023, 11 (04)
  • [2] Hochschild homology, and a persistent approach via connectivity digraphs
    Caputi L.
    Riihimäki H.
    Journal of Applied and Computational Topology, 2024, 8 (5) : 1121 - 1170
  • [3] Tree representations of brain structural connectivity via persistent homology
    Li, Didong
    Nguyen, Phuc
    Zhang, Zhengwu
    Dunson, David
    FRONTIERS IN NEUROSCIENCE, 2023, 17
  • [4] Representation of molecular structures with persistent homology for machine learning applications in chemistry
    Jacob Townsend
    Cassie Putman Micucci
    John H. Hymel
    Vasileios Maroulas
    Konstantinos D. Vogiatzis
    Nature Communications, 11
  • [5] A persistent homology model of street network connectivity
    Corcoran, Padraig
    Jones, Christopher B.
    TRANSACTIONS IN GIS, 2022, 26 (01) : 155 - 181
  • [6] Improving Self-supervised Molecular Representation Learning using Persistent Homology
    Luo, Yuankai
    Shi, Lei
    Thost, Veronika
    ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 36 (NEURIPS 2023), 2023,
  • [7] Persistent Homology and Machine Learning
    Skraba, Primoz
    INFORMATICA-JOURNAL OF COMPUTING AND INFORMATICS, 2018, 42 (02): : 253 - 258
  • [8] Intrinsic Persistent Homology via Density-based Metric Learning
    Fernandez, Ximena
    Borghini, Eugenio
    Mindlin, Gabriel
    Groisman, Pablo
    JOURNAL OF MACHINE LEARNING RESEARCH, 2023, 24
  • [9] Learning discriminative topological structure information representation for 2D shape and social network classification via persistent homology
    Wang, Changshuo
    Cao, Rongsheng
    Wang, Ruiping
    KNOWLEDGE-BASED SYSTEMS, 2025, 311