Representing and Learning High Dimensional Data with the Optimal Transport Map from a Probabilistic Viewpoint

被引:9
|
作者
Park, Serim [1 ]
Thorpe, Matthew [2 ]
机构
[1] Carnegie Mellon Univ, Dept Elect & Comp Engn, Pittsburgh, PA 15213 USA
[2] Univ Cambridge, Dept Appl Math & Theoret Phys, Cambridge CB3 0WA, England
关键词
DIFFEOMORPHISM; DISTRIBUTIONS;
D O I
10.1109/CVPR.2018.00820
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In this paper, we propose a generative model in the space of diffeomorphic deformation maps. More precisely, we utilize the Kantarovich-Wasserstein metric and accompanying geometry to represent an image as a deformation from templates. Moreover, we incorporate a probabilistic viewpoint by assuming that each image is locally generated from a reference image. We capture the local structure by modelling the tangent planes at reference images. Once basis vectors for each tangent plane are learned via probabilistic PCA, we can sample a local coordinate, that can be inverted back to image space exactly. With experiments using 4 different datasets, we show that the generative tangent plane model in the optimal transport (OT) manifold can be learned with small numbers of images and can be used to create infinitely many 'unseen' images. In addition, the Bayesian classification accompanied with the probabilist modeling of the tangent planes shows improved accuracy over that done in the image space. Combining the results of our experiments supports our claim that certain datasets can be better represented with the KantarovichWasserstein metric. We envision that the proposed method could be a practical solution to learning and representing data that is generated with templates in situatons where only limited numbers of data points are available.
引用
收藏
页码:7864 / 7872
页数:9
相关论文
共 50 条
  • [21] Representing the dynamics of high-dimensional data with non-redundant wavelets
    Jia, Shanshan
    Li, Xingyi
    Huang, Tiejun
    Liu, Jian K.
    Yu, Zhaofei
    PATTERNS, 2022, 3 (03):
  • [22] From Representing the Knowledge to Offering Appropriate Remediation - a Road Map for Virtual Learning Process
    Najjar, Mehdi
    ARTIFICIAL INTELLIGENCE IN EDUCATION: SUPPORTING LEARNING THROUGH INTELLIGENT AND SOCIALLY INFORMED TECHNOLOGY, 2005, 125 : 971 - 971
  • [23] FROM KNOTHE'S TRANSPORT TO BRENIER'S MAP AND A CONTINUATION METHOD FOR OPTIMAL TRANSPORT
    Carlier, G.
    Galichon, A.
    Santambrogio, F.
    SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2010, 41 (06) : 2554 - 2576
  • [24] An Outlier-Resilient Autoencoder for Representing High-Dimensional and Incomplete Data
    Wu, Di
    Hu, Yuanpeng
    Liu, Kechen
    Li, Jing
    Wang, Xianmin
    Deng, Song
    Zheng, Nenggan
    Luo, Xin
    IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE, 2024,
  • [25] Am efficient method for representing, analyzing and visualizing massive, high dimensional data
    Dasu, T
    Johnson, T
    MINING AND MODELING MASSIVE DATA SETS IN SCIENCE, ENGINEERING, AND BUSINESS WITH A SUBTHEME IN ENVIRONMENTAL STATISTICS, 1997, 29 (01): : 70 - 75
  • [26] Probabilistic solutions to DAEs learning from physical data
    Wu, Zongmin
    Zhang, Ran
    ANALYSIS AND APPLICATIONS, 2021, 19 (06) : 1093 - 1111
  • [27] From Data to Optimal Decision Making: A Data-Driven, Probabilistic Machine Learning Approach to Decision Support for Patients With Sepsis
    Tsoukalas, Athanasios
    Albertson, Timothy
    Tagkopoulos, Ilias
    JMIR MEDICAL INFORMATICS, 2015, 3 (01)
  • [28] Learning probabilistic phenotypes from heterogeneous EHR data
    Pivovarov, Rimma
    Perotte, Adler J.
    Grave, Edouard
    Angiolillo, John
    Wiggins, Chris H.
    Elhadad, Noemie
    JOURNAL OF BIOMEDICAL INFORMATICS, 2015, 58 : 156 - 165
  • [29] A guide to the literature on learning probabilistic networks from data
    Buntine, W
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 1996, 8 (02) : 195 - 210
  • [30] FROM KNOTHE'S REARRANGEMENT TO BRENIER'S OPTIMAL TRANSPORT MAP
    Bonnotte, Nicolas
    SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 2013, 45 (01) : 64 - 87