Coupling matrix manifolds assisted optimization for optimal transport problems

被引:0
作者
Dai Shi
Junbin Gao
Xia Hong
S. T. Boris Choy
Zhiyong Wang
机构
[1] The University of Sydney,Discipline of Business Analytics, The University of Sydney Business School
[2] University of Reading,Department of Computer Science
[3] The University of Sydney,School of Computer Science
来源
Machine Learning | 2021年 / 110卷
关键词
Optimal transport; Doubly stochastic matrices; Coupling matrix manifold; Sinkhorn algorithm; Wasserstein distance; Entropy regularized optimal transport;
D O I
暂无
中图分类号
学科分类号
摘要
Optimal transport (OT) is a powerful tool for measuring the distance between two probability distributions. In this paper, we introduce a new manifold named as the coupling matrix manifold (CMM), where each point on this novel manifold can be regarded as a transportation plan of the optimal transport problem. We firstly explore the Riemannian geometry of CMM with the metric expressed by the Fisher information. These geometrical features can be exploited in many essential optimization methods as a framework solving all types of OT problems via incorporating numerical Riemannian optimization algorithms such as gradient descent and trust region algorithms in CMM manifold. The proposed approach is validated using several OT problems in comparison with recent state-of-the-art related works. For the classic OT problem and its entropy regularized variant, it is shown that our method is comparable with the classic algorithms such as linear programming and Sinkhorn algorithms. For other types of non-entropy regularized OT problems, our proposed method has shown superior performance to other works, whereby the geometric information of the OT feasible space was not incorporated within.
引用
收藏
页码:533 / 558
页数:25
相关论文
共 60 条
[1]  
Brezis H(2018)Remarks on the Monge–Kantorovich problem in the discrete setting Comptes Rendus Mathematique 356 207-213
[2]  
Bruzzone L(2010)Domain adaptation problems: A DASVM classification technique and a circular validation strategy IEEE Transactions on Pattern Analysis and Machine Intelligence 32 770-787
[3]  
Marconcini M(2016)Optimal transport for domain adaptation IEEE Transactions on Pattern Analysis and Machine Intelligence 39 1853-1865
[4]  
Courty N(2013)Sinkhorn distances: Lightspeed computation of optimal transport Advances in Neural Information Processing Systems 26 2292-2300
[5]  
Flamary R(2014)Combinatorics and geometry of transportation polytopes: An update Discrete Geometry and Algebraic Combinatorics 625 37-76
[6]  
Tuia D(2018)Regularised optimal transport and the rot mover’s distance Journal of Machine Learning Research 19 1-53
[7]  
Rakotomamonjy A(2019)Manifold optimization over the set of doubly stochastic matrices: A second-order geometry IEEE Transactions on Signal Processing 67 5761-5774
[8]  
Cuturi M(2018)Quadratically regularized optimal transport on graphs SIAM Journal on Scientific Computing 40 A1961-A1986
[9]  
De Loera JA(2014)Regularized discrete optimal transport SIAM Journal on Imaging Sciences 7 1853-1882
[10]  
Kim ED(2018)Wasserstein discriminant analysis Machine Learning 107 1923-1945