The fastest mixing Markov process on a graph and a connection to a maximum variance unfolding problem

被引:92
作者
Sun, Jun [1 ]
Boyd, Stephen
Xiao, Lin
Diaconis, Persi
机构
[1] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
[2] CALTECH, Ctr Math Informat, Pasadena, CA 91125 USA
[3] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[4] Stanford Univ, Dept Math, Stanford, CA 94305 USA
关键词
Markov process; fast mixing; second smallest eigenvalue; semidefinite programming; dimensionality reduction;
D O I
10.1137/S0036144504443821
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider a Markov process on a connected graph, with edges labeled with transition rates between the adjacent vertices. The distribution of the Markov process converges to the uniform distribution at a rate determined by the second smallest eigenvalue lambda(2) Of the Laplacian of the weighted graph. In this paper we consider the problem of assigning transition rates to the edges so as to maximize lambda(2) subject to a linear constraint on the rates. This is the problem of finding the fastest mixing Markov process (FMMP) on the graph. We show that the FMMP problem is a convex optimization problem, which can in turn be expressed as a semidefinite program, and therefore effectively solved numerically. We formulate a dual of the FMMP problem and show that it has a natural geometric interpretation as a maximum variance unfolding (MVU) problem, i.e., the problem of choosing a set of points to be as far apart as possible, measured by their variance, while respecting local distance constraints. This MVU problem is closely related to a problem recently proposed by Weinberger and Saul as a method for "unfolding" high-dimensional data that lies on a low-dimensional manifold. The duality between the FMMP and MVU problems sheds light on both problems, and allows us to characterize and, in some cases, find optimal solutions.
引用
收藏
页码:681 / 699
页数:19
相关论文
共 32 条
  • [1] [Anonymous], 2004, P 21 INT C MACH LEAR
  • [2] BENSON S, 2001, ANLMCSP8511000
  • [3] CSDP, a C library for semidefinite programming
    Borchers, B
    [J]. OPTIMIZATION METHODS & SOFTWARE, 1999, 11-2 (1-4) : 613 - 623
  • [4] Fastest mixing Markov chain on a path
    Boyd, S
    Diaconis, P
    Sun, J
    Xiao, L
    [J]. AMERICAN MATHEMATICAL MONTHLY, 2006, 113 (01) : 70 - 74
  • [5] Fastest mixing Markov chain on a graph
    Boyd, S
    Diaconis, P
    Xiao, L
    [J]. SIAM REVIEW, 2004, 46 (04) : 667 - 689
  • [6] Boyd S., 2004, CONVEX OPTIMIZATION
  • [7] ON THE OPTIMAL-DESIGN OF COLUMNS AGAINST BUCKLING
    COX, SJ
    OVERTON, ML
    [J]. SIAM JOURNAL ON MATHEMATICAL ANALYSIS, 1992, 23 (02) : 287 - 325
  • [8] Where best to hold a drum fast
    Cox, SJ
    Uhlig, PX
    [J]. SIAM JOURNAL ON OPTIMIZATION, 1999, 9 (04) : 948 - 964
  • [9] Diaconis P, 1996, ANN APPL PROBAB, V6, P695
  • [10] SOME MINIMAX PROBLEMS FOR GRAPHS
    FIEDLER, M
    [J]. DISCRETE MATHEMATICS, 1993, 121 (1-3) : 65 - 74