Belief Propagation and LP Relaxation for Weighted Matching in General Graphs

被引:31
作者
Sanghavi, Sujay [1 ]
Malioutov, Dmitry [2 ]
Willsky, Alan [3 ]
机构
[1] Univ Texas Austin, Austin, TX 78750 USA
[2] DRW Inc, Chicago, IL USA
[3] MIT, Cambridge, MA 02139 USA
基金
美国国家科学基金会;
关键词
Belief propagation; combinatorial optimization; graphical models; Markov random fields; matching; message passing;
D O I
10.1109/TIT.2011.2110170
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Loopy belief propagation has been employed in a wide variety of applications with great empirical success, but it comes with few theoretical guarantees. In this paper, we analyze the performance of the max-product form of belief propagation for the weighted matching problem on general graphs. We show that the performance of max-product is exactly characterized by the natural linear programming (LP) relaxation of the problem. In particular, we first show that if the LP relaxation has no fractional optima then max-product always converges to the correct answer. This establishes the extension of the recent result by Bayati, Shah and Sharma, which considered bipartite graphs, to general graphs. Perhaps more interestingly, we also establish a tight converse, namely that the presence of any fractional LP optimum implies that max-product will fail to yield useful estimates on some of the edges. We extend our results to the weighted b-matching and r-edge-cover problems. We also demonstrate how to simplify the max-product message-update equations for weighted matching, making it easily deployable in distributed settings like wireless or sensor networks.
引用
收藏
页码:2203 / 2212
页数:10
相关论文
共 17 条
[1]  
[Anonymous], 2003, COMBINATORIAL OPTIMI
[2]  
[Anonymous], 2003, Exploring artificial intelligence in the new millennium, DOI DOI 10.5555/779343.779352
[3]  
Bayati M, 2005, 2005 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), VOLS 1 AND 2, P1763
[4]  
BAYATI M, BELIEF PROPAGATION W
[5]  
HUANG B, 2007, P ART INT STAT AISTA
[6]  
Kolmogorov V. N., 2005, P UNC ART INT ED SCO
[7]   Factor graphs and the sum-product algorithm [J].
Kschischang, FR ;
Frey, BJ ;
Loeliger, HA .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2001, 47 (02) :498-519
[8]  
Malioutov DM, 2006, J MACH LEARN RES, V7, P2031
[9]  
Pearl J., 1988, PROBABILISTIC INFERE
[10]  
Sanghavi S., 2007, P INF THEOR WORKSH S