Improved Graph Clustering

被引:55
作者
Chen, Yudong [1 ]
Sanghavi, Sujay [2 ]
Xu, Huan [3 ]
机构
[1] Univ Calif Berkeley, Dept Elect Engn & Comp Sci, Berkeley, CA 94720 USA
[2] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78712 USA
[3] Natl Univ Singapore, Dept Mech Engn, Singapore 117575, Singapore
基金
美国国家科学基金会;
关键词
Graph clustering; maximum likehood estimator; convex optimization; stochastic block model; ALGORITHMS; CLIQUE;
D O I
10.1109/TIT.2014.2346205
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph clustering involves the task of dividing nodes into clusters, so that the edge density is higher within clusters as opposed to across clusters. A natural, classic, and popular statistical setting for evaluating solutions to this problem is the stochastic block model, also referred to as the planted partition model. In this paper, we present a new algorithm-a convexified version of maximum likelihood-for graph clustering. We show that, in the classic stochastic block model setting, it outperforms existing methods by polynomial factors when the cluster size is allowed to have general scalings. In fact, it is within logarithmic factors of known lower bounds for spectral methods, and there is evidence suggesting that no polynomial time algorithm would do significantly better. We then show that this guarantee carries over to a more general extension of the stochastic block model. Our method can handle the settings of semirandom graphs, heterogeneous degree distributions, unequal cluster sizes, unaffiliated nodes, partially observed graphs, planted clique/coloring, and so on. In particular, our results provide the best exact recovery guarantees to date for the planted partition, planted k-disjoint-cliques and planted noisy coloring models with general cluster sizes; in other settings, we match the best existing results up to logarithmic factors.
引用
收藏
页码:6440 / 6455
页数:16
相关论文
共 50 条
[1]   Fast computation of low-rank matrix approximations [J].
Achlioptas, Dimitris ;
McSherry, Frank .
JOURNAL OF THE ACM, 2007, 54 (02)
[2]  
Ailon Nir, 2013, P 30 INT C MACH LEAR, P995
[3]   A spectral technique for coloring random 3-colorable graphs [J].
Alon, N ;
Kahale, N .
SIAM JOURNAL ON COMPUTING, 1997, 26 (06) :1733-1748
[4]  
Alon N, 1998, RANDOM STRUCT ALGOR, V13, P457, DOI 10.1002/(SICI)1098-2418(199810/12)13:3/4<457::AID-RSA14>3.0.CO
[5]  
2-W
[6]  
Ames B. P. W., 2013, MATH PROGRAMMING
[7]   Convex optimization for the planted k-disjoint-clique problem [J].
Ames, Brendan P. W. ;
Vavasis, Stephen A. .
MATHEMATICAL PROGRAMMING, 2014, 143 (1-2) :299-337
[8]  
Anandkumar A, 2014, J MACH LEARN RES, V15, P2239
[9]  
[Anonymous], UILUENG092215 UIUC D
[10]  
[Anonymous], 2006, Elements of Information Theory