Pregel Algorithms for Graph Connectivity Problems with Performance Guarantees

被引:64
作者
Yan, Da [1 ]
Cheng, James [1 ]
Xing, Kai [2 ]
Lu, Yi [1 ]
Ng, Wilfred [2 ]
Bu, Yingyi [3 ]
机构
[1] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Hong Kong, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Hong Kong, Peoples R China
[3] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92717 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2014年 / 7卷 / 14期
关键词
D O I
10.14778/2733085.2733089
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graphs in real life applications are often huge, such as the Web graph and various social networks. These massive graphs are often stored and processed in distributed sites. In this paper, we study graph algorithms that adopt Google's Pregel, an iterative vertex-centric framework for graph processing in the Cloud. We first identify a set of desirable properties of an efficient Pregel algorithm, such as linear space, communication and computation cost per iteration, and logarithmic number of iterations. We define such an algorithm as a practical Pregel algorithm (PPA). We then propose PPAs for computing connected components (CCs), biconnected components (BCCs) and strongly connected components (SCCs). The PPAs for computing BCCs and SCCs use the PPAs of many fundamental graph problems as building blocks, which are of interest by themselves. Extensive experiments over large real graphs verified the efficiency of our algorithms.
引用
收藏
页码:1821 / 1832
页数:12
相关论文
共 24 条
[1]  
Avery C., 2011, P HAD SUMM SANT CLAR
[2]  
Barnat J, 2007, LECT NOTES COMPUT SC, V4346, P316
[3]   Improved Distributed Algorithms for SCC Decomposition [J].
Barnat, Jiri ;
Chaloupka, Jakub ;
van de Pol, Jaco .
ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, 2008, 198 (01) :63-77
[4]  
Cheney James, 2013, In Search of Elegance in the Theory and Practice of Computation. Essays Dedicated to Peter Buneman: LNCS 8000, P193, DOI 10.1007/978-3-642-41660-6_9
[5]  
Cheng J, 2010, SIGMOD, P447, DOI 10.1145/1807167.1807217
[6]  
Cheng J., 2012, SIGMOD C, P457
[7]  
Chu S., 2011, TRIANGLE LISTING MAS, P672
[8]  
Dayarathna M, 2013, PROCEEDINGS OF THE 22ND INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'13 COMPANION), P509
[9]  
Fleischer LK, 2000, LECT NOTES COMPUT SC, V1800, P505
[10]  
Gonzalez J. E., 2012, P 10 USENIX C OPERAT, P17