Pregel Algorithms for Graph Connectivity Problems with Performance Guarantees

被引:64
作者
Yan, Da [1 ]
Cheng, James [1 ]
Xing, Kai [2 ]
Lu, Yi [1 ]
Ng, Wilfred [2 ]
Bu, Yingyi [3 ]
机构
[1] Chinese Univ Hong Kong, Dept Comp Sci & Engn, Hong Kong, Hong Kong, Peoples R China
[2] Hong Kong Univ Sci & Technol, Dept Comp Sci & Engn, Hong Kong, Hong Kong, Peoples R China
[3] Univ Calif Irvine, Dept Comp Sci, Irvine, CA 92717 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2014年 / 7卷 / 14期
关键词
D O I
10.14778/2733085.2733089
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graphs in real life applications are often huge, such as the Web graph and various social networks. These massive graphs are often stored and processed in distributed sites. In this paper, we study graph algorithms that adopt Google's Pregel, an iterative vertex-centric framework for graph processing in the Cloud. We first identify a set of desirable properties of an efficient Pregel algorithm, such as linear space, communication and computation cost per iteration, and logarithmic number of iterations. We define such an algorithm as a practical Pregel algorithm (PPA). We then propose PPAs for computing connected components (CCs), biconnected components (BCCs) and strongly connected components (SCCs). The PPAs for computing BCCs and SCCs use the PPAs of many fundamental graph problems as building blocks, which are of interest by themselves. Extensive experiments over large real graphs verified the efficiency of our algorithms.
引用
收藏
页码:1821 / 1832
页数:12
相关论文
共 24 条
[11]   Distributed GraphLab: A Framework for Machine Learning and Data Mining in the Cloud [J].
Low, Yucheng ;
Gonzalez, Joseph ;
Kyrola, Aapo ;
Bickson, Danny ;
Guestrin, Carlos ;
Hellerstein, Joseph M. .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (08) :716-727
[12]  
Malewicz G., 2010, P 2010 ACM SIGMOD IN, P135, DOI [10.1145/1807167.1807184, DOI 10.1145/1807167.1807184]
[13]   Using Pregel-like Large Scale Graph Processing Frameworks for Social Network Analysis [J].
Quick, Louise ;
Wilkinson, Paul ;
Hardcastle, David .
2012 IEEE/ACM INTERNATIONAL CONFERENCE ON ADVANCES IN SOCIAL NETWORKS ANALYSIS AND MINING (ASONAM), 2012, :457-463
[14]  
Rastogi V, 2013, PROC INT CONF DATA, P50, DOI 10.1109/ICDE.2013.6544813
[15]   DEPTH-1ST SEARCH IS INHERENTLY SEQUENTIAL [J].
REIF, JH .
INFORMATION PROCESSING LETTERS, 1985, 20 (05) :229-234
[16]   Optimizing Graph Algorithms on Pregel-like Systems [J].
Salihoglu, Semih ;
Widom, Jennifer .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 7 (07) :577-588
[17]  
Salihoglu Semih, 2013, P 25 INT C SCI STAT, P22
[18]   AN O(LOG N) PARALLEL CONNECTIVITY ALGORITHM [J].
SHILOACH, Y ;
VISHKIN, U .
JOURNAL OF ALGORITHMS, 1982, 3 (01) :57-67
[19]  
Tao Y., 2013, SIGMOD, P529, DOI DOI 10.1145/2463676.2463719
[20]   AN EFFICIENT PARALLEL BICONNECTIVITY ALGORITHM [J].
TARJAN, RE ;
VISHKIN, U .
SIAM JOURNAL ON COMPUTING, 1985, 14 (04) :862-874