Updating PageRank for Streaming Graphs

被引:9
作者
Riedy, Jason [1 ]
机构
[1] Georgia Inst Technol, Coll Comp, Atlanta, GA 30332 USA
来源
2016 IEEE 30TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM WORKSHOPS (IPDPSW) | 2016年
关键词
graph analysis; PageRank; streaming graphs; ITERATIVE REFINEMENT; ALGORITHM;
D O I
10.1109/IPDPSW.2016.22
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Incremental graph algorithms can respond quickly to small changes in massive graphs by updating rather than recomputing analysis metrics. Here we use the linear system formulation of PageRank and ideas from iterative refinement to compute the update to a PageRank vector accurately and quickly. The core idea is to express the residual of the original solution with respect to the updated matrix representing the graph. The update to the residual is sparse. Solving for the solution update with a straight-forward iterative method spreads the change outward from the change locations but converges before traversing the entire graph. We achieve speed-ups of 2x to over 40x relative to a restarted, highly parallel PageRank iteration for small, low-latency batches of edge insertions. These cases traverse 2x to nearly 10000x fewer edges than the restarted PageRank iteration. This provides an interesting test case for the ongoing GraphBLAS effort: Can the APIs support our incremental algorithms cleanly and efficiently?
引用
收藏
页码:877 / 884
页数:8
相关论文
共 21 条
  • [1] [Anonymous], 2014, Encyclopedia of Social Network Analysis and Mining, DOI [10.1007/978-1-4614-6170-8, 10.1007/978-1-4614-6170-8_23, DOI 10.1007/978-1-4614-6170-8_23]
  • [2] Bahmani B., 2012, KDD, P24, DOI DOI 10.1145/2339530.2339539
  • [3] Bahmani B, 2010, PROC VLDB ENDOW, V4, P173
  • [4] Algorithm 832: UMFPACK V4.3 - An unsymmetric-pattern multifrontal method
    Davis, TA
    [J]. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 2004, 30 (02): : 196 - 199
  • [5] Fast PageRank Computation via a Sparse Linear System
    Del Corso, Gianna M.
    Gulli, Antonio
    Romani, Francesco
    [J]. INTERNET MATHEMATICS, 2005, 2 (03) : 251 - 273
  • [6] Ediger D, 2012, IEEE HIGH PERF EXTR
  • [7] Fairbanks J. P., 2015, CORR
  • [8] Gleich D, 2004, FAST PARALLEL PAGERA, V13, P22
  • [9] Approximating Personalized PageRank with Minimal Use of Web Graph Data
    Gleich, David
    Polito, Marzia
    [J]. INTERNET MATHEMATICS, 2006, 3 (03) : 257 - 294
  • [10] PageRank Beyond the Web
    Gleich, David F.
    [J]. SIAM REVIEW, 2015, 57 (03) : 321 - 363