Scalable Single Source Shortest Path Algorithms for Massively Parallel Systems

被引:36
作者
Chakaravarthy, Venkatesan T. [1 ]
Checconi, Fabio [2 ]
Murali, Prakash [1 ]
Petrini, Fabrizio [2 ,3 ]
Sabharwal, Yogish [1 ]
机构
[1] IBM Res, New Delhi 110070, India
[2] IBM Thomas J Watson Res Ctr, Yorktown Hts, NY 10598 USA
[3] Intel Parallel Comp Labs, Santa Clara, CA 95054 USA
关键词
Shortest path; parallel algorithm; delta stepping; graph; 500; benchmark; distributed system;
D O I
10.1109/TPDS.2016.2634535
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We consider the single-source shortest path (SSSP) problem: given an undirected graph with integer edge weights and a source vertex v, find the shortest paths from v to all other vertices. In this paper, we introduce a novel parallel algorithm, derived from the Bellman-Ford and Delta-stepping algorithms. We employ various pruning techniques, such as edge classification and direction-optimization, to dramatically reduce inter-node communication traffic, and we propose load balancing strategies to handle higher-degree vertices. These techniques are particularly effective on power-law graphs, as demonstrated by our extensive performance analysis. In the largest tested configuration, an R-MAT graph with 2(38) vertices and 2(42) edges on 32,768 Blue Gene/Q nodes, we have achieved a processing rate of three Trillion Edges Per Second (TTEPS), a four orders of magnitude improvement over the best published results.
引用
收藏
页码:2031 / 2045
页数:15
相关论文
共 27 条
  • [1] [Anonymous], P 2011 INT C HIGH PE
  • [2] Designing multithreaded algorithms for breadth-first search and st-connectivity on the cray MTA-2
    Bader, David A.
    Madduri, Kamesh
    [J]. 2006 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, PROCEEDINGS, 2006, : 523 - 530
  • [3] Densest Subgraph in Streaming and MapReduce
    Bahmani, Bahman
    Kumar, Ravi
    Vassilvitskii, Sergei
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2012, 5 (05): : 454 - 465
  • [4] Beamer S., 2012, 2012 SC - International Conference for High Performance Computing, Networking, Storage and Analysis, DOI 10.1109/SC.2012.50
  • [5] A faster algorithm for betweenness centrality
    Brandes, U
    [J]. JOURNAL OF MATHEMATICAL SOCIOLOGY, 2001, 25 (02) : 163 - 177
  • [6] A parallel priority data structure with applications
    Brodal, GS
    Traff, JL
    Zaroliagis, CD
    [J]. 11TH INTERNATIONAL PARALLEL PROCESSING SYMPOSIUM, PROCEEDINGS, 1997, : 689 - 693
  • [7] Chakrabarti D, 2004, SIAM PROC S, P442
  • [8] Checconi F, 2012, INT CONF HIGH PERFOR
  • [9] Traversing Trillions of Edges in Real-time: Graph Exploration on Large-scale Parallel Machines
    Checconi, Fabio
    Petrini, Fabrizio
    [J]. 2014 IEEE 28TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM, 2014,
  • [10] Delling D., 2011, Proceedings of the 25th IEEE International Parallel & Distributed Processing Symposium (IPDPS 2011), P921, DOI 10.1109/IPDPS.2011.89