Scalable Single Source Shortest Path Algorithms for Massively Parallel Systems

被引:20
作者
Chakaravarthy, Venkatesan T. [1 ]
Checconi, Fabio [2 ]
Petrini, Fabrizio [2 ]
Sabharwal, Yogish [1 ]
机构
[1] IBM Res India, New Delhi, India
[2] IBM Corp, TJ Watson Res Ctr, Armonk, NY 10504 USA
来源
2014 IEEE 28TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM | 2014年
关键词
FIBONACCI HEAPS; BETWEENNESS; CENTRALITY; GRAPHS;
D O I
10.1109/IPDPS.2014.96
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In the single-source shortest path (SSSP) problem, we have to find the shortest paths from a source vertex v to all other vertices in a graph. In this paper, we introduce a novel parallel algorithm, derived from the Bellman-Ford and Delta-stepping algorithms. We employ various pruning techniques, such as edge classification and direction-optimization, to dramatically reduce inter-node communication traffic, and we propose load balancing strategies to handle higher-degree vertices. The extensive performance analysis shows that our algorithms work well on scale-free and real-world graphs. In the largest tested configuration, an R-MAT graph with 2(38) vertices and 2(42) edges on 32, 768 Blue Gene/Q nodes, we have achieved a processing rate of three Trillion Edges Per Second (TTEPS), a four orders of magnitude improvement over the best published results.
引用
收藏
页数:13
相关论文
共 27 条
[1]  
[Anonymous], P INT C HIGH PERF CO
[2]  
[Anonymous], P 9 WORKSH ALG ENG E
[3]   Designing multithreaded algorithms for breadth-first search and st-connectivity on the cray MTA-2 [J].
Bader, David A. ;
Madduri, Kamesh .
2006 INTERNATIONAL CONFERENCE ON PARALLEL PROCESSING, PROCEEDINGS, 2006, :523-530
[4]  
Bellman R., 1958, ROUTING PROBLEM Q AP, V16, P87
[5]   A faster algorithm for betweenness centrality [J].
Brandes, U .
JOURNAL OF MATHEMATICAL SOCIOLOGY, 2001, 25 (02) :163-177
[6]   A parallel priority data structure with applications [J].
Brodal, GS ;
Traff, JL ;
Zaroliagis, CD .
11TH INTERNATIONAL PARALLEL PROCESSING SYMPOSIUM, PROCEEDINGS, 1997, :689-693
[7]  
Chakrabarti D, 2004, SIAM PROC S, P442
[8]  
Checconi F., 2012, P INT C HIGH PERF CO
[9]  
Chen D., 2011, SC 11, P1
[10]   THE IBM BLUE GENE/Q INTERCONNECTION FABRIC [J].
Chen, Dong ;
Eisley, Noel A. ;
Heidelberger, Philip ;
Senger, Robert M. ;
Sugawara, Yutaka ;
Kumar, Sameer ;
Salapura, Valentina ;
Satterfield, David L. ;
Steinmacher-Burow, Burkhard ;
Parker, Jeffrey J. .
IEEE MICRO, 2012, 32 (01) :32-43