Graph Programming Interface (GPI): A Linear Algebra Programming Model for Large Scale Graph Computations

被引:13
作者
Ekanadham, K. [1 ]
Horn, W. P. [1 ]
Kumar, Manoj [1 ]
Jann, Joefon [1 ]
Moreira, Jose [1 ]
Pattnaik, Pratap [1 ]
Serrano, Mauricio [1 ]
Tanase, Gabriel [1 ]
Yu, Hao [1 ]
机构
[1] IBM Thomas J Watson Res Ctr, Yorktown Hts, NY 10598 USA
来源
PROCEEDINGS OF THE ACM INTERNATIONAL CONFERENCE ON COMPUTING FRONTIERS (CF'16) | 2016年
关键词
D O I
10.1145/2903150.2903164
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Graph processing is becoming a crucial component for analyzing big data arising in many application domains such as social and biological networks, fraud detection, and sentiment analysis. As a result, a number of computational models for graph analytics have been proposed in the literature to help users write efficient large scale graph algorithms. In this paper we present an alternative model for implementing graph algorithms using a linear algebra based specification. We first specify a set of linear algebra primitives that allows users to express graph algorithms by composition of linear algebra operations. We then describe a high performance implementation of these primitives and its integration with the Spark framework to achieve the scalability we need for large shared-memory systems. We provide an overview of our implementation and also compare and contrast the expressiveness and performance of various algorithms implemented with our approach with that of the current Spark GraphX implementation of those algorithms.
引用
收藏
页码:72 / 81
页数:10
相关论文
共 28 条
  • [1] [Anonymous], 2010, INTRO GRAPH 500
  • [2] [Anonymous], 2001, The Boost Graph Library: User Guide and Reference Manual, Portable Documents
  • [3] [Anonymous], 2014, SIAM WORKSH EX APPL
  • [4] [Anonymous], 2011, P HAD SUMM SANT CLAR
  • [5] [Anonymous], 2003, ITERATIVE METHODS SP, DOI DOI 10.1137/1.9780898718003
  • [6] A faster algorithm for betweenness centrality
    Brandes, U
    [J]. JOURNAL OF MATHEMATICAL SOCIOLOGY, 2001, 25 (02) : 163 - 177
  • [7] The anatomy of a large-scale hypertextual Web search engine
    Brin, S
    Page, L
    [J]. COMPUTER NETWORKS AND ISDN SYSTEMS, 1998, 30 (1-7): : 107 - 117
  • [8] The Combinatorial BLAS: design, implementation, and applications
    Buluc, Aydin
    Gilbert, John R.
    [J]. INTERNATIONAL JOURNAL OF HIGH PERFORMANCE COMPUTING APPLICATIONS, 2011, 25 (04) : 496 - 509
  • [9] Buluç A, 2009, SPAA'09: PROCEEDINGS OF THE TWENTY-FIRST ANNUAL SYMPOSIUM ON PARALLELISM IN ALGORITHMS AND ARCHITECTURES, P233
  • [10] Optimizing Sparse Linear Algebra for Large-Scale Graph Analytics
    Buono, Daniele
    Gunnels, John A.
    Que, Xinyu
    Checconi, Fabio
    Petrini, Fabrizio
    Tuan, Tai-Ching
    Long, Chris
    [J]. COMPUTER, 2015, 48 (08) : 26 - 34