BLADYG: A Graph Processing Framework for Large Dynamic Graphs

被引:18
作者
Aridhi, Sabeur [1 ]
Montresor, Alberto [2 ]
Velegrakis, Yannis [2 ]
机构
[1] Univ Lorraine, LORIA, Campus Sci,BP 239, F-54506 Vandoeuvre Les Nancy, France
[2] Univ Trento, Trento, Italy
关键词
Distributed graph processing; Dynamic graphs; AKKA framework; Graph partitioning; k-Core decomposition; K-CORE DECOMPOSITION; MAINTENANCE; COMPUTATION;
D O I
10.1016/j.bdr.2017.05.003
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, distributed processing of large dynamic graphs has become very popular, especially in certain domains such as social network analysis, Web graph analysis and spatial network analysis. In this context, many distributed/parallel graph processing systems have been proposed, such as Pregel, PowerGraph, GraphLab, and Trinity. However, these systems deal only with static graphs and do not consider the issue of processing evolving and dynamic graphs. In this paper, we are considering the issues of scale and dynamism in the case of graph processing systems. We present BLADYG, a graph processing framework that addresses the issue of dynamism in large-scale graphs. We present an implementation of BLADYG on top of AKKA framework. We experimentally evaluate the performance of the proposed framework by applying it to problems such as distributed k-core decomposition and partitioning of large dynamic graphs. The experimental results show that the performance and scalability of BLADYG are satisfying for large-scale dynamic graphs. (C) 2017 Elsevier Inc. All rights reserved.
引用
收藏
页码:9 / 17
页数:9
相关论文
共 28 条
[1]   Distributed k-Core View Materialization and Maintenance for Large Dynamic Graphs [J].
Aksu, Hidayet ;
Canim, Mustafa ;
Chang, Yuan-Chi ;
Korpeoglu, Ibrahim ;
Ulusoy, Ozgur .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2014, 26 (10) :2439-2452
[2]  
[Anonymous], 2008, NETW HETEROG MEDIA
[3]  
[Anonymous], 2012, NSDI
[4]  
[Anonymous], 2012, P 10 USENIX S OP SYS
[5]  
Aridhi S., 2016, P 10 ACM INT C DISTR, P161, DOI DOI 10.1145/2933267.2933299
[6]   BLADYG: A Novel Block-Centric Framework for the Analysis of Large Dynamic Graphs [J].
Aridhi, Sabeur ;
Montresor, Alberto ;
Velegrakis, Yannis .
PROCEEDINGS OF THE ACM WORKSHOP ON HIGH PERFORMANCE GRAPH PROCESSING (HPGP'16), 2016, :39-42
[7]   Big Graph Mining: Frameworks and Techniques [J].
Aridhi, Sabeur ;
Nguifo, Engelbert Mephu .
BIG DATA RESEARCH, 2016, 6 :1-10
[8]   Fast algorithms for determining (generalized) core groups in social networks [J].
Batagelj, Vladimir ;
Zaversnik, Matjaz .
ADVANCES IN DATA ANALYSIS AND CLASSIFICATION, 2011, 5 (02) :129-145
[9]   FlumeJava']Java: Easy, Efficient Data-Parallel Pipelines [J].
Chambers, Craig ;
Raniwala, Ashish ;
Perry, Frances ;
Adams, Stephen ;
Henry, Robert R. ;
Bradshaw, Robert ;
Weizenbaum, Nathan .
PLDI '10: PROCEEDINGS OF THE 2010 ACM SIGPLAN CONFERENCE ON PROGRAMMING LANGUAGE DESIGN AND IMPLEMENTATION, 2010, :363-375
[10]   Blogel: A Block-Centric Framework for Distributed Computation on Real-World Graphs [J].
Da Yan ;
Cheng, James ;
Yi Lu ;
Ng, Wilfred .
PROCEEDINGS OF THE VLDB ENDOWMENT, 2014, 7 (14) :1981-1992