DynamoGraph: A Distributed System for Large-scale, Temporal Graph Processing, its Implementation and First Observations

被引:6
|
作者
Steinbauer, Matthias [1 ]
Anderst-Kotsis, Gabriele [1 ]
机构
[1] Johannes Kepler Univ Linz, Inst Telecooperat, Linz, Austria
来源
PROCEEDINGS OF THE 25TH INTERNATIONAL CONFERENCE ON WORLD WIDE WEB (WWW'16 COMPANION) | 2016年
关键词
Distributed computing; Graph processing; Pregel; Temporal graph; Large-scale graph;
D O I
10.1145/2872518.2889293
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Graph models have a long standing history as models for real world structures and processes. In recent research two important dimensions of graphs are described of particular importance. (1) Temporal aspects of graphs cannot be neglected for many current application scenarios such as social network analysis or the analysis of the global web graph. (2) The mentioned graph structures have grown to very large sizes such that traditional methodologies no longer hold. In this work a distributed computing framework designed for storing and processing of large-scale temporal graphs is presented. For this system a reference implementation in Java was created. In this paper first insight on the implementation and observations in using the system are discussed.
引用
收藏
页码:861 / 866
页数:6
相关论文
共 50 条
  • [1] DynamoGraph: extending the Pregel paradigm for large-scale temporal graph processing
    Steinbauer, Matthias
    Anderst-Kotsis, Gabriele
    INTERNATIONAL JOURNAL OF GRID AND UTILITY COMPUTING, 2016, 7 (02) : 141 - 151
  • [2] Distributed large-scale graph processing on FPGAs
    Sahebi, Amin
    Barbone, Marco
    Procaccini, Marco
    Luk, Wayne
    Gaydadjiev, Georgi
    Giorgi, Roberto
    JOURNAL OF BIG DATA, 2023, 10 (01)
  • [3] Distributed large-scale graph processing on FPGAs
    Amin Sahebi
    Marco Barbone
    Marco Procaccini
    Wayne Luk
    Georgi Gaydadjiev
    Roberto Giorgi
    Journal of Big Data, 10
  • [4] Implementation of large-scale distributed information retrieval system
    Sun, L
    Chen, GC
    2001 INTERNATIONAL CONFERENCES ON INFO-TECH AND INFO-NET PROCEEDINGS, CONFERENCE A-G: INFO-TECH & INFO-NET: A KEY TO BETTER LIFE, 2001, : C7 - C17
  • [5] Complex query processing in large-scale distributed system
    Zhou, Ao-Ying
    Zhou, Min-Qi
    Qian, Wei-Ning
    Zhang, Rong
    Jisuanji Xuebao/Chinese Journal of Computers, 2008, 31 (09): : 1563 - 1572
  • [6] An Analysis of Distributed Programming Models and Frameworks for Large-scale Graph Processing
    Corbellini, Alejandro
    Godoy, Daniela
    Mateos, Cristian
    Schiaffino, Silvia
    Zunino, Alejandro
    IETE JOURNAL OF RESEARCH, 2022, 68 (04) : 3065 - 3073
  • [7] Design and Implementation of Large-scale Distributed Video Surveillance System
    Yang Hongyun
    Chen Xuhui
    Hu Ruiming
    Chen Jun
    ICCSE 2008: PROCEEDINGS OF THE THIRD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION: ADVANCED COMPUTER TECHNOLOGY, NEW EDUCATION, 2008, : 235 - 239
  • [8] Performance and Monetary Cost of Large-scale Distributed Graph Processing on Amazon Cloud
    Li, Zengxiang
    Thai Nguyen Hung
    Lu, Sifei
    Goh, Rick Siow Mong
    2016 INTERNATIONAL CONFERENCE ON CLOUD COMPUTING RESEARCH AND INNOVATION - ICCCRI 2016, 2016, : 9 - 16
  • [9] Large Scale Graph Processing in a Distributed Environment
    Upadhyay, Nitesh
    Patel, Parita
    Cheramangalath, Unnikrishnan
    Srikant, Y. N.
    EURO-PAR 2017: PARALLEL PROCESSING WORKSHOPS, 2018, 10659 : 465 - 477
  • [10] Large-Scale Dynamic Graph Updating Algorithm in Distributed Computing System
    Rong Xuanyu
    Cui Huanqing
    PROCEEDINGS OF 2019 2ND INTERNATIONAL CONFERENCE ON BIG DATA TECHNOLOGIES (ICBDT 2019), 2019, : 248 - 251