GraphMap: scalable iterative graph processing using NoSQL

被引:0
作者
Sayan Goswami
Ayam Pokhrel
Kisung Lee
Ling Liu
Qi Zhang
Yang Zhou
机构
[1] Louisiana State University,
[2] Louisiana State University,undefined
[3] Georgia Institute of Technology,undefined
[4] IBM Thomas J. Watson Research Center,undefined
[5] Auburn University,undefined
来源
The Journal of Supercomputing | 2020年 / 76卷
关键词
Graph processing; Distributed systems; NoSQL;
D O I
暂无
中图分类号
学科分类号
摘要
Despite having several distributed graph processing frameworks, scalable iterative processing of large graphs is a challenging problem since the graph and intermediate data need a global view of the graph topology in distributed memory. Although some systems support out-of-core iterative computations, they use a single machine and often require fast storage. In this paper, we present a new distributed iterative graph computation framework, called GraphMap, that utilizes a disk-based NoSQL database system for scalable graph processing while ensuring competitive performance. Extensive experiments on several real-world graphs show that GraphMap is more scalable and often faster than existing distributed memory-based systems for various graph processing workloads.
引用
收藏
页码:6619 / 6647
页数:28
相关论文
共 41 条
  • [31] Liu M(undefined)undefined undefined undefined undefined-undefined
  • [32] Chen H(undefined)undefined undefined undefined undefined-undefined
  • [33] Cheng J(undefined)undefined undefined undefined undefined-undefined
  • [34] Wu H(undefined)undefined undefined undefined undefined-undefined
  • [35] Zhang C(undefined)undefined undefined undefined undefined-undefined
  • [36] Zerbino DR(undefined)undefined undefined undefined undefined-undefined
  • [37] Birney E(undefined)undefined undefined undefined undefined-undefined
  • [38] Zhou Y(undefined)undefined undefined undefined undefined-undefined
  • [39] Liu L(undefined)undefined undefined undefined undefined-undefined
  • [40] Lee K(undefined)undefined undefined undefined undefined-undefined