Weaver: A High-Performance, Transactional Graph Database Based on Refinable Timestamps

被引:29
|
作者
Dubey, Ayush [1 ]
Hill, Greg D. [2 ]
Escriva, Robert [1 ]
Sirer, Emin Gun [1 ]
机构
[1] Cornell Univ, Ithaca, NY 14853 USA
[2] Stanford Univ, Stanford, CA 94305 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2016年 / 9卷 / 11期
基金
美国国家科学基金会;
关键词
D O I
10.14778/2983200.2983202
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Graph databases have become a common infrastructure component. Yet existing systems either operate on offline snapshots, provide weak consistency guarantees, or use expensive concurrency control techniques that limit performance. In this paper, we introduce a new distributed graph database, called Weaver, which enables efficient, transactional graph analyses as well as strictly serializable ACID transactions on dynamic graphs. The key insight that allows Weaver to combine strict serializability with horizontal scalability and high performance is a novel request ordering mechanism called refinable timestamps. This technique couples coarse-grained vector timestamps with a fine-grained timeline oracle to pay the overhead of strong consistency only when needed. Experiments show that Weaver enables a Bitcoin blockchain explorer that is 8x faster than Blockchain. info, and achieves 10 : 9x higher throughput than the Titan graph database on social network workloads and 4x lower latency than GraphLab on offline graph traversal workloads.
引用
收藏
页码:852 / 863
页数:12
相关论文
共 50 条
  • [41] PARALLEL DATABASE-SYSTEMS - THE FUTURE OF HIGH-PERFORMANCE DATABASE-SYSTEMS
    DEWITT, D
    GRAY, J
    COMMUNICATIONS OF THE ACM, 1992, 35 (06) : 85 - 98
  • [42] High-performance implementation for graph-based packet classification algorithm on network processor
    Tang, YY
    Qian, L
    Bou-Diab, B
    Krishnamurthy, A
    Damm, G
    Wang, YK
    2004 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS, VOLS 1-7, 2004, : 1268 - 1272
  • [43] DFMan: A Graph-based Optimization of Dataflow Scheduling on High-Performance Computing Systems
    Chowdhury, Fahim
    Di Natale, Francesco
    Moody, Adam
    Mohror, Kathryn
    Yu, Weikuan
    2022 IEEE 36TH INTERNATIONAL PARALLEL AND DISTRIBUTED PROCESSING SYMPOSIUM (IPDPS 2022), 2022, : 368 - 378
  • [44] Effective High-Level Synthesis for High-Performance Graph Processing
    Tang J.
    Zheng L.
    Liao X.
    Jin H.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2021, 58 (03): : 467 - 478
  • [45] MONITORING AND MODELING TOOLS FOR HIGH-PERFORMANCE DATABASE-SYSTEMS
    ALLEN, P
    CRAMB, I
    UPSTILL, C
    FUTURE GENERATION COMPUTER SYSTEMS, 1995, 11 (02) : 193 - 198
  • [46] High-performance GRID stream database manager for scientific data
    Koparanova, MG
    Risch, T
    GRID COMPUTING, 2004, 2970 : 86 - 92
  • [47] High-performance programming support for multimedia document database management
    Adam, P
    Essafi, H
    Gayrard, MP
    Pic, M
    HIGH-PERFORMANCE COMPUTING AND NETWORKING, PROCEEDINGS, 1999, 1593 : 1211 - 1214
  • [48] High-performance and balanced parallel graph coloring on multicore platforms
    Christina Giannoula
    Athanasios Peppas
    Georgios Goumas
    Nectarios Koziris
    The Journal of Supercomputing, 2023, 79 : 6373 - 6421
  • [49] Improving the efficiency of graph algorithm executions on high-performance computing
    Moori, Marcelo K.
    Rocha, Hiago Mayk G. de A.
    Schwarzrock, Janaina
    Lorenzon, Arthur F.
    Beck, Antonio Carlos S.
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2023, 35 (18):
  • [50] High-performance and balanced parallel graph coloring on multicore platforms
    Giannoula, Christina
    Peppas, Athanasios
    Goumas, Georgios
    Koziris, Nectarios
    JOURNAL OF SUPERCOMPUTING, 2023, 79 (06): : 6373 - 6421