Dalio: In-Kernel Centralized Replication for Key-Value Stores

被引:0
|
作者
Kim, Gyuyeong [1 ]
机构
[1] Sungshin Womens Univ, Dept Comp Engn, Seoul, South Korea
关键词
networking stacks; replication protocol; in-kernel acceleration;
D O I
10.1587/transinf.2024EDL8060
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Replication is commonly used in distributed key-value stores for high availability. Recent works show that centralized replication provides high throughput through low-overhead write coordination and consistency-aware read forwarding. Unfortunately, they rely on specialized hardware, which is deploy-challenging and poses various limitations. To this end, we present Dalio, a software-based centralized replication system that does not require extra hardware while supporting high throughput. Our key idea is to offload the replication function to per-shard load balancers with eBPF, an emerging kernel-native technique. By building a replication coordinator with eBPF, we can avoid burdensome kernel networking stack overhead. Our experimental results show that Dalio achieves throughput better than the vanilla Linux by up to 2.05x and is comparable to a hardware-based solution.
引用
收藏
页码:157 / 160
页数:4
相关论文
共 50 条
  • [1] InK: In-Kernel Key-Value Storage with Persistent Memory
    Ha, Minjong
    Kim, Sang-Hoon
    ELECTRONICS, 2020, 9 (11) : 1 - 22
  • [2] Toward an in-kernel high performance key-value store implementation
    Blin, Antoine
    Lazri, Kahina
    Sopena, Julien
    Muller, Gilles
    2019 IEEE 38TH INTERNATIONAL SYMPOSIUM ON RELIABLE DISTRIBUTED SYSTEMS (SRDS 2019), 2019, : 268 - 268
  • [3] Totally Ordered Replication for Massive Scale Key-Value Stores
    Ribeiro, Jose
    Machado, Nuno
    Maia, Francisco
    Matos, Miguel
    DISTRIBUTED APPLICATIONS AND INTEROPERABLE SYSTEMS (DAIS 2018), 2018, 10853 : 58 - 74
  • [4] Encrypted Key-Value Stores
    Agarwal, Archita
    Kamara, Seny
    PROGRESS IN CRYPTOLOGY - INDOCRYPT 2020, 2020, 12578 : 62 - 85
  • [5] Tebis: Index Shipping for Efficient Replication in LSM Key-Value Stores
    Vardoulakis, Michalis
    Saloustros, Giorgos
    Gonzalez-Ferez, Pilar
    Bilas, Angelos
    PROCEEDINGS OF THE SEVENTEENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS (EUROSYS '22), 2022, : 85 - 98
  • [6] Consistency Analysis of Replication-Based Probabilistic Key-Value Stores
    Ali, Ramy E.
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
  • [7] Fast Scans on Key-Value Stores
    Pilman, Markus
    Bocksrocker, Kevin
    Braun, Lucas
    Marroquin, Renato
    Kossmann, Donald
    PROCEEDINGS OF THE VLDB ENDOWMENT, 2017, 10 (11): : 1526 - 1537
  • [8] Scalable Versioning for Key-Value Stores
    Haeusler, Martin
    DATA: PROCEEDINGS OF THE 5TH INTERNATIONAL CONFERENCE ON DATA MANAGEMENT TECHNOLOGIES AND APPLICATIONS, 2016, : 79 - 86
  • [9] Parallax: Hybrid Key-Value Placement in LSM-based Key-Value Stores
    Xanthakis, Giorgos
    Saloustros, Giorgos
    Batsaras, Nikos
    Papagiannis, Anastasios
    Bilas, Angelos
    PROCEEDINGS OF THE 2021 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '21), 2021, : 305 - 318
  • [10] Towards Elastic Key-value Stores on IaaS
    Li, Han
    2013 IEEE 29TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING WORKSHOPS (ICDEW), 2013, : 302 - 305