CaseDB: Lightweight Key-Value Store for Edge Computing Environment

被引:5
作者
Tulkinbekov, Khikmatullo [1 ]
Kim, Deok-Hwan [1 ]
机构
[1] Inha Univ, Dept Elect Engn, Incheon 22211, South Korea
基金
新加坡国家研究基金会;
关键词
Compaction; Nonvolatile memory; Big Data; Metadata; Edge computing; Databases; Merging; Key-value store; LSM-tree; NoSQL; write and space amplification; edge computing; TREE;
D O I
10.1109/ACCESS.2020.3016680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Key-value stores based on a log-structured merge (LSM) tree have emerged in big data systems because of their scalability and reliability. An LSM-tree offers a multilevel data structure with a simple interface. However, it performs file rewrites at the disk level, which causes write amplification. This study is concerned with this problem in relation to an embedded board environment, which can be used in edge computing. Addressing the major problems associated with an LSM-tree, we propose a new key-value store named CaseDB, which aggressively separates keys and bloom filters on the non-volatile memory express (NVMe) drive and stores the values on the SSD. Our solution reduces the I/O cost and enhances the overall performance in a cost-efficient manner. CaseDB employs a memory component, CBuffer, to avoid small write operations, and a delayed value compaction technique that guarantees the sorted order for both keys and values. CaseDB also utilizes deduction-based data deduplication to prevent space amplification in the values layer. The experiments show that CaseDB outperforms LevelDB and WiscKey 5.7 and 1.8 times, respectively, with respect to data writes, and additionally improves the read performance by 1.5 times. CaseDB also avoids the space amplification of WiscKey.
引用
收藏
页码:149775 / 149786
页数:12
相关论文
共 50 条
  • [41] KVSTL: An Application Support to LSM-Tree Based Key-Value Store via Shingled Translation Layer Data Management
    Chen, Shuo-Han
    Liang, Yuhong
    Yang, Ming-Chang
    IEEE TRANSACTIONS ON COMPUTERS, 2022, 71 (07) : 1598 - 1611
  • [42] A Relational Database Schema on the Transactional Key-Value Store Scalaris
    Kruber, Nico
    Schintke, Florian
    Berlin, Michael
    2014 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2014,
  • [43] Reducing Tail Latency of LSM-tree based Key-value Store via Limited Compaction
    Hu, Yongchao
    Du, Yajuan
    36TH ANNUAL ACM SYMPOSIUM ON APPLIED COMPUTING, SAC 2021, 2021, : 178 - 181
  • [44] Portkey: Adaptive Key-Value Placement over Dynamic Edge Networks
    Noor, Joseph
    Srivastava, Mani
    Netravali, Ravi
    PROCEEDINGS OF THE 2021 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '21), 2021, : 197 - 213
  • [45] LSM-Tree Managed Storage for Large-Scale Key-Value Store
    Mei, Fei
    Cao, Qiang
    Jiang, Hong
    Tian, Lei
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (02) : 400 - 414
  • [46] Light Weight Key-Value Store for Efficient Services on Local Distributed Mobile Devices
    Li, Changlong
    Zhuang, Hang
    Xu, Bo
    Wang, Jiali
    Wang, Chao
    Zhou, Xuehai
    2017 IEEE 24TH INTERNATIONAL CONFERENCE ON WEB SERVICES (ICWS 2017), 2017, : 333 - 340
  • [47] Eukv: Enabling Efficient Updates for Hybrid PM-DRAM Key-Value Store
    Li, Zhengtao
    Chen, Jianxi
    IEEE ACCESS, 2023, 11 : 30459 - 30472
  • [48] CRAST: Crash-resilient data management for a key-value store in persistent memory
    Han, Youil
    Lee, Eunji
    IEICE ELECTRONICS EXPRESS, 2018, 15 (23):
  • [49] Time-constrained persistent deletion for key-value store engine on ZNS SSD
    Nie, Shiqiang
    Lei, Tong
    Niu, Jie
    Hu, Qihan
    Liu, Song
    Wu, Weiguo
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2025, 164
  • [50] PetaKV: Building Efficient Key-Value Store for File System Metadata on Persistent Memory
    Zhang, Yiwen
    Zhou, Jian
    Min, Xinhao
    Ge, Song
    Wan, Jiguang
    Yao, Ting
    Wang, Daohui
    IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2023, 34 (03) : 843 - 855