MTDB: an LSM-tree-based key-value store using a multi-tree structure to improve read performance

被引:0
作者
Lin, Xinwei [1 ,2 ]
Pan, Yubiao [1 ,2 ]
Feng, Wenjuan [1 ]
Zhang, Huizhen [1 ]
Lin, Mingwei [3 ]
机构
[1] Huaqiao Univ, Sch Comp Sci & Technol, Xiamen 361021, Fujian, Peoples R China
[2] Xiamen Key Lab Data Secur & Blockchain Technol, Data Secur Dept, Xiamen 361021, Fujian, Peoples R China
[3] Fujian Normal Univ, Coll Math & Informat, Fuzhou 350000, Fujian, Peoples R China
关键词
Key-value store; Storage system; LSM-tree; Read amplification; Write amplification;
D O I
10.1007/s11227-024-06382-5
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional LSM-tree-based key-value storage systems face significant read amplification issues due to the multi-level structure of LSM-tree, the unordered SSTable files in Level 0, and the lack of an in-memory index structure for key-value pairs. We observed that, under the influence of workloads with locality features, key-value pairs exhibit a range-specific access intensity. Addressing the three reasons for LSM-tree read amplification, we have utilized the range-specific access intensity of workload to propose a multi-tree structure consisting of a B+ tree, a single-level hot tree, and an LSM-tree with partition-based Level 0. This aims to enhance the read performance of LSM-tree-based key-value storage systems. We designed the prototype, MTDB, based on LevelDB. The experimental results show that MTDB's read performance is 1.62x to 2.02x that of LevelDB, and it approaches or exceeds the read performance of KVell and Bourbon while reducing memory overhead by 58.85%-86%.
引用
收藏
页码:23995 / 24025
页数:31
相关论文
共 43 条
  • [1] ForestDB: A Fast Key-Value Storage System for Variable-Length String Keys
    Ahn, Jung-Sang
    Seo, Chiyoung
    Mayuram, Ravi
    Yaseen, Rahim
    Kim, Jin-Soo
    Maeng, Seungryoul
    [J]. IEEE TRANSACTIONS ON COMPUTERS, 2016, 65 (03) : 902 - 915
  • [2] [Anonymous], 2013, Bloom Filter
  • [3] Appsflyer, 2021, US
  • [4] Atikoglu Berk, 2012, Performance Evaluation Review, V40, P53, DOI 10.1145/2318857.2254766
  • [5] Balmau O, 2017, 2017 USENIX ANNUAL TECHNICAL CONFERENCE (USENIX ATC '17), P363
  • [6] Cai, 2023, IEEE T COMPUTER AIDE
  • [7] Cao ZC, 2020, PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, P209
  • [8] Cassandra, 2020, US
  • [9] Bigtable: A distributed storage system for structured data
    Chang, Fay
    Dean, Jeffrey
    Ghemawat, Sanjay
    Hsieh, Wilson C.
    Wallach, Deborah A.
    Burrows, Mike
    Chandra, Tushar
    Fikes, Andrew
    Gruber, Robert E.
    [J]. ACM TRANSACTIONS ON COMPUTER SYSTEMS, 2008, 26 (02):
  • [10] Chen JQ, 2020, PROCEEDINGS OF THE 18TH USENIX CONFERENCE ON FILE AND STORAGE TECHNOLOGIES, P239