Towards Building a High-Performance, Scale-In Key-Value Storage System

被引:31
作者
Kang, Yangwook [1 ]
Pitchumani, Rekha [1 ]
Mishra, Pratik [1 ]
Kee, Yang-suk [1 ]
Londono, Francisco [1 ]
Oh, Sangyoon [1 ]
Lee, Jongyeol [1 ]
Lee, Daniel D. G. [1 ]
机构
[1] Samsung Semicond Inc, San Jose, CA USA
来源
SYSTOR '19: PROCEEDINGS OF THE 12TH ACM INTERNATIONAL SYSTEMS AND STORAGE CONFERENCE | 2019年
关键词
Key-value store; Scalability; Key-value SSD;
D O I
10.1145/3319647.3325831
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Key-value stores are widely used as storage backends, due to their simple, yet flexible interface for cache, storage, file system, and database systems. However, when used with high performance NVMe devices, their high compute requirements for data management often leave the device bandwidth under-utilized. This leads to a performance mismatch of what the device is capable of delivering and what it actually delivers, and the gains derived from high speed NVMe devices is nullified. In this paper, we introduce KV-SSD ( Key-Value SSD) as a key technology in a holistic approach to overcome such performance imbalance. KV-SSD provides better scalability and performance by simplifying the software storage stack and consolidating redundancy, thereby lowering the overall CPU usage and releasing the memory to user applications. We evaluate the performance and scalability of KV-SSDs over state-of-the-art software alternatives built for traditional block SSDs. Our results show that, unlike traditional key-value systems, the overall performance of KV-SSD scales linearly, and delivers 1.6 to 57x gains depending on the workload characteristics.
引用
收藏
页码:144 / 154
页数:11
相关论文
共 19 条
  • [1] [Anonymous], 2011, P 23 ACM S OP SYST P
  • [2] Baliyarsingh B, 2017, MICROORG SUSTAIN, V4, P1, DOI 10.1007/978-981-10-7380-9_1
  • [3] Cooper B.F., 2010, YCSB
  • [4] Cooper Brian F, 2010, P 1 ACM S CLOUD COMP, P143, DOI DOI 10.1145/1807128.1807152
  • [5] Coughlin Tom, 2016, IOPS CHANGING NEEDS
  • [6] FlashStore: High Throughput Persistent Key-Value Store
    Debnath, Biplob
    Sengupta, Sudipta
    Li, Jin
    [J]. PROCEEDINGS OF THE VLDB ENDOWMENT, 2010, 3 (02): : 1414 - 1425
  • [7] Gordeev Alexander, BLK MQ INTRO COMBINE
  • [8] Intel, Storage performance development kit
  • [9] KAML: A Flexible, High-Performance Key-Value SSD
    Jin, Yanqin
    Tseng, Hung-Wei
    Papakonstantinou, Yannis
    Swanson, Steven
    [J]. 2017 23RD IEEE INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE COMPUTER ARCHITECTURE (HPCA), 2017, : 373 - 384
  • [10] Kannan S, 2018, PROCEEDINGS OF THE 2018 USENIX ANNUAL TECHNICAL CONFERENCE, P993