SwapKV: A Hotness Aware In-Memory Key-Value Store for Hybrid Memory Systems

被引:3
作者
Cui, Lixiao [1 ]
He, Kewen [1 ]
Li, Yusen [1 ]
Li, Peng [2 ]
Zhang, Jiachen [1 ]
Wang, Gang [1 ]
Liu, Xiaoguang [1 ]
机构
[1] Nankai Univ, Coll Comp Sci, Nankai Baidu Joint Lab, TJ Key Lab NDST, Tianjin 300350, Peoples R China
[2] ByteDance Inc, Beijing 100089, Peoples R China
基金
美国国家科学基金会;
关键词
Key-value system; persistent memory; hybrid memory system;
D O I
10.1109/TKDE.2021.3077264
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In-memory Key-Value (KV) stores are widely deployed in modern data centers. These systems generally use DRAM as their storage medium, causing huge hardware costs. The emerging persistent memory (PMEM) is a potential substitute for DRAM, which has a lower price and larger capacity, but lower access speed and bandwidth. Many prior studies strive to build hybrid memory systems to retain both the advantages of DRAM and PMEM. However, they are either application agnostic or simply take DRAM as a cache, which are both not efficient for in-memory KV stores. In this paper, we propose SwapKV, a well-designed in-memory KV store for hybrid DRAM-PMEM system. SwapKV has several promising properties. First, SwapKV combines DRAM and PMEM to a uniform memory pool and only stores one copy of data, which maximizes capacity utilization. Second, SwapKV maps all writing operations to DRAM and migrates data to PMEM with large blocks asynchronously, which mitigates the intrinsic inefficiency of PMEM for writing operations. Third, SwapKV maintains the hot data in DRAM through an efficient hotness filtering and data swapping mechanism, which ensures high system throughput and responsiveness. We implement SwapKV and evaluate it under various workload patterns. The results demonstrate that SwapKV improves the throughput by 11 similar to 41 percent compared to the state-of-the-art alternatives.
引用
收藏
页码:917 / 930
页数:14
相关论文
共 31 条
[31]   An efficient wear-leveling-aware multi-grained allocator for persistent memory file systems一种磨损感知的持久化内存文件系统高效多粒度分配器 [J].
Zhiwang Yu ;
Runyu Zhang ;
Chaoshu Yang ;
Shun Nie ;
Duo Liu .
Frontiers of Information Technology & Electronic Engineering, 2023, 24 :688-702