Improvement of Rock PR Performance via Large-Scale Parameter Analysis and Optimization

被引:2
作者
Jin, Huijun [1 ]
Choi, Won Gi [2 ]
Choi, Jonghwan [1 ]
Sung, Hanseung [3 ]
Park, Sanghyun [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul, South Korea
[2] Korea Elect Technol Inst KETI, Seoul, South Korea
[3] Tmax Tibero R&D Ctr, Seoul, South Korea
来源
JOURNAL OF INFORMATION PROCESSING SYSTEMS | 2022年 / 18卷 / 03期
关键词
Database; Genetic Algorithm; Log-Structured Merge-Tree; Optimization; Random Forest; Space Amplification; Write Amplification;
D O I
10.3745/JIPS.04.0244
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Database systems usually have many parameters that must be configured by database administrators and users. RocksDB achieves fast data writing performance using a log-structured merged tree. This database has many parameters associated with write and space amplifications. Write amplification degrades the database performance, and space amplification leads to an increased storage space owing to the storage of unwanted data. Previously, it was proven that significant performance improvements can be achieved by tuning the database parameters. However, tuning the multiple parameters of a database is a laborious task owing to the large number of potential configuration combinations. To address this problem, we selected the important parameters that affect the performance of RocksDB using random forest. We then analyzed the effects of the selected parameters on write and space amplifications using analysis of variance. We used a genetic algorithm to obtain optimized values of the major parameters. The experimental results indicate an insignificant reduction (-5.64%) in the execution time when using these optimized values; however, write amplification, space amplification, and data processing rates improved considerably by 20.65%, 54.50%, and 89.68%, respectively, as compared to the performance when using the default settings.
引用
收藏
页码:374 / 388
页数:15
相关论文
共 21 条
[11]  
Mardle S. J., 2000, International Transactions in Operational Research, V7, P33, DOI 10.1111/j.1475-3995.2000.tb00183.x
[12]   LSM-Tree Managed Storage for Large-Scale Key-Value Store [J].
Mei, Fei ;
Cao, Qiang ;
Jiang, Hong ;
Tian, Lei .
IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, 2019, 30 (02) :400-414
[13]  
Odeh S, 2014, IEEE S MASS STOR SYS
[14]   The log-structured merge-tree (LSM-tree) [J].
ONeil, P ;
Cheng, E ;
Gawlick, D ;
ONeil, E .
ACTA INFORMATICA, 1996, 33 (04) :351-385
[15]  
Ouaknine K., 2017, ICCDA 17, P155, DOI 10.1145/3093241.3093278
[16]  
Pedregosa F, 2011, J MACH LEARN RES, V12, P2825
[17]  
RocksDB, 2021, A persistent key-value store for fast storage environments
[18]   Automatic Database Management System Tuning Through Large-scale Machine Learning [J].
Van Aken, Dana ;
Pavlo, Andrew ;
Gordon, Geoffrey J. ;
Zhang, Bohan .
SIGMOD'17: PROCEEDINGS OF THE 2017 ACM INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2017, :1009-1024
[19]  
WHITLEY D, 1994, STAT COMPUT, V4, P65, DOI 10.1007/BF00175354
[20]   An End-to-End Automatic Cloud Database Tuning System Using Deep Reinforcement Learning [J].
Zhang, Ji ;
Liu, Yu ;
Zhou, Ke ;
Li, Guoliang ;
Xiao, Zhili ;
Cheng, Bin ;
Xing, Jiashu ;
Wang, Yangtao ;
Cheng, Tianheng ;
Liu, Li ;
Ran, Minwei ;
Li, Zekang .
SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2019, :415-432