Improvement of Rock PR Performance via Large-Scale Parameter Analysis and Optimization

被引:2
|
作者
Jin, Huijun [1 ]
Choi, Won Gi [2 ]
Choi, Jonghwan [1 ]
Sung, Hanseung [3 ]
Park, Sanghyun [1 ]
机构
[1] Yonsei Univ, Dept Comp Sci, Seoul, South Korea
[2] Korea Elect Technol Inst KETI, Seoul, South Korea
[3] Tmax Tibero R&D Ctr, Seoul, South Korea
来源
JOURNAL OF INFORMATION PROCESSING SYSTEMS | 2022年 / 18卷 / 03期
关键词
Database; Genetic Algorithm; Log-Structured Merge-Tree; Optimization; Random Forest; Space Amplification; Write Amplification;
D O I
10.3745/JIPS.04.0244
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Database systems usually have many parameters that must be configured by database administrators and users. RocksDB achieves fast data writing performance using a log-structured merged tree. This database has many parameters associated with write and space amplifications. Write amplification degrades the database performance, and space amplification leads to an increased storage space owing to the storage of unwanted data. Previously, it was proven that significant performance improvements can be achieved by tuning the database parameters. However, tuning the multiple parameters of a database is a laborious task owing to the large number of potential configuration combinations. To address this problem, we selected the important parameters that affect the performance of RocksDB using random forest. We then analyzed the effects of the selected parameters on write and space amplifications using analysis of variance. We used a genetic algorithm to obtain optimized values of the major parameters. The experimental results indicate an insignificant reduction (-5.64%) in the execution time when using these optimized values; however, write amplification, space amplification, and data processing rates improved considerably by 20.65%, 54.50%, and 89.68%, respectively, as compared to the performance when using the default settings.
引用
收藏
页码:374 / 388
页数:15
相关论文
共 50 条
  • [21] Solving large-scale optimization problems with EFCOSS
    Bischof, CH
    Bücker, HM
    Lang, B
    Rasch, A
    ADVANCES IN ENGINEERING SOFTWARE, 2003, 34 (10) : 633 - 639
  • [22] Large-Scale Traffic Signal Offset Optimization
    Ouyang, Yi
    Zhang, Richard Y.
    Lavaei, Javad
    Varaiya, Pravin
    IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2020, 7 (03): : 1176 - 1187
  • [23] Adaptive pattern search for large-scale optimization
    Vincent Gardeux
    Mahamed G. H. Omran
    Rachid Chelouah
    Patrick Siarry
    Fred Glover
    Applied Intelligence, 2017, 47 : 319 - 330
  • [24] Adaptive pattern search for large-scale optimization
    Gardeux, Vincent
    Omran, Mahamed G. H.
    Chelouah, Rachid
    Siarry, Patrick
    Glover, Fred
    APPLIED INTELLIGENCE, 2017, 47 (02) : 319 - 330
  • [25] Parallel Hybrid Metaheuristics with Distributed Intensification and Diversification for Large-scale Optimization in Big Data Statistical Analysis
    Cho, Wendy K. Tam
    Liu, Yan Y.
    2019 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2019, : 3312 - 3320
  • [26] Simulation analysis and optimization of steam reforming process for a large-scale ammonia plant
    Zhang, SW
    Yu, YG
    CHINESE JOURNAL OF CHEMICAL ENGINEERING, 1995, 3 (04) : 223 - 232
  • [27] Multilevel optimization control for large-scale systems using genetic algorithms
    EL mdbouly, EE
    Ibrahim, AAS
    El-Far, GZ
    El Nassef, M
    ICEEC'04: 2004 INTERNATIONAL CONFERENCE ON ELECTRICAL, ELECTRONIC AND COMPUTER ENGINEERING, PROCEEDINGS, 2004, : 193 - 197
  • [28] Enabling large-scale multidisciplinary design optimization through adjoint sensitivity analysis
    Martins, Joaquim R. R. A.
    Kennedy, Graeme J.
    STRUCTURAL AND MULTIDISCIPLINARY OPTIMIZATION, 2021, 64 (05) : 2959 - 2974
  • [29] SIMULATION ANALYSIS AND OPTIMIZATION OF STEAM REFORMING PROCESS FOR A LARGE-SCALE AMMONIA PLANT
    张述伟
    俞裕国
    Chinese Journal of Chemical Engineering, 1995, (04) : 40 - 49
  • [30] Large-scale analysis of the dynamics of enzymes
    Tobi, Dror
    PROTEINS-STRUCTURE FUNCTION AND BIOINFORMATICS, 2013, 81 (11) : 1910 - 1918