A GPU-accelerated highly compact and encoding based database system

被引:0
|
作者
Luo, Xinyuan [1 ]
Chen, Gang [1 ]
Wu, Sai [1 ]
机构
[1] College of Computer Science, Zhejiang University, Hangzhou
来源
Jisuanji Yanjiu yu Fazhan/Computer Research and Development | 2015年 / 52卷 / 02期
关键词
CUDA; Database system; Encoding; GPU; Hybrid row-column storage; Rule mining;
D O I
10.7544/issn1000-1239.2015.20140254
中图分类号
学科分类号
摘要
In the big data era, business applications generate huge volumes of data, making it extremely challenging to store and manage those data. One possible solution adopted in previous database systems is to employ some types of encoding techniques, which can effectively reduce the size of data and consequential improve the query performance. However, existing encoding approaches still cannot make a good tradeoff between the compression ratio, importing time and query performance. In this paper, to address the problem, we propose a new encoding-based database system, HEGA-STORE, which adopts the hybrid row-oriented and column-oriented storage model. In HEGA-STORE, we design a GPU-assistant encoding scheme by combining the rule-based encoding and conventional compression algorithms. By exploiting the computation power of GPU, we efficiently improve the performance of encoding and decoding algorithms. To evaluate the performance of HEGA-STORE, it is deployed in Netease to support log analysis. We compare HEGA-STORE with other database systems and the results show that HEGA-STORE can provide better performance for data import and query processing. It is a much compact encoding database for big data applications. ©, 2015, Science Press. All right reserved.
引用
收藏
页码:362 / 376
页数:14
相关论文
共 33 条
  • [31] Ding S., He J., Yan H., Et al., Using graphics processors for high performance IR query processing, Proc of the 18th Int Conf on World Wide Web, pp. 421-430, (2009)
  • [32] Fang W., He B., Luo Q., Database compression on graphics processors, Proceedings of the VLDB Endowment, 3, 1-2, pp. 670-680, (2010)
  • [33] Erdodi L., File compression with LZO algorithm using NVIDIA CUDA architecture, Proc of the IEEE Int Symp on Logistics and Industrial Informatics (LINDI), pp. 251-254, (2012)