An update-intensive LSM-based R-tree index

被引:0
|
作者
Shin, Jaewoo [1 ]
Zhou, Libin [1 ]
Wang, Jianguo [1 ]
Aref, Walid G. [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
来源
VLDB JOURNAL | 2025年 / 34卷 / 01期
基金
美国国家科学基金会;
关键词
LSM-based index; Secondary index; Query processing; R-tree; Big data; Spatial databases; LOG-STRUCTURED MERGE; COMPACTION; BENCHMARK;
D O I
10.1007/s00778-024-00876-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications require update-intensive workloads on spatial objects, e.g., social-network services and shared-riding services that track moving objects. By buffering insert and delete operations in memory, the Log Structured Merge Tree (LSM) has been used widely in various systems because of its ability to handle write-heavy workloads. While the focus on LSM has been on key-value stores and their optimizations, there is a need to study how to efficiently support LSM-based secondary indexes (e.g., location-based indexes) as modern, heterogeneous data necessitates the use of secondary indexes. In this paper, we investigate the augmentation of a main-memory-based memo structure into an LSM secondary index structure to handle update-intensive workloads efficiently. We conduct this study in the context of an R-tree-based secondary index. In particular, we introduce the LSM RUM-tree that demonstrates the use of an Update Memo in an LSM-based R-tree to enhance the performance of the R-tree's insert, delete, update, and search operations. The LSM RUM-tree introduces new strategies to control the size of the Update Memo to make sure it always fits in memory for high performance. The Update Memo is a light-weight in-memory structure that is suitable for handling update-intensive workloads without introducing significant overhead. Experimental results using real spatial data demonstrate that the LSM RUM-tree achieves up to 6.6x speedup on update operations and up to 249292x speedup on query processing over existing LSM R-tree implementations.
引用
收藏
页数:24
相关论文
共 50 条
  • [41] Efficient trajectory outlier detection algorithm based on R-Tree
    Liu, Liang-Xu
    Qiao, Shao-Jie
    Liu, Bin
    Le, Jia-Jin
    Tang, Chang-Jie
    Ruan Jian Xue Bao/Journal of Software, 2009, 20 (09): : 2426 - 2435
  • [42] Moving query method based on double R-tree and double indexing
    School of Computer Science and Engineering, Beijing Institute of Technology, Beijing 100081, China
    不详
    Beijing Ligong Daxue Xuebao, 2008, 11 (993-997):
  • [43] A brand-new node-choosing algorithm in R-tree spatial index
    Gong, Jun
    Ke, Shengnan
    Bao, Shuming
    GEOINFORMATICS 2007: GEOSPATIAL INFORMATION SCIENCE, PTS 1 AND 2, 2007, 6753
  • [44] A Novel KNN Join Algorithms based on Hilbert R-tree in MapReduce
    Du, Qinsheng
    Li, Xiongfei
    2013 3RD INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND NETWORK TECHNOLOGY (ICCSNT), 2013, : 417 - 420
  • [45] Differential privacy trajectory data protection scheme based on R-tree
    Yuan, Shuilian
    Pi, Dechang
    Zhao, Xiaodong
    Xu, Meng
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 182
  • [46] SQR-tree: A spatial index using semi-quantized MBR compression scheme in R-tree
    Kim, Jongwan
    Im, SeokJin
    Kang, Sang-Won
    Hwang, Chong-Sun
    Lee, SangKeun
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2007, 23 (05) : 1541 - 1563
  • [47] InPlaceKV: in-place update scheme for SSD-based KV storage systems under update-intensive Worklaods
    Jianing Zhao
    Yubiao Pan
    Huizhen Zhang
    Mingwei Lin
    Xin Luo
    Zeshui Xu
    Cluster Computing, 2024, 27 : 1527 - 1540
  • [48] Differential privacy trajectory data protection scheme based on R-tree
    Yuan, Shuilian
    Pi, Dechang
    Zhao, Xiaodong
    Xu, Meng
    Pi, Dechang (pinuaa@nuaa.edu.cn), 1600, Elsevier Ltd (182):
  • [49] Three-dimension visualization query method based on R-tree
    Gong, Jun
    Xie, Xiao
    Wuhan Daxue Xuebao (Xinxi Kexue Ban)/Geomatics and Information Science of Wuhan University, 2011, 36 (10): : 1140 - 1143
  • [50] InPlaceKV: in-place update scheme for SSD-based KV storage systems under update-intensive Worklaods
    Zhao, Jianing
    Pan, Yubiao
    Zhang, Huizhen
    Lin, Mingwei
    Luo, Xin
    Xu, Zeshui
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2024, 27 (02): : 1527 - 1540