An update-intensive LSM-based R-tree index

被引:0
|
作者
Shin, Jaewoo [1 ]
Zhou, Libin [1 ]
Wang, Jianguo [1 ]
Aref, Walid G. [1 ]
机构
[1] Purdue Univ, W Lafayette, IN 47907 USA
来源
VLDB JOURNAL | 2025年 / 34卷 / 01期
基金
美国国家科学基金会;
关键词
LSM-based index; Secondary index; Query processing; R-tree; Big data; Spatial databases; LOG-STRUCTURED MERGE; COMPACTION; BENCHMARK;
D O I
10.1007/s00778-024-00876-7
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Many applications require update-intensive workloads on spatial objects, e.g., social-network services and shared-riding services that track moving objects. By buffering insert and delete operations in memory, the Log Structured Merge Tree (LSM) has been used widely in various systems because of its ability to handle write-heavy workloads. While the focus on LSM has been on key-value stores and their optimizations, there is a need to study how to efficiently support LSM-based secondary indexes (e.g., location-based indexes) as modern, heterogeneous data necessitates the use of secondary indexes. In this paper, we investigate the augmentation of a main-memory-based memo structure into an LSM secondary index structure to handle update-intensive workloads efficiently. We conduct this study in the context of an R-tree-based secondary index. In particular, we introduce the LSM RUM-tree that demonstrates the use of an Update Memo in an LSM-based R-tree to enhance the performance of the R-tree's insert, delete, update, and search operations. The LSM RUM-tree introduces new strategies to control the size of the Update Memo to make sure it always fits in memory for high performance. The Update Memo is a light-weight in-memory structure that is suitable for handling update-intensive workloads without introducing significant overhead. Experimental results using real spatial data demonstrate that the LSM RUM-tree achieves up to 6.6x speedup on update operations and up to 249292x speedup on query processing over existing LSM R-tree implementations.
引用
收藏
页数:24
相关论文
共 50 条
  • [1] The LSM RUM-Tree: A Log Structured Merge R-Tree for Update-intensive Spatial Workloads
    Shin, Jaewoo
    Wang, Jianguo
    Aref, Walid G.
    2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021), 2021, : 2285 - 2290
  • [2] 2-Level R-tree Index Based on Spatial Grids and Hilbert R-tree
    GUO Jing LIU Guangjun DONG Xurong GUO Lei
    Geo-Spatial Information Science, 2006, (02) : 135 - 141
  • [3] 2-Level R-tree Index Based on Spatial Grids and Hilbert R-tree
    Guo Jing
    Liu Guangjun
    Dong Xurong
    Guo Lei
    GEO-SPATIAL INFORMATION SCIENCE, 2006, 9 (02) : 135 - 141
  • [4] 2-level R-tree index based on spatial grids and Hilbert R-tree
    Beijing Institute of Command and Technology of Equipment, 1 Jingjia Road, Huairou District, Beijing 101416, China
    Geo-Spatial Inf. Sci., 2006, 2 (135-141):
  • [5] Dynamic R-tree index based on hybrid clustering algorithm
    School of Geoscience and Environmental Engineering, Central South University, Changsha 410083, China
    不详
    不详
    Zhongnan Daxue Xuebao (Ziran Kexue Ban), 2006, 2 (366-370):
  • [6] Bulk Loading of the Secondary Index in LSM-Based Stores for Flash Memory
    Macyna, Wojciech
    Kukowski, Michal
    NEW TRENDS IN DATABASE AND INFORMATION SYSTEMS, ADBIS 2022, 2022, 1652 : 133 - 143
  • [7] Managing Frequent Updates in R-Trees for Update-Intensive Applications
    Song, MoonBae
    Kitagawa, Hiroyuki
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2009, 21 (11) : 1573 - 1589
  • [8] Rips induction: index of the dual lamination of an R-tree
    Coulbois, Thierry
    Hilion, Arnaud
    GROUPS GEOMETRY AND DYNAMICS, 2014, 8 (01) : 97 - 134
  • [9] A new approach to creating spatial index with R-TREE
    Zhang, Ze-Bao
    Zhang, Jian-Pei
    Yang, Jing
    Yang, Yue
    PROCEEDINGS OF 2007 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-7, 2007, : 2645 - 2648
  • [10] Multi-approximate index based on R-tree for massive spatial data
    Lin, W. H.
    Wu, Y. G.
    Tan, X. J.
    Mao, D. H.
    Yu, Y.
    2008 PROCEEDINGS OF INFORMATION TECHNOLOGY AND ENVIRONMENTAL SYSTEM SCIENCES: ITESS 2008, VOL 1, 2008, : 574 - 579