Parallel Algorithms for Constructing Range and Nearest-Neighbor Searching Data Structures

被引:14
|
作者
Agarwal, Pankaj K. [1 ]
Fox, Kyle [1 ]
Munagala, Kamesh [1 ]
Nath, Abhinandan [1 ]
机构
[1] Duke Univ, Durham, NC 27706 USA
基金
美国国家科学基金会;
关键词
MODEL; COMPLEXITY; MAPREDUCE;
D O I
10.1145/2902251.2902303
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the massive amounts of data available today, it is common to store and process data using multiple machines. Parallel programming platforms such as MapReduce and its variants are popular frameworks for handling such large data. We present the first provably efficient algorithms to compute, store, and query data structures for range queries and approximate nearest neighbor queries in a popular parallel computing abstraction that captures the salient features of MapReduce and other massively parallel communication (MPC) models. In particular, we describe algorithms for kd-trees, range trees, and BBD-trees that only require O(1) rounds of communication for both preprocessing and querying while staying competitive in terms of running time and workload to their classical counterparts. Our algorithms are randomized, but they can be made deterministic at some increase in their running time and workload while keeping the number of rounds of communication to be constant.
引用
收藏
页码:429 / 440
页数:12
相关论文
共 50 条
  • [21] Disk Allocation for Fast Range and Nearest-Neighbor Queries
    Sunil Prabhakar
    Divyakant Agrawal
    Amr El Abbadi
    Distributed and Parallel Databases, 2003, 14 : 107 - 135
  • [22] Efficient Nearest-Neighbor Data Sharing in GPUs
    Nematollahi, Negin
    Sadrosadati, Mohammad
    Falahati, Hajar
    Barkhordar, Marzieh
    Drumond, Mario Paulo
    Sarbazi-Azad, Hamid
    Falsafi, Babak
    ACM TRANSACTIONS ON ARCHITECTURE AND CODE OPTIMIZATION, 2021, 18 (01)
  • [23] Data Acquisition for Probabilistic Nearest-Neighbor Query
    Lin, Yu-Chieh
    Yang, De-Nian
    Shuai, Hong-Han
    Chen, Ming-Syan
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2015, 27 (02) : 410 - 427
  • [24] Designing lattice structures with maximal nearest-neighbor entanglement
    Navarro-Munoz, J. C.
    Lopez-Sandoval, R.
    Garcia, M. E.
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2009, 42 (31)
  • [25] EFFICIENT ALGORITHMS FOR COMPUTING 2 NEAREST-NEIGHBOR PROBLEMS ON A RAP
    KAO, TW
    HORNG, SJ
    PATTERN RECOGNITION, 1994, 27 (12) : 1707 - 1716
  • [26] SOME HEURISTICS FOR NEAREST-NEIGHBOR SEARCHING IN CHEMICAL-STRUCTURE FILES
    WILLETT, P
    JOURNAL OF CHEMICAL INFORMATION AND COMPUTER SCIENCES, 1983, 23 (01): : 22 - 25
  • [27] Complexity analysis for partitioning nearest neighbor searching algorithms
    Zakarauskas, P
    Ozard, JM
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1996, 18 (06) : 663 - 668
  • [28] QUANTUM ALGORITHMS FOR NEAREST-NEIGHBOR METHODS FOR SUPERVISED AND UNSUPERVISED LEARNING
    Wiebe, Nathan
    Kapoor, Ashish
    Svore, Krysta M.
    QUANTUM INFORMATION & COMPUTATION, 2015, 15 (3-4) : 316 - 356
  • [29] Quantum algorithms for nearest-neighbor methods for supervised and unsupervised learning
    Quantum Architectures and Computation Group, Microsoft Research, One Microsoft Way Redmond, Washington
    98052, United States
    Quantum Inf. Comput., 3-4 (318-358):
  • [30] Fast nearest-neighbor codeword search algorithms for vector quantization
    Sun, Sheng-He
    Lu, Zhe-Ming
    Liu, Chun-He
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2001, 29 (SUPPL.): : 1772 - 1777