PUFFINN: Parameterless and Universally Fast FInding of Nearest Neighbors

被引:10
作者
Aumuller, Martin [1 ]
Christiani, Tobias [1 ]
Pagh, Rasmus [1 ,2 ]
Vesterli, Michael [1 ]
机构
[1] IT Univ Copenhagen, Copenhagen, Denmark
[2] BARC, Copenhagen, Denmark
来源
27TH ANNUAL EUROPEAN SYMPOSIUM ON ALGORITHMS (ESA 2019) | 2019年 / 144卷
基金
欧洲研究理事会;
关键词
Nearest Neighbor Search; Locality-Sensitive Hashing; Adaptive Similarity Search; SEARCH;
D O I
10.4230/LIPIcs.ESA.2019.10
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
We present PUFFINN, a parameterless LSH-based index for solving the k-nearest neighbor problem with probabilistic guarantees. By parameterless we mean that the user is only required to specify the amount of memory the index is supposed to use and the result quality that should be achieved. The index combines several heuristic ideas known in the literature. By small adaptions to the query algorithm, we make heuristics rigorous. We perform experiments on real-world and synthetic inputs to evaluate implementation choices and show that the implementation satisfies the quality guarantees while being competitive with other state-of-the-art approaches to nearest neighbor search. We describe a novel synthetic data set that is difficult to solve for almost all existing nearest neighbor search approaches, and for which PUFFINN significantly outperform previous methods.
引用
收藏
页数:16
相关论文
共 31 条
[1]   Efficient Algorithms for Substring Near Neighbor Problem [J].
Andoni, Alexandr ;
Indyk, Piotr .
PROCEEDINGS OF THE SEVENTHEENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, 2006, :1203-1212
[2]  
Andoni A, 2015, ADV NEUR IN, V28
[3]  
Andoni Alexandr, 2005, E2LSH USER MANUAL
[4]  
[Anonymous], 2016, ARXIV160309320
[5]  
[Anonymous], 2017, CORR
[6]  
[Anonymous], 2017, CORR
[7]   ANN-Benchmarks: A Benchmarking Tool for Approximate Nearest Neighbor Algorithms [J].
Aumueller, Martin ;
Bernhardsson, Erik ;
Faithfull, Alexander .
SIMILARITY SEARCH AND APPLICATIONS, SISAP 2017, 2017, 10609 :34-49
[8]  
Bawa M., 2005, WWW 05, P651, DOI DOI 10.1145/1060745.1060840
[9]   MULTIDIMENSIONAL BINARY SEARCH TREES USED FOR ASSOCIATIVE SEARCHING [J].
BENTLEY, JL .
COMMUNICATIONS OF THE ACM, 1975, 18 (09) :509-517
[10]  
Boytsov L, 2013, LECT NOTES COMPUT SC, V8199, P280, DOI 10.1007/978-3-642-41062-8_28