Efficient top-k aggregation of ranked inputs

被引:71
作者
Mamoulis, Nikos
Yiu, Man Lung
Cheng, Kit Hung
Cheung, David W.
机构
[1] Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[2] Aalborg Univ, Dept Comp Sci, DK-9220 Aalborg, Denmark
来源
ACM TRANSACTIONS ON DATABASE SYSTEMS | 2007年 / 32卷 / 03期
关键词
algorithms; experimentation; performance; top-k queries; rank aggregation;
D O I
10.1145/1272743.1272749
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
A top-k query combines different rankings of the same set of objects and returns the k objects with the highest combined score according to an aggregate function. We bring to light some key observations, which impose two phases that any top-k algorithm, based on sorted accesses, should go through. Based on them, we propose a new algorithm, which is designed to minimize the number of object accesses, the computational cost, and the memory requirements of top-k search with monotone aggregate functions. We provide an analysis for its cost and show that it is always no worse than the baseline "no random accesses" algorithm in terms of computations, accesses, and memory required. As a side contribution, we perform a space analysis, which indicates the memory requirements of top-k algorithms that only perform sorted accesses. For the case, where the required space exceeds the available memory, we propose disk-based variants of our algorithm. We propose and optimize a multiway top-k join operator, with certain advantages over evaluation trees of binary top-k join operators. Finally, we define and study the computation of top-k cubes and the implementation of roll-up and drill-down operations in such cubes. Extensive experiments with synthetic and real data show that, compared to previous techniques, our method accesses fewer objects, while being orders of magnitude faster.
引用
收藏
页数:47
相关论文
共 31 条
[1]  
AGRAWAL R, 2000, P ACM SIGMOD INT C M, P297, DOI DOI 10.1145/342009.335423
[2]  
[Anonymous], P 7 INT C DAT THEOR
[3]  
Balke W., 2004, P 30 INT C VERY LARG, P936, DOI DOI 10.1016/B978-012088469-8.50082-6
[4]   The Skyline operator [J].
Börzsönyi, S ;
Kossmann, D ;
Stocker, K .
17TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, PROCEEDINGS, 2001, :421-430
[5]   Top-k selection queries over relational databases:: Mapping strategies and performance evaluation [J].
Bruno, N ;
Chaudhuri, S ;
Gravano, L .
ACM TRANSACTIONS ON DATABASE SYSTEMS, 2002, 27 (02) :153-187
[6]  
Carey M. J., 1997, SIGMOD Record, V26, P219, DOI 10.1145/253262.253302
[7]  
Chang K. C.-C., 2002, PROC ACM SIGMOD INT, P346
[8]  
CHANG YC, 2000, P ACM SIGMOD INT C M, P391
[9]  
DEVRIES AP, 2002, P ACM SIGMOD INT C M, P322
[10]   Optimal aggregation algorithms for middleware [J].
Fagin, R ;
Lotem, A ;
Naor, M .
JOURNAL OF COMPUTER AND SYSTEM SCIENCES, 2003, 66 (04) :614-656