Efficient monitoring of skyline queries over distributed data streams

被引:27
作者
Sun, Shengli [1 ]
Huang, Zhenghua [2 ]
Zhong, Hao [3 ]
Dai, Dongbo [4 ]
Liu, Hongbin [5 ]
Li, Jinjiu [6 ]
机构
[1] Peking Univ, Sch Software & Microelect, Beijing 100871, Peoples R China
[2] Tongji Univ, Dept Comp Sci, Sch Elect & Informat, Shanghai 200092, Peoples R China
[3] Chinese Acad Sci, Inst Software, Lab Internet Software Technol, Beijing, Peoples R China
[4] Fudan Univ, Sch Comp Sci & Technol, Shanghai 200433, Peoples R China
[5] State Grid Corp China, N China Grid China, Beijing, Peoples R China
[6] Univ Technol Sydney, Fac Engn & Informat Technol, Sydney, NSW 2007, Australia
基金
中国国家自然科学基金;
关键词
Distributed data streams; Skyline; Communication-optimal processing; Progressive refinement;
D O I
10.1007/s10115-009-0269-0
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Data management and data mining over distributed data streams have received considerable attention within the database community recently. This paper is the first work to address skyline queries over distributed data streams, where streams derive from multiple horizontally split data sources. Skyline query returns a set of interesting objects which are not dominated by any other objects within the base dataset. Previous work is concentrated on skyline computations over static data or centralized data streams. We present an efficient and an effective algorithm called BOCS to handle this issue under a more challenging environment of distributed streams. BOCS consists of an efficient centralized algorithm GridSky and an associated communication protocol. Based on the strategy of progressive refinement in BOCS, the skyline is incrementally computed by two phases. In the first phase, local skylines on remote sites are maintained by GridSky. At each time, only skyline increments on remote sites are sent to the coordinator. In the second phase, a global skyline is obtained by integrating remote increments with the latest global skyline. A theoretical analysis shows that BOCS is communication-optimal among all algorithms which use a share-nothing strategy. Extensive experiments demonstrate that our proposals are efficient, scalable, and stable.
引用
收藏
页码:575 / 606
页数:32
相关论文
共 38 条
[1]  
Borzsonyi S., Kossmann D., Stocker K., The skyline operator, Proceedings of ICDE, pp. 421-430, (2001)
[2]  
Tao Y., Papadias D., Maintaining sliding window skylines on data streams, IEEE Trans Knowl Data Eng, 18, 3, pp. 377-391, (2006)
[3]  
Lin X., Yuan Y., Wang W., Et al., Stabbing the sky: Efficient skyline computation over slidingwindows, Proceedings of ICDE, pp. 502-513, (2005)
[4]  
Guttman A., R-trees: A dynamic index structure for spatial searching, Proceedings of the ACM SIGMOD, pp. 47-57, (1984)
[5]  
Theodoridis Y., Sellis T., A model for the prediction of R-tree performance, Proceedings of the ACM PODS, pp. 161-171, (1996)
[6]  
Gibbons P., Tirthapura S., Estimating simple functions on the union of data streams, Proceedings of the ACM Symposium On Parallel Algorithms and Architectures, pp. 281-291, (2001)
[7]  
Keralapura R., Cormode G., Ramamirtham J., Communication-efficient distributed monitoring of thresholded counts, Proceedings of the ACM SIGMOD, pp. 289-300, (2006)
[8]  
Cormode G., Garofalakis M., Sketching streams through the net: Distributed approximate query tracking, Proceedings of VLDB, pp. 13-24, (2005)
[9]  
Cormode G., Garofalakis M., Muthukrishnan S., Et al., Holistic aggregates in a networked world: Distributed tracking of approximate quantiles, Proceedings of the ACM SIGMOD, pp. 25-36, (2005)
[10]  
Das A., Ganguly S., Garofalakis M., Et al., Distributed set-expression cardinality estimation, Proceedings of VLDB, pp. 312-323, (2004)