SECRET: A Model for Analysis of the Execution Semantics of Stream Processing Systems

被引:50
作者
Botan, Irina [1 ]
Derakhshan, Roozbeh [1 ]
Dindar, Nihal [1 ]
Haas, Laura [2 ]
Miller, Renee J. [3 ]
Tatbul, Nesime [1 ]
机构
[1] Swiss Fed Inst Technol, Zurich, Switzerland
[2] IBM Almaden Res Ctr, San Jose, CA USA
[3] Univ Toronto, Toronto, ON, Canada
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2010年 / 3卷 / 01期
基金
加拿大自然科学与工程研究理事会;
关键词
D O I
10.14778/1920841.1920874
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There are many academic and commercial stream processing engines (SPEs) today, each of them with its own execution semantics. This variation may lead to seemingly inexplicable differences in query results. In this paper, we present SECRET, a model of the behavior of SPEs. SECRET is a descriptive model that allows users to analyze the behavior of systems and understand the results of window-based queries for a broad range of heterogeneous SPEs. The model is the result of extensive analysis and experimentation with several commercial and academic engines. In the paper, we describe the types of heterogeneity found in existing engines, and show with experiments on real systems that our model can explain the key differences in windowing behavior.
引用
收藏
页码:232 / 243
页数:12
相关论文
共 13 条
[1]   Aurora: a new model and architecture for data stream management [J].
Abadi, DJ ;
Carney, D ;
Cetintemel, U ;
Cherniack, M ;
Convey, C ;
Lee, S ;
Stonebraker, M ;
Tatbul, N ;
Zdonik, S .
VLDB JOURNAL, 2003, 12 (02) :120-139
[2]   The CQL continuous query language: semantic foundations and query execution [J].
Arasu, A ;
Babu, S ;
Widom, J .
VLDB JOURNAL, 2006, 15 (02) :121-142
[3]  
Botan I., 2009, TR632 ETH ZUR DEP CO
[4]  
CHANDRASEKARAN S, 2003, CIDR C
[5]  
Gedik Bugra, 2008, ACM SIGMOD
[6]  
Jain N., 2008, VLDB C
[7]  
Kramer J., 2009, ACM TODS, V34
[8]  
Li L., 2005, ACM SIGMOD C
[9]  
Maier D., 2005, ICDT C
[10]  
Motwani R., 2003, CIDR C