S-Store: A Streaming NewSQL System for Big Velocity Applications

被引:40
作者
Cetintemel, Ugur [1 ]
Due, Jiang [2 ]
Kraska, Tim [1 ]
Madden, Samuel [3 ]
Maier, David [4 ]
Meehan, John [1 ]
Pavlo, Andrew [5 ]
Stonebraker, Michael [3 ]
Sutherland, Erik [4 ]
Tatbul, Nesime [2 ,3 ]
Tufte, Kristin [4 ]
Wang, Hao [3 ]
Zdonik, Stanley [1 ]
机构
[1] Brown Univ, Providence, RI 02912 USA
[2] Intel Labs, Pittsburgh, PA 15213 USA
[3] MIT, Cambridge, MA 02139 USA
[4] Portland State Univ, Portland, OR 97207 USA
[5] CMU, Pittsburgh, PA 15213 USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2014年 / 7卷 / 13期
基金
美国国家科学基金会;
关键词
D O I
10.14778/2733004.2733048
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
First-generation streaming systems did not pay much attention to state management via ACID transactions (e.g., [ 3, 4]). S-Store is a data management system that combines OLTP transactions with stream processing. To create S-Store, we begin with H-Store, a main-memory transaction processing engine, and add primitives to support streaming. This includes triggers and transaction workflows to implement push-based processing, windows to provide a way to bound the computation, and tables with hidden state to implement scoping for proper isolation. This demo explores the benefits of this approach by showing how a naive implementation of our benchmarks using only H-Store can yield incorrect results. We also show that by exploiting push-based semantics and our implementation of triggers, we can achieve significant improvement in transaction throughput. We demo two modern applications: (i) leaderboard maintenance for a version of "American Idol", and (ii) a city-scale bicycle rental scenario.
引用
收藏
页码:1633 / 1636
页数:4
相关论文
共 8 条
[1]   Aurora: a new model and architecture for data stream management [J].
Abadi, DJ ;
Carney, D ;
Cetintemel, U ;
Cherniack, M ;
Convey, C ;
Lee, S ;
Stonebraker, M ;
Tatbul, N ;
Zdonik, S .
VLDB JOURNAL, 2003, 12 (02) :120-139
[2]  
[Anonymous], 2012, SIGMOD
[3]  
Arasu A., 2004, DATA STREAM MANAGEME
[4]  
Aslett M., 2011, THE 451 GROUP
[5]  
Kallman R., 2008, VLDB
[6]  
Malviya N., 2014, ICDE
[7]  
Toshniwal A., 2014, SIGMOD
[8]  
Zaharia Matei, 2013, SOSP