Optimizing Multiple Multi-Way Stream Joins

被引：4
作者：
Dossinger, Manuel [1 ]
Michel, Sebastian [1 ]
机构：
[1] TU Kaiserslautern TUK, Kaiserslautern, Germany
来源：
2021 IEEE 37TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING (ICDE 2021) | 2021年
关键词：
QUERY OPTIMIZATION;
D O I：
10.1109/ICDE51399.2021.00188
中图分类号：
TP [自动化技术、计算机技术];
学科分类号：
0812 ;
摘要：
We address the joint optimization of multiple stream joins in a scale-out architecture by tailoring prior work on multi-way stream joins to predicate-driven data partitioning schemes. We present an integer linear programming (ILP) formulation for selecting the partitioning and tuple routing with minimal probe load. The presented algorithms and optimization schemes are implemented in CLASH, a data stream processor developed in our group that translates queries to deployable Apache Storm topologies after optimization. The experiments conducted on TPC-H data exhibit the potential of multi-query optimization of multi-way stream joins and the effectiveness and feasibility of the ILP optimization problem.
引用
收藏
页码：1985 / 1990
页数：6
相关论文
共 23 条
  • [1] Ananthanarayanan Rajagopal., 2013, Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data, SIGMOD '13, P577, DOI DOI 10.1145/2463676.2465272
  • [2] [Anonymous], 2016, APACHE STORM
  • [3] Apache Software Foundation, 2018, APACH FLINK
  • [4] Avnur R, 2000, SIGMOD REC, V29, P261, DOI 10.1145/335191.335420
  • [5] Carbone P., 2015, B IEEE COMPUTER SOC, V36, DOI DOI 10.1109/IC2EW.2016.56
  • [6] Dokeroglu T., 2014, ISCIS
  • [7] CLASH: A High-Level Abstraction for Optimized, Multi-Way Stream Joins over Apache Storm
    Dossinger, Manuel
    Michel, Sebastian
    Roudsarabi, Constantin
    [J]. SIGMOD '19: PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, 2019, : 1897 - 1900
  • [8] Golab L., 2003, VLDB
  • [9] Hammad M. A., 2003, VLDB
  • [10] Multi-Query Optimization in Wide-Area Streaming Analytics
    Jonathan, Albert
    Chandra, Abhishek
    Weissman, Jon
    [J]. PROCEEDINGS OF THE 2018 ACM SYMPOSIUM ON CLOUD COMPUTING (SOCC '18), 2018, : 412 - 425
123