Load shedding for window joins over streams

被引:0
|
作者
Han, Donghong [1 ]
Xiao, Chuan [1 ]
Zhou, Rui [1 ]
Wang, Guoren [1 ]
Huo, Huan [1 ]
Hui, Xiaoyun [1 ]
机构
[1] Northeastern Univ, Shenyang 110004, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel load shedding technique over sliding window joins. We first construct a dual window architectural model including join-windows and aux-windows. With the statistics built on aux-windows, an effective load shedding strategy is developed to produce maximum subset join outputs. For the streams with high arrival rates, we propose an approach incorporating front-shedding and rear-shedding, and then address the problem of how to cooperate these two shedding processes through a series of calculations. Based on extensive experimentation with synthetic data and real life data, we show that our load shedding strategy delivers superb join output performance, and dominates the existing strategies.
引用
收藏
页码:472 / 483
页数:12
相关论文
共 50 条
  • [21] Stream Economics: Resource Efficiency in Streams with Task Over-Allocation and Load Shedding
    Alves, Luis
    Veiga, Luis
    DISTRIBUTED APPLICATIONS AND INTEROPERABLE SYSTEMS, DAIS 2024, 2024, 14677 : 1 - 17
  • [22] Random sampling over streaming window joins
    Ren, Jiadong
    Jiang, Wanchang
    Huo, Cong
    PROCEEDINGS OF THE FIRST INTERNATIONAL SYMPOSIUM ON DATA, PRIVACY, AND E-COMMERCE, 2007, : 53 - +
  • [23] ClusterSheddy:: Load shedding using moving clusters over spatio-temporal data streams
    Nehme, Rimma V.
    Rundensteiner, Elke A.
    ADVANCES IN DATABASES: CONCEPTS, SYSTEMS AND APPLICATIONS, 2007, 4443 : 637 - +
  • [24] Window specification over data streams
    Patroumpas, Kostas
    Sellis, Timos
    CURRENT TRENDS IN DATABASE TECHNOLOGY - EDBT 2006, 2006, 4254 : 445 - 464
  • [25] QoS-driven load shedding on data streams
    Tatbul, N
    XML-BASED DATA MANAGEMENT AND MULTIMEDIA ENGINEERING-EDBT 2002 WORKSHOPS, 2002, 2490 : 566 - 576
  • [26] Loadstar: A Load Shedding Scheme for Classifying Data Streams
    Chi, Yun
    Yu, Philip S.
    Wang, Haixun
    Muntz, Richard R.
    PROCEEDINGS OF THE FIFTH SIAM INTERNATIONAL CONFERENCE ON DATA MINING, 2005, : 346 - 357
  • [27] Load Distribution for Multi-Way Streams Joins Using Cluster
    Liu, Xinchun
    Li, Jing
    Fan, Xiaopeng
    2014 INTERNATIONAL CONFERENCE ON COMPUTING, COMMUNICATION AND NETWORKING TECHNOLOGIES (ICCCNT, 2014,
  • [28] A load shedding framework and optimizations for M-way windowed stream joins
    Gedik, Bugra
    Wu, Kun-Lung
    Yu, Philip S.
    Liu, Ling
    2007 IEEE 23RD INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3, 2007, : 511 - +
  • [29] Associated load shedding strategies for computing multi-joins in sensor networks
    Yang, Xiaochun
    Li, Lin
    Ng, Yiu-Kai
    Wang, Bin
    Yu, Ge
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS, PROCEEDINGS, 2006, 3882 : 50 - 64
  • [30] Prediction-Based Load Shedding for Burst Data Streams
    Maison, Rafal
    Zakrzewicz, Maciej
    BELL LABS TECHNICAL JOURNAL, 2011, 16 (01) : 121 - 132