Load shedding for window joins over streams

被引:0
|
作者
Han, Donghong [1 ]
Xiao, Chuan [1 ]
Zhou, Rui [1 ]
Wang, Guoren [1 ]
Huo, Huan [1 ]
Hui, Xiaoyun [1 ]
机构
[1] Northeastern Univ, Shenyang 110004, Peoples R China
关键词
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We present a novel load shedding technique over sliding window joins. We first construct a dual window architectural model including join-windows and aux-windows. With the statistics built on aux-windows, an effective load shedding strategy is developed to produce maximum subset join outputs. For the streams with high arrival rates, we propose an approach incorporating front-shedding and rear-shedding, and then address the problem of how to cooperate these two shedding processes through a series of calculations. Based on extensive experimentation with synthetic data and real life data, we show that our load shedding strategy delivers superb join output performance, and dominates the existing strategies.
引用
收藏
页码:472 / 483
页数:12
相关论文
共 50 条
  • [31] Load Shedding Strategy Based on Combined Feed-Forward Plus Feedback Control over Data Streams
    Donghong Han
    Yi Fang
    Daqing Yi
    Yifei Zhang
    Xiang Tang
    Guoren Wang
    JournalofBeijingInstituteofTechnology, 2019, 28 (03) : 437 - 446
  • [32] Load Shedding Strategy Based on Combined Feed-Forward Plus Feedback Control over Data Streams
    Han D.
    Fang Y.
    Yi D.
    Zhang Y.
    Tang X.
    Wang G.
    Journal of Beijing Institute of Technology (English Edition), 2019, 28 (03): : 437 - 446
  • [33] An Optimization Technique for Multiple Continuous Multiple Joins over Data Streams
    Byun, Changwoo
    Lee, Hunjoo
    Ryu, YoungHa
    Park, Seog
    DATABASE AND EXPERT SYSTEMS APPLICATIONS, PROCEEDINGS, 2009, 5690 : 838 - +
  • [34] SWOOP: top-k similarity joins over set streams
    Mann, Willi
    Augsten, Nikolaus
    Jensen, Christian S.
    Pawlik, Mateusz
    VLDB JOURNAL, 2025, 34 (01):
  • [35] Load shedding for multi-way stream joins based on arrival order patterns
    Kwon, Tae-Hyung
    Lee, Ki Yong
    Kim, Myoung Ho
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2011, 37 (02) : 245 - 265
  • [36] Load shedding for multi-way stream joins based on arrival order patterns
    Tae-Hyung Kwon
    Ki Yong Lee
    Myoung Ho Kim
    Journal of Intelligent Information Systems, 2011, 37 : 245 - 265
  • [37] Adaptive load shedding for mining frequent patterns from data streams
    Dang, Xuan Hong
    Ng, Wee-Keong
    Ong, Kok-Leong
    DATA WAREHOUSING AND KNOWLEDGE DISCOVERY, PROCEEDINGS, 2006, 4081 : 342 - 351
  • [38] Temporal Coalescing on Window Extents over Data Streams
    Al-Kateb, Mohammed
    Kunta, Sasi Sekhar
    Lee, Byung Suk
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2011, E94D (03): : 489 - 503
  • [39] Efficient Window Processing over Disordered Data Streams
    Kim, Hyeon-Gyu
    Kang, Woo-Lam
    Kim, Myoung-Ho
    IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS, 2010, E93D (03): : 635 - 638
  • [40] Scalable Joins over Big Data Streams: Actual and Future Research Trends
    Cuzzocrea, Alfredo
    2022 IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW, 2022, : 1016 - 1019