Adaptive selection of tuples over data streams for efficient goad shedding

被引:0
|
作者
Chang, Joong Hyuk [1 ]
机构
[1] Univ Illinois, Dept Comp Sci, Urbana, IL 61801 USA
来源
关键词
load shedding; data streams; frequency-based selection; prediction of frequency; pre-processing;
D O I
暂无
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, data stream processing algorithms have been actively proposed. in terms of computing performance, they mainly focus on the restriction of their memory usage and minimization of their processing time per data element. However, if the number of data elements in a time slot is greater than the number of those that can be processed for the time slot, some of them cannot be processed in real time even though the processing time per data element is minimized. in this paper, a selection method of frequent tuples over a data stream for efficient load shedding is proposed. Furthermore, considering the change of the data stream, a threshold for the tuples to be selected is adaptively controlled by a prediction mechanism for the frequency of a tuple. Through this mechanism, the number of selected tuples is maximized within the capacity of the main-processing operation.
引用
收藏
页码:277 / 287
页数:11
相关论文
共 50 条
  • [1] Frequency-based load shedding over a data stream of tuples
    Chang, Joong Hyuk
    Kum, Hye-Chung
    INFORMATION SCIENCES, 2009, 179 (21) : 3733 - 3744
  • [2] Load shedding for aggregation queries over data streams
    Babcock, B
    Datar, M
    Motwani, R
    20TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, PROCEEDINGS, 2004, : 350 - 361
  • [3] Load shedding for window queries over continuous data streams
    Kim, Kwang Rak
    Kim, Hyeon Gyu
    Lecture Notes in Electrical Engineering, 2015, 373 : 159 - 164
  • [4] Adaptive load shedding for mining frequent patterns from data streams
    Dang, Xuan Hong
    Ng, Wee-Keong
    Ong, Kok-Leong
    DATA WAREHOUSING AND KNOWLEDGE DISCOVERY, PROCEEDINGS, 2006, 4081 : 342 - 351
  • [5] Adaptive clusters and histograms over data streams
    Puttagunta, V
    Kalpakis, K
    IKE '05: PROCEEDINGS OF THE 2005 INTERNATIONAL CONFERENCE ON INFORMATION AND KNOWLEDGE ENGINEERING, 2005, : 98 - 104
  • [6] Semantic load shedding for prioritized continuous queries over data streams
    Park, J
    Cho, H
    COMPUTER AND INFORMATION SCIENCES - ISCIS 2005, PROCEEDINGS, 2005, 3733 : 813 - 822
  • [7] Prioritized Query Shedding Technique for Continuous Queries Over Data Streams
    Helmy, Yehia M.
    El Zanfaly, Doaa S.
    Othman, Nermin A.
    2009 INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING AND SYSTEMS (ICCES 2009), 2009, : 418 - 422
  • [8] Semantic Load Shedding over Real-Time Data Streams
    Ma, Li
    Zhang, Qiongsheng
    Wang, Kun
    Li, Xin
    Wang, Hongan
    PROCEEDINGS OF THE 2008 INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN, VOL 1, 2008, : 465 - +
  • [9] Efficient aggregate computation over data streams
    Nagaraj, Kanthi
    Naidu, K. V. M.
    Rastogi, Rajeev
    Satkin, Scott
    2008 IEEE 24TH INTERNATIONAL CONFERENCE ON DATA ENGINEERING, VOLS 1-3, 2008, : 1382 - +
  • [10] An Efficient Sliding Window Based Algorithm for Adaptive Frequent Itemset Mining over Data Streams
    Deypir, Mhmood
    Sadreddini, Mohammad Hadi
    Taahomi, Mehran
    JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2013, 29 (05) : 1001 - 1020