Uncertainty Aware Query Execution Time Prediction

被引:18
|
作者
Wu, Wentao [1 ]
Wu, Xi [1 ]
Haciguemues, Hakan [2 ]
Naughton, Jeffrey F. [1 ]
机构
[1] Univ Wisconsin Madison, Dept Comp Sci, Madison, NJ 53706 USA
[2] NEC Labs Amer, Princeton, NJ USA
来源
PROCEEDINGS OF THE VLDB ENDOWMENT | 2014年 / 7卷 / 14期
关键词
D O I
10.14778/2733085.2733092
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Predicting query execution time is a fundamental issue underlying many database management tasks. Existing predictors rely on information such as cardinality estimates and system performance constants that are difficult to know exactly. As a result, accurate prediction still remains elusive for many queries. However, existing predictors provide a single, point estimate of the true execution time, but fail to characterize the uncertainty in the prediction. In this paper, we take a first step towards providing uncertainty information along with query execution time predictions. We use the query optimizer's cost model to represent the query execution time as a function of the selectivities of operators in the query plan as well as the constants that describe the cost of CPU and I/O operations in the system. By treating these quantities as random variables rather than constants, we show that with low overhead we can infer the distribution of likely prediction errors. We further show that the estimated prediction errors by our proposed techniques are strongly correlated with the actual prediction errors.
引用
收藏
页码:1857 / 1868
页数:12
相关论文
共 50 条
  • [1] A novel query execution time prediction approach based on operator iterate-aware of the execution plan on the graph database
    He, Zhenzhen
    Yu, Jiong
    Gu, Tiquan
    JOURNAL OF KING SAUD UNIVERSITY-COMPUTER AND INFORMATION SCIENCES, 2024, 36 (06)
  • [2] Stage: Query Execution Time Prediction in Amazon Redshift
    Wu, Ziniu
    Marcus, Ryan
    Liu, Zhengchun
    Negi, Parimarjan
    Nathan, Vikram
    Pfeil, Pascal
    Saxena, Gaurav
    Rahman, Mohammad
    Narayanaswamy, Balakrishnan
    Kraska, Tim
    COMPANION OF THE 2024 INTERNATIONAL CONFERENCE ON MANAGEMENT OF DATA, SIGMOD-COMPANION 2024, 2024, : 280 - 294
  • [3] DeepQT : Learning Sequential Context for Query Execution Time Prediction
    Ni, Jingxiong
    Zhao, Yan
    Zeng, Kai
    Su, Han
    Zheng, Kai
    DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2020), PT III, 2020, 12114 : 188 - 203
  • [4] Address-Aware Query Caching for Symbolic Execution
    Trabish, David
    Itzhaky, Shachar
    Rinetzky, Noam
    2021 14TH IEEE CONFERENCE ON SOFTWARE TESTING, VERIFICATION AND VALIDATION (ICST 2021), 2021, : 116 - 126
  • [5] Robust Query Execution Time Prediction for Concurrent Workloads on Massive Parallel Processing Databases
    Zheng, Zhihao
    Bei, Yuanzhe
    Sun, Hongyan
    Hong, Pengyu
    ADVANCES AND TRENDS IN ARTIFICIAL INTELLIGENCE: FROM THEORY TO PRACTICE, 2019, 11606 : 63 - 70
  • [6] A novel deep learning method for query task execution time prediction in graph database
    Chu, Zheng
    Yu, Jiong
    Hamdulla, Askar
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 112 : 534 - 548
  • [7] Toward Network-Aware Query Execution Systems in Large Datacenters
    Cheng, Long
    Wang, Ying
    Jhaveri, Rutvij H.
    Wang, Qingle
    Mao, Ying
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2023, 20 (04): : 4494 - 4504
  • [8] QoS-aware online scheduling of multiple workflows under task execution time uncertainty in clouds
    Ahmad Taghinezhad-Niar
    Saeid Pashazadeh
    Javid Taheri
    Cluster Computing, 2022, 25 : 3767 - 3784
  • [9] QoS-aware online scheduling of multiple workflows under task execution time uncertainty in clouds
    Taghinezhad-Niar, Ahmad
    Pashazadeh, Saeid
    Taheri, Javid
    CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (06): : 3767 - 3784
  • [10] Time-aware Structured Query Suggestion
    Miyanishi, Taiki
    Sakai, Tetsuya
    SIGIR'13: THE PROCEEDINGS OF THE 36TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH & DEVELOPMENT IN INFORMATION RETRIEVAL, 2013, : 809 - 812