Truthful Online Scheduling of CloudWorkloads under Uncertainty

被引:1
作者
Babaioff, Moshe [1 ]
Lempel, Ronny [2 ]
Lucier, Brendan [1 ]
Menache, Ishai [1 ]
Slivkins, Aleksandrs [1 ]
Wong, Sam Chiu Wai [1 ]
机构
[1] Microsoft Res, Herzliyya, Israel
[2] Google, Kirkland, WA USA
来源
PROCEEDINGS OF THE ACM WEB CONFERENCE 2022 (WWW'22) | 2022年
关键词
scheduling; cloud computing; online algorithms; mechanism design; FAST APPROXIMATION ALGORITHMS;
D O I
10.1145/3485447.3512060
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Cloud computing customers often submit repeating jobs and computation pipelines on approximately regular schedules, with arrival and running times that exhibit variance. This pattern, typical of training tasks in machine learning, allows customers to partially predict future job requirements. We develop a model of cloud computing platforms that receive statements of work (SoWs) in an online fashion. The SoWs describe future jobs whose arrival times and durations are probabilistic, and whose utility to the submitting agents declines with completion time. The arrival and duration distributions, as well as the utility functions, are considered private customer information and are reported by strategic agents to a scheduler that is optimizing for social welfare. We design pricing, scheduling, and eviction mechanisms that incentivize truthful reporting of SoWs. An important challenge is maintaining incentives despite the possibility of the platform becoming saturated. We introduce a framework to reduce scheduling under uncertainty to a relaxed scheduling problem without uncertainty. Using this framework, we tackle both adversarial and stochastic submissions of statements of work, and obtain logarithmic and constant competitive mechanisms, respectively.
引用
收藏
页码:151 / 161
页数:11
相关论文
共 37 条
[31]  
Lucier B., 2013, SPAA, P305
[32]  
Mahajan K, 2020, PROCEEDINGS OF THE 17TH USENIX SYMPOSIUM ON NETWORKED SYSTEMS DESIGN AND IMPLEMENTATION, P289
[33]   Optimus: An Efficient Dynamic Resource Scheduler for Deep Learning Clusters [J].
Peng, Yanghua ;
Bao, Yixin ;
Chen, Yangrui ;
Wu, Chuan ;
Guo, Chuanxiong .
EUROSYS '18: PROCEEDINGS OF THE THIRTEENTH EUROSYS CONFERENCE, 2018,
[34]   FAST APPROXIMATION ALGORITHMS FOR FRACTIONAL PACKING AND COVERING PROBLEMS [J].
PLOTKIN, SA ;
SHMOYS, DB ;
TARDOS, E .
MATHEMATICS OF OPERATIONS RESEARCH, 1995, 20 (02) :257-301
[35]  
Porter R., 2004, Proc. 5th ACM Conference on Electronic Commerce (EC'Of), P61
[36]   TetriSched: global rescheduling with adaptive plan-ahead in dynamic heterogeneous clusters [J].
Tumanov, Alexey ;
Zhu, Timothy ;
Park, Jun Woo ;
Kozuch, Michael A. ;
Harchol-Balter, Mor ;
Ganger, Gregory R. .
PROCEEDINGS OF THE ELEVENTH EUROPEAN CONFERENCE ON COMPUTER SYSTEMS, (EUROSYS 2016), 2016,
[37]   Cloud Pricing Models: Taxonomy, Survey, and Interdisciplinary Challenges [J].
Wu, Caesar ;
Buyya, Raj K. Umar ;
Ramamohanarao, Kotagiri .
ACM COMPUTING SURVEYS, 2020, 52 (06)