A Dynamic Hybrid Resource Provisioning Approach for Running Large-scale Computational Applications on Cloud Spot and On-demand Instances

被引:16
作者
Lu, Sifei [1 ]
Li, Xiaorong [1 ]
Wang, Long [1 ]
Kasim, Henry [1 ]
Palit, Henry [1 ]
Hung, Terence [1 ]
Legara, Erika Fille Tupas [1 ]
Lee, Gary [1 ]
机构
[1] Inst High Performance Comp, Singapore, Singapore
来源
2013 19TH IEEE INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2013) | 2013年
关键词
component; Cloud computing; resource provisioning; cost analysis; fault tolerance; spot instance; spot price; reliability; workflow scheduling;
D O I
10.1109/ICPADS.2013.117
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Testing and executing large-scale computational applications in public clouds is becoming prevalent due to cost saving, elasticity, and scalability. However, how to increase the reliability and reduce the cost to run large-scale applications in public clouds is still a big challenge. In this paper, we analyzed the pricing schemes of Amazon Elastic Compute Cloud (EC2) and found the disturbance effect that the price of the spot instances can be heavily affected due to the large number of spot instances required. We proposed a dynamic approach which schedules and runs large-scale computational applications on a dynamic pool of cloud computational instances. We use hybrid instances, including both on-demand instances for high priority tasks and backup, and spot instances for normal computational tasks so as to further reduce the cost without significantly increasing the completion time. Our proposed method takes the dynamic pricing of cloud instances into consideration, and it reduces the cost and tolerates the failures for running large-scale applications in public clouds. We conducted experimental tests and an agent based Scalable complex System modeling for Sustainable city (S-3) application is used to evaluate the scalability, reliability and cost saving. The results show that our proposed method is robust and highly flexible for researchers and users to further reduce cost in real practice.
引用
收藏
页码:657 / 662
页数:6
相关论文
共 30 条
[1]  
Agmon Ben-Yehuda O., 2011, Proceedings of the 2011 IEEE 3rd International Conference on Cloud Computing Technology and Science (CloudCom 2011), P304, DOI 10.1109/CloudCom.2011.48
[2]  
Andrzejak Artur, 2010, Proceedings 18th IEEE/ACM International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication Systems (MASCOTS 2010), P257, DOI 10.1109/MASCOTS.2010.34
[3]  
Chaisiri S, 2010, P IEEE INT C SERV OR
[4]  
Chaisiri Sivadon, IEEE T SERVICES COMP, V5, P164
[5]  
Chen JL, 2011, HPDC 11: PROCEEDINGS OF THE 20TH INTERNATIONAL SYMPOSIUM ON HIGH PERFORMANCE DISTRIBUTED COMPUTING, P229
[6]  
Chen Wang, 2012, 2012 IEEE Eighth World Congress on Services, P285, DOI 10.1109/SERVICES.2012.38
[7]  
Chohan N., 2010, P 2 USENIX C HOT TOP
[8]  
Javadi B., 2011, Proceedings of the 2011 IEEE 4th International Conference on Utility and Cloud Computing (UCC 2011), P219, DOI 10.1109/UCC.2011.37
[9]  
Javadi Bahman, 2012, P 4 IEEE INT C COUD
[10]  
Kasim H., 2013, 6 IEEE INT SCAL COMP