Automated Performance Benchmarking Platform of IaaS Cloud

被引：0
作者：
Liu, Xu [1 ]
Fang, Dongxu [2 ]
Xu, Peng [2 ]
机构：
[1] China Acad Ind Internet, Beijing, Peoples R China
[2] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
来源：
2021 IEEE 20TH INTERNATIONAL CONFERENCE ON TRUST, SECURITY AND PRIVACY IN COMPUTING AND COMMUNICATIONS (TRUSTCOM 2021) | 2021年
基金：
中国国家自然科学基金;
关键词：
Cloud Computing; IaaS; Virtual Machine; Performance Evaluation;
D O I：
10.1109/TRUSTCOM53373.2021.00197
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
With the rapid development of cloud computing, IaaS (Infrastructure as a Service) becomes more and more popular. IaaS customers may not clearly know the actual performance of each cloud platform. Moreover, there are no unified standards in performance evaluation of IaaS VMs (virtual machine). The underlying virtualization technology of IaaS cloud is transparent to customers. In this paper, we will design an automated performance benchmarking platform which can automatically install, configure and execute each benchmarking tool with a configuration center. This platform can easily visualize multidimensional benchmarking parameters data of each IaaS cloud platform. We also rented four IaaS VMs from AliCloud-Beijing, AliCloud-Qingdao, UCloud and Huawei to validate our benchmarking system. Performance comparisons of multiple parameters between multiple platforms were shown in this paper. However, in practice, customers' applications running on VMs are often complex. Performance of complex applications may not depend on single benchmarking parameter (e.g. CPU, memory, disk I/O etc.). We ran a TPC-C test for example to get overall performance in MySQL application scenario. The effects of different benchmarking parameters differ in this specific scenario.
引用
收藏
页码：1402 / 1405
页数：4
相关论文
共 17 条
[1]   Massive Data Load on Distributed Database Systems over HBase [J].
Azqueta-Alzuaz, Ainhoa ;
Patino-Martinez, Marta ;
Brondino, Ivan ;
Jimenez-Peris, Ricardo .
2017 17TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND GRID COMPUTING (CCGRID), 2017, :776-779
[2]  
Felter W, 2015, INT SYM PERFORM ANAL, P171, DOI 10.1109/ISPASS.2015.7095802
[3]   Privacy-Preserving Aggregation for Federated Learning-Based Navigation in Vehicular Fog [J].
Kong, Qinglei ;
Yin, Feng ;
Lu, Rongxing ;
Li, Beibei ;
Wang, Xiaohong ;
Cui, Shuguang ;
Zhang, Ping .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (12) :8453-8463
[4]   Blockchain-Based Privacy-Preserving Driver Monitoring for MaaS in the Vehicular IoT [J].
Kong, Qinglei ;
Lu, Rongxing ;
Yin, Feng ;
Cui, Shuguang .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (04) :3788-3799
[5]   On the Conceptualization of Performance Evaluation of IaaS Services [J].
Li, Zheng ;
O'Brien, Liam ;
Zhang, He ;
Cai, Rainbow .
IEEE TRANSACTIONS ON SERVICES COMPUTING, 2014, 7 (04) :628-641
[6]   Resource scheduling for infrastructure as a service (IaaS) in cloud computing: Challenges and opportunities [J].
Madni, Syed Hamid Hussain ;
Abd Latiff, Muhammad Shafie ;
Coulibaly, Yahaya ;
Abdulhamid, Shafi'i Muhammad .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2016, 68 :173-200
[7]  
Nambiar Raghunath, TECHN C PERF EV BENC, P1
[8]  
Patel P., 2009, P CLOUD WORKSH
[9]   Streaming Big Data Processing in Datacenter Clouds [J].
Ranjan, Rajiv .
IEEE CLOUD COMPUTING, 2014, 1 (01) :78-83
[10]  
Salah K., 2011, 2011 6th International Conference for Internet Technology and Secured Transactions (ICITST), P345
12