Performance Modeling of Serverless Computing Platforms

被引:56
作者
Mahmoudi, Nima [1 ]
Khazaei, Hamzeh [2 ]
机构
[1] Univ Alberta, Dept Elect & Comp Engn, Edmonton, AB T6G 2R3, Canada
[2] York Univ, Dept Elect Engn & Comp Sci, Toronto, ON M3J 1P3, Canada
关键词
Serverless computing; performance modeling; optimization; queuing theory; stochastic processes;
D O I
10.1109/TCC.2020.3033373
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Analytical performance models have been leveraged extensively to analyze and improve the performance and cost of various cloud computing services. However, in the case of serverless computing, which is projected to be the dominant form of cloud computing in the future, we have not seen analytical performance models to help with the analysis and optimization of such platforms. In this work, we propose an analytical performance model that captures the unique details of serverless computing platforms. The model can be leveraged to improve the quality of service and resource utilization and reduce the operational cost of serverless platforms. Also, the proposed performance model provides a framework that enables serverless platforms to become workload-aware and operate differently for different workloads to provide a better trade-off between the cost and performance depending on the user's preferences. The current serverless offerings require the user to have extensive knowledge of the internals of the platform to perform efficient deployments. Using the proposed analytical model, the provider can simplify the deployment process by calculating the performance metrics for users even before physical deployments. We validate the applicability and accuracy of the proposed model by extensive experimentation on AWS Lambda. We show that the proposed model can calculate essential performance metrics such as average response time, probability of cold start, and the average number of function instances in the steady-state. Also, we show how the performance model can be used to tune the serverless platform for each workload, which will result in better performance or lower cost without scarifying the other. The presented model assumes no non-realistic restrictions, so that it offers a high degree of fidelity while maintaining tractability at large scale.
引用
收藏
页码:2834 / 2847
页数:14
相关论文
共 60 条
[1]  
Akkus IE, 2018, PROCEEDINGS OF THE 2018 USENIX ANNUAL TECHNICAL CONFERENCE, P923
[2]  
Amazon Web Services Inc, SERV COMP
[3]  
Amazon Web Services Inc, AWS LAMBD
[4]  
Apache Software Foundation, OPENWHISK OP SOURC S
[5]   A View of Cloud Computing [J].
Armbrust, Michael ;
Fox, Armando ;
Griffith, Rean ;
Joseph, Anthony D. ;
Katz, Randy ;
Konwinski, Andy ;
Lee, Gunho ;
Patterson, David ;
Rabkin, Ariel ;
Stoica, Ion ;
Zaharia, Matei .
COMMUNICATIONS OF THE ACM, 2010, 53 (04) :50-58
[6]   Hierarchical Stochastic Models for Performance, Availability, and Power Consumption Analysis of IaaS Clouds [J].
Ataie, Ehsan ;
Entezari-Maleki, Reza ;
Rashidi, Leila ;
Trivedi, Kishor S. ;
Ardagna, Danilo ;
Movaghar, Ali .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2019, 7 (04) :1039-1056
[7]  
Balla David, 2020, Internet of Vehicles. Technologies and Services Toward Smart Cities. 6th International Conference, IOV 2019. Proceedings. Lecture Notes in Computer Science (LNCS 11894), P250, DOI 10.1007/978-3-030-38651-1_21
[8]   Serverless Performance and Optimization Strategies [J].
Bardsley, Daniel ;
Ryan, Larry ;
Howard, John .
2018 IEEE INTERNATIONAL CONFERENCE ON SMART CLOUD (SMARTCLOUD), 2018, :19-26
[9]   A Novel Statistical Cost Model and an Algorithm for Efficient Application Offloading to Clouds [J].
Barrameda, Jose ;
Samaan, Nancy .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2018, 6 (03) :598-611
[10]  
Baxter LaurenceA., 1992, Probability, statistics, and queueing theory with computer sciences applications