Mitigating cold start problem in serverless computing using predictive pre-warming with machine learning

被引:0
|
作者
Hu, Qingmiao [1 ]
Li, Hongwei [1 ]
Nikougoftar, Elaheh [2 ]
机构
[1] Beijing Normal Univ, Fac art & Sci, Zhuhai 519000, Peoples R China
[2] Taali Inst Higher Educ, Dept Comp & Elect, Qom, Iran
关键词
Serverless computing; Cold start; Machine learning; Predictive pre-warming; Recurrent neural network;
D O I
10.1007/s00607-024-01382-y
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
The cold start problem in serverless computing leads to increased latency when functions are invoked after being idle. This paper proposes a predictive pre-warming strategy that leverages machine learning and historical data analysis to mitigate the cold start problem. By using a Recurrent Neural Network (RNN) to predict future invocations and a pre-warming scheduler to determine the number of instances to pre-warm, our approach aims to optimize resource utilization and reduce latency. Results show that the proposed method adapts idle-container times efficiently, reducing cold starts and idle periods. The proposed method outperforms OpenWhisk by executing more invocations, demonstrating a 49.52% improvement and enhancing container resource allocation optimization.
引用
收藏
页数:24
相关论文
共 40 条
  • [1] Mitigating Cold Start Problem in Serverless Computing: A Reinforcement Learning Approach
    Vahidinia, Parichehr
    Farahani, Bahar
    Aliee, Fereidoon Shams
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (05) : 3917 - 3927
  • [2] Mitigating Cold Start Problem in Serverless Computing with Function Fusion
    Lee, Seungjun
    Yoon, Daegun
    Yeo, Sangho
    Oh, Sangyoon
    SENSORS, 2021, 21 (24)
  • [3] Pre-warming: Alleviating Cold Start Occurrences on Cloud-based Serverless Platforms
    Htet, Thu Yein
    Shwe, Thanda
    Mendonca, Israel
    Aritsugi, Masayoshi
    2024 IEEE 10TH INTERNATIONAL CONFERENCE ON EDGE COMPUTING AND SCALABLE CLOUD, EDGECOM 2024, 2024, : 66 - 72
  • [4] Cold Start Prediction and Provisioning Optimization in Serverless Computing Using Deep Learning
    Kumar, N. Saravana
    Samy, S. Selvakumara
    CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2025, 37 (4-5):
  • [5] WLEC: A Not So Cold Architecture to Mitigate Cold Start Problem in Serverless Computing
    Solaiman, Khondokar
    Adnan, Muhammad Abdullah
    2020 IEEE INTERNATIONAL CONFERENCE ON CLOUD ENGINEERING (IC2E 2020), 2020, : 144 - 153
  • [6] Mitigating Cold-Start Delay using Warm-Start Containers in Serverless Platform
    Kumari, Anisha
    Sahoo, Bibhudatta
    Behera, Ranjan Kumar
    2022 IEEE 19TH INDIA COUNCIL INTERNATIONAL CONFERENCE, INDICON, 2022,
  • [7] Reducing cold start delay in serverless computing using lightweight virtual machines
    Karamzadeh, Amirmohammad
    Shameli-Sendi, Alireza
    JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 232
  • [8] Holistic cold-start management in serverless computing cloud with deep learning for time series
    Nguyen, Tam n.
    FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 153 : 312 - 325
  • [9] Intelligent Framework in a Serverless Computing for Serving using Artificial Intelligence and Machine Learning
    Khatri, Deepak
    Khatri, Sunil Kumar
    Mishra, Deepti
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2024, 15 (05) : 29 - 37
  • [10] Overcoming the Cold Start Problem of Customer Relationship Management Using a Probabilistic Machine Learning Approach
    Padilla, Nicolas
    Ascarza, Eva
    JOURNAL OF MARKETING RESEARCH, 2021, 58 (05) : 981 - 1006