Using Machine Learning to Predict the Exact Resource Usage of Microservice Chains

被引:0
|
作者
Taheri, Javid [1 ,2 ]
Gorden, Arvid [1 ]
Al-Dulaimy, Auday [3 ,4 ]
机构
[1] Karlstad Univ, Karlstad, Sweden
[2] Queens Univ Belfast, Belfast, Antrim, North Ireland
[3] Malardalen Univ, Vasteras, Sweden
[4] Dalarna Univ, Falun, Sweden
来源
16TH IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING, UCC 2023 | 2023年
关键词
Cloud computing; Resource management; Auto-scaling; Kubernetes; Microservice; Machine learning;
D O I
10.1145/3603166.3632166
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing offers a wide range of services, but it comes with some challenges. One of these challenges is to predict the resource utilization of the nodes that run applications and services. This is especially relevant for container-based platforms such as Kubernetes. Predicting the resource utilization of a Kubernetes cluster can help optimize the performance, reliability, and cost-effectiveness of the platform. This paper focuses on how well different resources in a cluster can be predicted using machine learning techniques. The approach consists of three main steps: data collection and extraction, data pre-processing and analysis, and resource prediction. The data collection step involves stressing the system with a load-generator (called Locust) and collecting data from Locust and Kubernetes with the use of Prometheus. The data pre-processing and extraction step involves extracting relevant data and transforming it into a suitable format for the machine learning models. The final step involves applying different machine learning models to the data and evaluating their accuracy. The results illustrate that different machine learning techniques can predict resources accurately.
引用
收藏
页数:9
相关论文
共 50 条
  • [1] Online Machine Learning for Cloud Resource Provisioning of Microservice Backend Systems
    Alipour, Hanieh
    Liu, Yan
    2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 2433 - 2441
  • [2] Is Machine Learning Necessary for Cloud Resource Usage Forecasting?
    Christofidi, Georgia
    Papaioannou, Konstantinos
    Doudali, Thaleia Dimitra
    PROCEEDINGS OF THE 2023 ACM SYMPOSIUM ON CLOUD COMPUTING, SOCC 2023, 2023, : 544 - 554
  • [3] Resource Usage Cost Optimization in Cloud Computing Using Machine Learning
    Osypanka, Patryk
    Nawrocki, Piotr
    IEEE TRANSACTIONS ON CLOUD COMPUTING, 2022, 10 (03) : 2079 - 2089
  • [4] Machine Learning as a Reusable Microservice
    Pahl, Marc-Oliver
    Loipfinger, Markus
    NOMS 2018 - 2018 IEEE/IFIP NETWORK OPERATIONS AND MANAGEMENT SYMPOSIUM, 2018,
  • [5] Signature-based Adaptive Cloud Resource Usage Prediction Using Machine Learning and Anomaly Detection
    Sus, Wiktor
    Nawrocki, Piotr
    JOURNAL OF GRID COMPUTING, 2024, 22 (02)
  • [6] FinOps-driven optimization of cloud resource usage for high-performance computing using machine learning
    Nawrocki, Piotr
    Smendowski, Mateusz
    JOURNAL OF COMPUTATIONAL SCIENCE, 2024, 79
  • [7] Toward Using Representation Learning for Cloud Resource Usage Forecasting
    Moundir Ghorab, Razine
    Dimitra Doudali, Thaleia
    PROCEEDINGS OF THE 2024 ON WORKSHOP ON AI FOR SYSTEMS, AI4SYS 2024, 2024, : 13 - 19
  • [8] USAGE OF MACHINE LEARNING TO PREDICT MARKET ATTRACTIVENESS IN THE CONTEXT OF INTERNATIONALIZATION
    Falco, Briam Daniel
    Neubert, Michael
    van der Krogt, Augustinus
    PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE INNOVATION MANAGEMENT, ENTREPRENEURSHIP AND SUSTAINABILITY (IMES 2020), 2020, : 140 - 152
  • [9] Auto-Scaling Network Service Chains Using Machine Learning and Negotiation Game
    Rahman, Sabidur
    Ahmed, Tanjila
    Huynh, Minh
    Tornatore, Massimo
    Mukherjee, Biswanath
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2020, 17 (03): : 1322 - 1336
  • [10] A Machine Learning Approach to Predict Customer Usage of a Home Workout Platform
    Chen, Qiuying
    Lee, SangJoon
    APPLIED SCIENCES-BASEL, 2021, 11 (21):