Using Machine Learning to Predict the Exact Resource Usage of Microservice Chains

被引:0
|
作者
Taheri, Javid [1 ,2 ]
Gorden, Arvid [1 ]
Al-Dulaimy, Auday [3 ,4 ]
机构
[1] Karlstad Univ, Karlstad, Sweden
[2] Queens Univ Belfast, Belfast, Antrim, North Ireland
[3] Malardalen Univ, Vasteras, Sweden
[4] Dalarna Univ, Falun, Sweden
来源
16TH IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING, UCC 2023 | 2023年
关键词
Cloud computing; Resource management; Auto-scaling; Kubernetes; Microservice; Machine learning;
D O I
10.1145/3603166.3632166
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing offers a wide range of services, but it comes with some challenges. One of these challenges is to predict the resource utilization of the nodes that run applications and services. This is especially relevant for container-based platforms such as Kubernetes. Predicting the resource utilization of a Kubernetes cluster can help optimize the performance, reliability, and cost-effectiveness of the platform. This paper focuses on how well different resources in a cluster can be predicted using machine learning techniques. The approach consists of three main steps: data collection and extraction, data pre-processing and analysis, and resource prediction. The data collection step involves stressing the system with a load-generator (called Locust) and collecting data from Locust and Kubernetes with the use of Prometheus. The data pre-processing and extraction step involves extracting relevant data and transforming it into a suitable format for the machine learning models. The final step involves applying different machine learning models to the data and evaluating their accuracy. The results illustrate that different machine learning techniques can predict resources accurately.
引用
收藏
页数:9
相关论文
共 50 条
  • [41] Cloud Resource Demand Prediction using Machine Learning in the Context of QoS Parameters
    Piotr Nawrocki
    Patryk Osypanka
    Journal of Grid Computing, 2021, 19
  • [42] Cloud Resource Demand Prediction using Machine Learning in the Context of QoS Parameters
    Nawrocki, Piotr
    Osypanka, Patryk
    JOURNAL OF GRID COMPUTING, 2021, 19 (02)
  • [43] Enhancing Machine Learning-Based Autoscaling for Cloud Resource Orchestration
    Pintye, Istvan
    Kovacs, Jozsef
    Lovas, Robert
    JOURNAL OF GRID COMPUTING, 2024, 22 (04)
  • [44] Resource Optimization for Circuit Simulation using Machine Learning
    Chakma, Gangotree
    Awasthi, Shaan
    2018 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2018, : 4900 - 4905
  • [45] A Machine-Learning-Based Auction for Resource Trading in Fog Computing
    Luong, Nguyen Cong
    Jiao, Yutao
    Wang, Ping
    Niyato, Dusit
    Kim, Dong In
    Han, Zhu
    IEEE COMMUNICATIONS MAGAZINE, 2020, 58 (03) : 82 - 88
  • [46] Resource Metric Refining Module for AIOps Learning Data in Kubernetes Microservice
    Park, Jonghwan
    Son, Jaegi
    Kim, Dongmin
    KSII TRANSACTIONS ON INTERNET AND INFORMATION SYSTEMS, 2023, 17 (06): : 1545 - 1559
  • [47] Using machine learning to detect the differential usage of novel gene isoforms
    Xiaopu Zhang
    Musa A. Hassan
    James G. D. Prendergast
    BMC Bioinformatics, 23
  • [48] Predicting Site Energy Usage Intensity Using Machine Learning Models
    Njimbouom, Soualihou Ngnamsie
    Lee, Kwonwoo
    Lee, Hyun
    Kim, Jeongdong
    SENSORS, 2023, 23 (01)
  • [49] USAGE OF MACHINE LEARNING IN INTERNATIONAL ENTREPRENEURSHIP
    Falco, Briam Daniel
    Neubert, Michael
    van der Krogt, Augustinus
    13TH ANNUAL CONFERENCE OF THE EUROMED ACADEMY OF BUSINESS: BUSINESS THEORY AND PRACTICE ACROSS INDUSTRIES AND MARKETS, 2020, : 419 - 428
  • [50] Using machine learning to detect the differential usage of novel gene isoforms
    Zhang, Xiaopu
    Hassan, Musa A.
    Prendergast, James G. D.
    BMC BIOINFORMATICS, 2022, 23 (01)