Using Machine Learning to Predict the Exact Resource Usage of Microservice Chains

被引:0
|
作者
Taheri, Javid [1 ,2 ]
Gorden, Arvid [1 ]
Al-Dulaimy, Auday [3 ,4 ]
机构
[1] Karlstad Univ, Karlstad, Sweden
[2] Queens Univ Belfast, Belfast, Antrim, North Ireland
[3] Malardalen Univ, Vasteras, Sweden
[4] Dalarna Univ, Falun, Sweden
来源
16TH IEEE/ACM INTERNATIONAL CONFERENCE ON UTILITY AND CLOUD COMPUTING, UCC 2023 | 2023年
关键词
Cloud computing; Resource management; Auto-scaling; Kubernetes; Microservice; Machine learning;
D O I
10.1145/3603166.3632166
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Cloud computing offers a wide range of services, but it comes with some challenges. One of these challenges is to predict the resource utilization of the nodes that run applications and services. This is especially relevant for container-based platforms such as Kubernetes. Predicting the resource utilization of a Kubernetes cluster can help optimize the performance, reliability, and cost-effectiveness of the platform. This paper focuses on how well different resources in a cluster can be predicted using machine learning techniques. The approach consists of three main steps: data collection and extraction, data pre-processing and analysis, and resource prediction. The data collection step involves stressing the system with a load-generator (called Locust) and collecting data from Locust and Kubernetes with the use of Prometheus. The data pre-processing and extraction step involves extracting relevant data and transforming it into a suitable format for the machine learning models. The final step involves applying different machine learning models to the data and evaluating their accuracy. The results illustrate that different machine learning techniques can predict resources accurately.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Facilitating and Managing Machine Learning and Data Analysis Tasks in Big Data Environments using Web and Microservice Technologies
    Shahoud, Shadi
    Gunnarsdottir, Sonja
    Khalloof, Hatem
    Duepmeier, Clemens
    Hagenmeyer, Veit
    11TH INTERNATIONAL CONFERENCE ON MANAGEMENT OF DIGITAL ECOSYSTEMS (MEDES), 2019, : 80 - 87
  • [22] A Machine Learning Approach to Service Discovery for Microservice Architectures
    Caporuscio, Mauro
    De Toma, Marco
    Muccini, Henry
    Vaidhyanathan, Karthik
    SOFTWARE ARCHITECTURE, ECSA 2021, 2021, 12857 : 66 - 82
  • [23] USING MACHINE LEARNING TO PREDICT REALIZED VARIANCE
    Carr, Peter
    Wu, Liuren
    Zhang, Zhibai
    JOURNAL OF INVESTMENT MANAGEMENT, 2020, 18 (02): : 57 - 72
  • [24] Using Machine Learning to Predict Enthalpy of Solvation
    Brandon J. Jaquis
    Ailin Li
    Nolan D. Monnier
    Robert G. Sisk
    William E. Acree
    Andrew S. I. D. Lang
    Journal of Solution Chemistry, 2019, 48 : 564 - 573
  • [25] A Microservice Based Architecture Topology for Machine Learning Deployment
    Ribeiro, Jose Lucas
    Figueredo, Mickael
    Araujo, Adelson
    Cacho, Nelio
    Lopes, Frederico
    2019 5TH IEEE INTERNATIONAL SMART CITIES CONFERENCE (IEEE ISC2 2019), 2019, : 426 - 431
  • [26] An Efficient Model to Predict Network Packets in TVDC Using Machine Learning
    Duggal, Ashmeet Kaur
    Dave, Meenu
    JOURNAL OF ADVANCES IN INFORMATION TECHNOLOGY, 2023, 14 (03) : 523 - 531
  • [27] A Horizontal Tuning Framework for Machine Learning Algorithms Using a Microservice-based Architecture
    Oprea, Simona-Vasilica
    Bara, Adela
    Dobria , Gabriela
    Barbu, Dragos-Catalin
    STUDIES IN INFORMATICS AND CONTROL, 2023, 32 (03): : 31 - 43
  • [28] Using machine learning techniques to predict ammonium concentration in membrane contactors for nitrogen recovery as a valuable resource
    Aguado, D.
    Noriega-Hevia, G.
    Serralta, J.
    Seco, A.
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [29] Using machine learning to predict catastrophes in dynamical systems
    Berwald, Jesse
    Gedeon, Tomas
    Sheppard, John
    JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2012, 236 (09) : 2235 - 2245
  • [30] Resource Usage and Performance Trade-offs for Machine Learning Models in Smart Environments
    Preuveneers, Davy
    Tsingenopoulos, Ilias
    Joosen, Wouter
    SENSORS, 2020, 20 (04)