RLPRAF: Reinforcement Learning-Based Proactive Resource Allocation Framework for Resource Provisioning in Cloud Environment

被引:1
作者
Panwar, Reena [1 ]
Supriya, M. [1 ]
机构
[1] Amrita Vishwa Vidyapeetham, Amrita Sch Comp, Dept Comp Sci & Engn, Bengaluru 560035, India
关键词
Resource allocation; resource provisioning; autonomic computing systems; machine learning; reinforcement learning; virtual machines; COMPUTING ENVIRONMENT; SERVICE;
D O I
10.1109/ACCESS.2024.3421956
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Recent developments in cloud technology enable one to dynamically deploy heterogeneous resources as and when needed. This dynamic nature of the incoming workload causes fluctuations in the cloud environment, which is currently addressed using traditional reactive scaling techniques. Simple reactive approaches affect elastic system performance either by over-provisioning resources which significantly increases the cost, or by under-provisioning, which leads to starvation. Hence automated resource provisioning becomes an effective method to deal with such workload fluctuations. The aforementioned problems can also be resolved by using intelligent resource provisioning techniques by dynamically assigning required resources while adapting to the environment. In this paper, a reinforcement learning-based proactive resource allocation framework (RLPRAF) is proposed. This framework simultaneously learns the environment and distributes the resources. The proposed work presents a paradigm for the optimal allocation of resources by merging the notions of automatic computation, linear regression, and reinforcement learning. When tested with real-time workloads, the proposed RLPRAF method surpasses previous auto-scaling algorithms considering CPU usage, response time, and throughput. Finally, a set of tests demonstrate that the suggested strategy lowers overall expense by 30% and SLA violation by 77.7%. Furthermore, it converges at an optimum timing and demonstrates that it is feasible for a wide range of real-world service-based cloud applications.
引用
收藏
页码:95986 / 96007
页数:22
相关论文
共 51 条
[1]   A Reinforcement Learning Approach to Reduce Serverless Function Cold Start Frequency [J].
Agarwal, Siddharth ;
Rodriguez, Maria A. ;
Buyya, Rajkumar .
21ST IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2021), 2021, :797-803
[2]  
Anilkumar S, 2017, PROCEEDINGS OF 2017 INTERNATIONAL CONFERENCE ON TECHNOLOGICAL ADVANCEMENTS IN POWER AND ENERGY (TAP ENERGY): EXPLORING ENERGY SOLUTIONS FOR AN INTELLIGENT POWER GRID
[3]  
Bao YX, 2019, IEEE INFOCOM SER, P505, DOI [10.1109/infocom.2019.8737460, 10.1109/INFOCOM.2019.8737460]
[4]   An autonomic resource provisioning framework for efficient data collection in cloudlet-enabled wireless body area networks: a fuzzy-based proactive approach [J].
Bhardwaj, Tushar ;
Sharma, Subhash Chander .
SOFT COMPUTING, 2019, 23 (20) :10361-10383
[5]   Fuzzy logic-based elasticity controller for autonomic resource provisioning in parallel scientific applications: A cloud computing perspective [J].
Bhardwaj, Tushar ;
Sharma, Subhash Chander .
COMPUTERS & ELECTRICAL ENGINEERING, 2018, 70 :1049-1073
[6]   An Efficient Elasticity Mechanism for Server-Based Pervasive Healthcare Applications in Cloud Environment [J].
Bhardwaj, Tushar ;
Sharma, Subhash Chander .
2017 IEEE 19TH INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPUTING AND COMMUNICATIONS WORKSHOPS (HPCCWS): MULTICORE AND MULTITHREADED ARCHITECTURES AND ALGORITHMS (M2A2 2017), 2017, :66-69
[7]  
Buyya R., 2013, Mastering Cloud Computing: Foundations and Applications Programming
[8]  
Calheiros R. N., 2011, 2011 International Conference on Parallel Processing, P295, DOI 10.1109/ICPP.2011.17
[9]   CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms [J].
Calheiros, Rodrigo N. ;
Ranjan, Rajiv ;
Beloglazov, Anton ;
De Rose, Cesar A. F. ;
Buyya, Rajkumar .
SOFTWARE-PRACTICE & EXPERIENCE, 2011, 41 (01) :23-50
[10]  
Cheng MX, 2018, ASIA S PACIF DES AUT, P129, DOI 10.1109/ASPDAC.2018.8297294