Multiobjective Edge Server Placement in Mobile-Edge Computing Using a Combination of Multiagent Deep Q-Network and Coral Reefs Optimization

被引:14
作者
Asghari, Ali [1 ]
Sohrabi, Mohammad Karim [2 ]
机构
[1] Shafagh Inst Higher Educ, Dept Comp Engn, Tonekabon 4683165363, Iran
[2] Islamic Azad Univ, Semnan Branch, Dept Comp Engn, Semnan 3513137111, Iran
关键词
Access latency; deep Q-network (DQN); load balancing; mobile-edge computing (MEC); server placement; SERVICE PLACEMENT; IOT;
D O I
10.1109/JIOT.2022.3161950
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The growth of telecommunication technologies, especially 5G, the growing popularity of smart mobile devices, the emergence of smart cities and Internet of Things (IoT), and the easy use of these equipments have led the cloud users to utilize their various services. Real-time applications and the use of big data have caused cloud service providers (CSPs) to move their servers to the edge of the network and in the vicinity of users to maintain the quality of their services. For this purpose, the concept of mobile-edge computing (MEC) was formed. Applications often have heavy computing complexity on mobile devices or require a lot of data to process. Moreover, in order to save energy consumption of the batteries of this equipment, offloading them on the network resources can transfer the computational complexity from the users' equipment to the network resources. The resource placement (RP) is one of the major challenges in this area. Improper resource topology upsets their load balancing and increases access latency. In the proposed method of this article, the cellular mobile network is divided into smaller areas and using the coral reefs optimization (CRO) algorithm, the optimal placement of resources in each of these areas will be locally performed. The deep Q-network (DQN) and Markov game (MG) are used to optimize global RP to reduce global latency and to improve resource load balancing as its two objectives. The results of the experiments show that the proposed method has significantly improved its objectives and server's energy efficiency, compared to some similar works in this area.
引用
收藏
页码:17503 / 17512
页数:10
相关论文
共 42 条
  • [1] Mobile Edge Computing: Opportunities, solutions, and challenges
    Ahmed, Ejaz
    Rehmani, Mubashir Husain
    [J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2017, 70 : 59 - 63
  • [2] Akherfi Khadija, 2018, Applied Computing and Informatics, V14, P1, DOI 10.1016/j.aci.2016.11.002
  • [3] Deep Reinforcement Learning A brief survey
    Arulkumaran, Kai
    Deisenroth, Marc Peter
    Brundage, Miles
    Bharath, Anil Anthony
    [J]. IEEE SIGNAL PROCESSING MAGAZINE, 2017, 34 (06) : 26 - 38
  • [4] Combined use of coral reefs optimization and multi-agent deep Q-network for energy-aware resource provisioning in cloud data centers using DVFS technique
    Asghari, Ali
    Sohrabi, Mohammad Karim
    [J]. CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2022, 25 (01): : 119 - 140
  • [5] Combined use of coral reefs optimization and reinforcement learning for improving resource utilization and load balancing in cloud environments
    Asghari, Ali
    Sohrabi, Mohammad Karim
    [J]. COMPUTING, 2021, 103 (07) : 1545 - 1567
  • [6] A cloud resource management framework for multiple online scientific workflows using cooperative reinforcement learning agents
    Asghari, Ali
    Sohrabi, Mohammad Karim
    Yaghmaee, Farzin
    [J]. COMPUTER NETWORKS, 2020, 179 (179)
  • [7] Task scheduling, resource provisioning, and load balancing on scientific workflows using parallel SARSA reinforcement learning agents and genetic algorithm
    Asghari, Ali
    Sohrabi, Mohammad Karim
    Yaghmaee, Farzin
    [J]. JOURNAL OF SUPERCOMPUTING, 2021, 77 (03) : 2800 - 2828
  • [8] Online scheduling of dependent tasks of cloud's workflows to enhance resource utilization and reduce the makespan using multiple reinforcement learning-based agents
    Asghari, Ali
    Sohrabi, Mohammad Karim
    Yaghmaee, Farzin
    [J]. SOFT COMPUTING, 2020, 24 (21) : 16177 - 16199
  • [9] A survey on fog computing for the Internet of Things
    Bellavista, Paolo
    Berrocal, Javier
    Corradi, Antonio
    Das, Sajal K.
    Foschini, Luca
    Zanni, Alessandro
    [J]. PERVASIVE AND MOBILE COMPUTING, 2019, 52 : 71 - 99
  • [10] Beraldi R, 2017, 2017 SECOND INTERNATIONAL CONFERENCE ON FOG AND MOBILE EDGE COMPUTING (FMEC), P94, DOI 10.1109/FMEC.2017.7946414