Optimizing task offloading and resource allocation in edge-cloud networks: a DRL approach

被引:33
作者
Ullah, Ihsan [1 ]
Lim, Hyun-Kyo [2 ]
Seok, Yeong-Jun [2 ]
Han, Youn-Hee [2 ]
机构
[1] Korea Univ Technol & Educ, Adv Technol Res Ctr, Cheonan, South Korea
[2] Korea Univ Technol & Educ, Dept Comp Sci & Engn, Future Convergence Engn, Cheonan, South Korea
来源
JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS | 2023年 / 12卷 / 01期
基金
新加坡国家研究基金会;
关键词
Edge-cloud computing; Task offloading; Resource allocation; Deep Reinforcement learning; Markov decision process (MDP); DEEP; OPTIMIZATION; DEVICES;
D O I
10.1186/s13677-023-00461-3
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Edge-cloud computing is an emerging approach in which tasks are offloaded from mobile devices to edge or cloud servers. However, Task offloading may result in increased energy consumption and delays, and the decision to offload the task is dependent on various factors such as time-varying radio channels, available computation resources, and the location of devices. As edge-cloud computing is a dynamic and resource-constrained environment, making optimal offloading decisions is a challenging task. This paper aims to optimize offloading and resource allocation to minimize delay and meet computation and communication needs in edge-cloud computing. The problem of optimizing task offloading in the edge-cloud computing environment is a multi-objective problem, for which we employ deep reinforcement learning to find the optimal solution. To accomplish this, we formulate the problem as a Markov decision process and use a Double Deep Q-Network (DDQN) algorithm. Our DDQN-edge-cloud (DDQNEC) scheme dynamically makes offloading decisions by analyzing resource utilization, task constraints, and the current status of the edge-cloud network. Simulation results demonstrate that DDQNEC outperforms heuristic approaches in terms of resource utilization, task offloading, and task rejection.
引用
收藏
页数:15
相关论文
共 38 条
[1]   Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA [J].
Alfakih, Taha ;
Hassan, Mohammad Mehedi ;
Gumaei, Abdu ;
Savaglio, Claudio ;
Fortino, Giancarlo .
IEEE ACCESS, 2020, 8 :54074-54084
[2]   Joint Multi-Task Offloading and Resource Allocation for Mobile Edge Computing Systems in Satellite IoT [J].
Chai, Furong ;
Zhang, Qi ;
Yao, Haipeng ;
Xin, Xiangjun ;
Gao, Ran ;
Guizani, Mohsen .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (06) :7783-7795
[3]   A DRL Agent for Jointly Optimizing Computation Offloading and Resource Allocation in MEC [J].
Chen, Juan ;
Xing, Huanlai ;
Xiao, Zhiwen ;
Xu, Lexi ;
Tao, Tao .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (24) :17508-17524
[4]   Dynamic Computation Offloading With Energy Harvesting Devices: A Graph-Based Deep Reinforcement Learning Approach [J].
Chen, Juan ;
Wu, Zongling .
IEEE COMMUNICATIONS LETTERS, 2021, 25 (09) :2968-2972
[5]   A novel deep policy gradient action quantization for trusted collaborative computation in intelligent vehicle networks [J].
Chen, Miaojiang ;
Yi, Meng ;
Huang, Mingfeng ;
Huang, Guosheng ;
Ren, Yingying ;
Liu, Anfeng .
EXPERT SYSTEMS WITH APPLICATIONS, 2023, 221
[6]   GPDS: A multi-agent deep reinforcement learning game for anti-jamming secure computing in MEC network [J].
Chen, Miaojiang ;
Liu, Wei ;
Zhang, Ning ;
Li, Junling ;
Ren, Yingying ;
Yi, Meng ;
Liu, Anfeng .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
[7]   A game-based deep reinforcement learning approach for energy-efficient computation in MEC systems [J].
Chen, Miaojiang ;
Liu, Wei ;
Wang, Tian ;
Zhang, Shaobo ;
Liu, Anfeng .
KNOWLEDGE-BASED SYSTEMS, 2022, 235
[8]   DDPG-based intelligent rechargeable fog computation offloading for IoT [J].
Chen, Siguang ;
Ge, Xinwei ;
Wang, Qian ;
Miao, Yifeng ;
Ruan, Xiukai .
WIRELESS NETWORKS, 2022, 28 (07) :3293-3304
[9]   Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning [J].
Chen, Xianfu ;
Zhang, Honggang ;
Wu, Celimuge ;
Mao, Shiwen ;
Ji, Yusheng ;
Bennis, Mehdi .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4005-4018
[10]   Decentralized computation offloading for multi-user mobile edge computing: a deep reinforcement learning approach [J].
Chen, Zhao ;
Wang, Xiaodong .
EURASIP JOURNAL ON WIRELESS COMMUNICATIONS AND NETWORKING, 2020, 2020 (01)