Deep-Reinforcement-Learning-Based Joint Optimization of Task Migration and Resource Allocation for Mobile-Edge Computing

被引:0
作者
Li, Juncai [1 ]
Jiang, Qi [1 ]
Leung, Victor C. M. [2 ,3 ]
Ma, Zhuo [1 ]
Abrokwa, Kofi Kwarteng [1 ]
机构
[1] Hefei Univ Technol, Sch Elect Engn & Automat, Hefei 230009, Peoples R China
[2] Shenzhen Univ, Coll Comp Sci & Software Engn, Shenzhen 518060, Peoples R China
[3] Univ British Columbia, Dept Elect & Comp Engn, Vancouver, BC V6T 1Z4, Canada
基金
中国国家自然科学基金;
关键词
Resource management; Multi-access edge computing; Optimization; Internet of Things; Dynamic scheduling; Costs; Cloud computing; Processor scheduling; Markov decision processes; Deep reinforcement learning; Deep reinforcement learning (DRL); Markov decision processes (MDPs); mobile-edge computing; resource allocation; task migration; INTERNET; IOT; MEC;
D O I
10.1109/JIOT.2025.3555503
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Task migration and resource allocation are essential to integrate available resources for improving the efficiency of mobile-edge computing to support various computation-intensive and delay-sensitive Internet of Things applications, which cooperative optimization has yet been well addressed to achieve desirable performance. In this article, a deep reinforcement learning (DRL)-based adaptive cooperative optimization strategy is presented to fill this gap. Task migration and resource allocation are jointly employed to adaptively integrate available resources within cooperative edge nodes for processing various randomly offloaded tasks. The policy optimization to minimize the system cost and task dropout rates is formulated as Markov decision processes. A DRL algorithm that enhances deep deterministic policy gradient with a dual experience pool is proposed to jointly optimize the task migration and resource allocation in unknown stochastic application environments. Simulation experiments have been conducted to evaluate the performance of the presented strategy, and the results illustrate that it increases system rewards by 17.9%-61.5% and reduces task dropout rate by 5.2%-31.3% comparing with benchmarks.
引用
收藏
页码:24431 / 24440
页数:10
相关论文
共 27 条
[1]   Dependency-Aware Computation Offloading for Mobile Edge Computing With Edge-Cloud Cooperation [J].
Chen, Long ;
Wu, Jigang ;
Zhang, Jun ;
Dai, Hong-Ning ;
Long, Xin ;
Yao, Mianyang .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2022, 10 (04) :2451-2468
[2]   DNNOff: Offloading DNN-Based Intelligent IoT Applications in Mobile Edge Computing [J].
Chen, Xing ;
Li, Ming ;
Zhong, Hao ;
Ma, Yun ;
Hsu, Ching-Hsien .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (04) :2820-2829
[3]   Dynamic Task Allocation and Service Migration in Edge-Cloud IoT System Based on Deep Reinforcement Learning [J].
Chen, Yan ;
Sun, Yanjing ;
Wang, Chenyang ;
Taleb, Tarik .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (18) :16742-16757
[4]   Energy Efficient Dynamic Offloading in Mobile Edge Computing for Internet of Things [J].
Chen, Ying ;
Zhang, Ning ;
Zhang, Yongchao ;
Chen, Xin ;
Wu, Wen ;
Shen, Xuemin .
IEEE TRANSACTIONS ON CLOUD COMPUTING, 2021, 9 (03) :1050-1060
[5]   Joint Task Scheduling and Energy Management for Heterogeneous Mobile Edge Computing With Hybrid Energy Supply [J].
Chen, Ying ;
Zhang, Yongchao ;
Wu, Yuan ;
Qi, Lianyong ;
Chen, Xin ;
Shen, Xuemin .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (09) :8419-8429
[6]   On incentivizing resource allocation and task offloading for cooperative edge computing [J].
Chu, Weibo ;
Jia, Xinming ;
Yu, Zhiwen ;
Lui, John C. S. ;
Lin, Yi .
COMPUTER NETWORKS, 2024, 246
[7]   Q-learning based dynamic task scheduling for energy-efficient cloud computing [J].
Ding, Ding ;
Fan, Xiaocong ;
Zhao, Yihuan ;
Kang, Kaixuan ;
Yin, Qian ;
Zeng, Jing .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2020, 108 :361-371
[8]   Machine and Deep Learning for Resource Allocation in Multi-Access Edge Computing: A Survey [J].
Djigal, Hamza ;
Xu, Jia ;
Liu, Linfeng ;
Zhang, Yan .
IEEE COMMUNICATIONS SURVEYS AND TUTORIALS, 2022, 24 (04) :2449-2494
[9]   Meeting the Requirements of Internet of Things: The Promise of Edge Computing [J].
Hazra, Abhishek ;
Kalita, Alakesh ;
Gurusamy, Mohan .
IEEE INTERNET OF THINGS JOURNAL, 2024, 11 (05) :7474-7498
[10]   Energy efficient task scheduling based on deep reinforcement learning in cloud environment: A specialized review [J].
Hou, Huanhuan ;
Jawaddi, Siti Nuraishah Agos ;
Ismail, Azlan .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 151 :214-231