Dependency-Aware Dynamic Task Offloading Based on Deep Reinforcement Learning in Mobile-Edge Computing

被引:15
作者
Fang, Juan [1 ]
Qu, Dezheng [1 ]
Chen, Huijie [1 ]
Liu, Yaqi [1 ]
机构
[1] Beijing Univ Technol, Fac Informat Technol, Beijing 100124, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT | 2024年 / 21卷 / 02期
基金
中国国家自然科学基金;
关键词
Task analysis; Servers; Mobile handsets; Heuristic algorithms; Reinforcement learning; Costs; Deep learning; Mobile edge computing; task offloading; optimization algorithm; deep reinforcement learning; RESOURCE-ALLOCATION; OPTIMIZATION; FRAMEWORK;
D O I
10.1109/TNSM.2023.3319294
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid advancement of mobile edge computing (MEC) networks has enabled the augmentation of the computational power of mobile devices (MDs) by offloading computationally intensive tasks to resource-rich edge nodes. This paper discusses the decision-making process for task offloading and resource allocation among multiple mobile devices connected to a base station. The primary objective is to minimize the time taken to complete tasks while simultaneously reducing energy consumption on the device under a time-varying wireless fading channel. This objective is formulated as an energy-efficiency cost (EEC) minimization problem, which cannot be solved by conventional methods. To address this challenge, we propose a dynamic offloading decision algorithm of dependent tasks (DODA-DT) that adjusts local task execution based on edge node status. The proposed algorithm facilitates fair competition among all devices for edge resources. Additionally, we use a deep reinforcement learning (DRL) algorithm based on an actor-critic learning structure to train the system to quickly identify near-optimal solutions. Numerical simulations demonstrate that the proposed algorithm effectively reduces the total cost of the task in comparison to previous algorithms.
引用
收藏
页码:1403 / 1415
页数:13
相关论文
共 33 条
[1]   Dynamic Task Offloading and Scheduling for Low-Latency IoT Services in Multi-Access Edge Computing [J].
Alameddine, Hyame Assem ;
Sharafeddine, Sanaa ;
Sebbah, Samir ;
Ayoubi, Sara ;
Assi, Chadi .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2019, 37 (03) :668-682
[2]   Delay-Aware and Energy-Efficient Computation Offloading in Mobile-Edge Computing Using Deep Reinforcement Learning [J].
Ale, Laha ;
Zhang, Ning ;
Fang, Xiaojie ;
Chen, Xianfu ;
Wu, Shaohua ;
Li, Longzhuang .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (03) :881-892
[3]  
[Anonymous], Ericsson Mobility Report Q4 Update February 2022
[4]   UAV Assisted Cooperative Caching on Network Edge Using Multi-Agent Actor-Critic Reinforcement Learning [J].
Araf, Sadman ;
Saha, Adittya Soukarjya ;
Kazi, Sadia Hamid ;
Tran, Nguyen H. H. ;
Alam, Md. Golam Rabiul .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (02) :2322-2337
[5]   Dynamic Priority-Based Computation Scheduling and Offloading for Interdependent Tasks: Leveraging Parallel Transmission and Execution [J].
Chai, Rong ;
Li, Mingzhu ;
Yang, Tiantian ;
Chen, Qianbin .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (10) :10970-10985
[6]   Optimized Computation Offloading Performance in Virtual Edge Computing Systems via Deep Reinforcement Learning [J].
Chen, Xianfu ;
Zhang, Honggang ;
Wu, Celimuge ;
Mao, Shiwen ;
Ji, Yusheng ;
Bennis, Mehdi .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4005-4018
[7]  
cisco, Cisco and SAS edge-to-enterprise IoT analytics platform
[8]   IoT Application Modules Placement and Dynamic Task Processing in Edge-Cloud Computing [J].
Fang, Juan ;
Ma, Aonan .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (16) :12771-12781
[9]   Energy-Efficient Dynamic Computation Offloading and Cooperative Task Scheduling in Mobile Cloud Computing [J].
Guo, Songtao ;
Liu, Jiadi ;
Yang, Yuanyuan ;
Xiao, Bin ;
Li, Zhetao .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (02) :319-333
[10]   Dynamic Task Offloading in Multi-Agent Mobile Edge Computing Networks [J].
Heydari, Javad ;
Ganapathy, Viswanath ;
Shah, Mohak .
2019 IEEE GLOBAL COMMUNICATIONS CONFERENCE (GLOBECOM), 2019,