Deep Reinforcement Learning for Time-Energy Tradeoff Online Offloading in MEC-Enabled Industrial Internet of Things

被引:17
作者
Jiao, Xianlong [1 ]
Ou, Hongjun [1 ]
Chen, Shiguang [1 ]
Guo, Songtao [1 ]
Qu, Yuben [2 ,3 ]
Xiang, Chaocan [1 ]
Shang, Jiaxing [1 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Dynam Cognit Syst Electromagnet Spectrum S, Beijing 211106, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Coll Elect & Informat Engn, Nanjing 211106, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 06期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; industrial Internet of Things; mobile edge computing; online offloading; time-energy tradeoff; COMPUTATION RATE MAXIMIZATION; EDGE; OPTIMIZATION;
D O I
10.1109/TNSE.2023.3263169
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Mobile edge computing (MEC) has recently emerged as a promising technology to boost the integration ability of sensing, transmission and computation in industrial Internet of Things (IIoT). This paper investigates an MEC-enabled IIoT system, where multiple industrial devices may offload computation-intensive tasks to an edge server through wireless communication. We focus on the online offloading problem to optimize the tradeoff of the task accomplishing time and energy consumption. Time-varying wireless channels, random targeted task data sizes and dynamically changing residual energy as well as adaptively adjusted tradeoff weights make this problem highly challenging. Conventional optimization methods may lead to inefficient or even infeasible solutions. To efficiently tackle this problem, we leverage the deep reinforcement learning (DRL) technology to propose a time-energy tradeoff online offloading algorithm called TETO. In TETO, the online offloading decision policies are empirically learned via a well-designed DRL framework. TETO algorithm incorporates a stochastic strategy, the crossover and mutation technology and a novel feasible suboptimal offloading method to expand the offloading action search space with the provable feasibility guarantee. Extensive experimental results based on a real-world dataset show that, our TETO algorithm performs better than existing baseline algorithms, and obtains near-optimal performance with low CPU execution latency.
引用
收藏
页码:3465 / 3479
页数:15
相关论文
共 45 条
[21]   Human-level control through deep reinforcement learning [J].
Mnih, Volodymyr ;
Kavukcuoglu, Koray ;
Silver, David ;
Rusu, Andrei A. ;
Veness, Joel ;
Bellemare, Marc G. ;
Graves, Alex ;
Riedmiller, Martin ;
Fidjeland, Andreas K. ;
Ostrovski, Georg ;
Petersen, Stig ;
Beattie, Charles ;
Sadik, Amir ;
Antonoglou, Ioannis ;
King, Helen ;
Kumaran, Dharshan ;
Wierstra, Daan ;
Legg, Shane ;
Hassabis, Demis .
NATURE, 2015, 518 (7540) :529-533
[22]   Towards Online Privacy-preserving Computation Offloading in Mobile Edge Computing [J].
Pang, Xiaoyi ;
Wang, Zhibo ;
Li, Jingxin ;
Zhou, Ruiting ;
Ren, Ju ;
Li, Zhetao .
IEEE CONFERENCE ON COMPUTER COMMUNICATIONS (IEEE INFOCOM 2022), 2022, :1179-1188
[23]   NOMA Assisted Multi-Task Multi-Access Mobile Edge Computing via Deep Reinforcement Learning for Industrial Internet of Things [J].
Qian, Liping ;
Wu, Yuan ;
Jiang, Fuli ;
Yu, Ningning ;
Lu, Weidang ;
Lin, Bin .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (08) :5688-5698
[24]   Latency Minimization for D2D-Enabled Partial Computation Offloading in Mobile Edge Computing [J].
Saleem, Umber ;
Liu, Yu ;
Jangsher, Sobia ;
Tao, Xiaoming ;
Li, Yong .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (04) :4472-4486
[25]   Trueno: A Cross-Platform Machine Learning Model Serving Framework in Heterogeneous Edge Systems [J].
Song, Danyang ;
Zhu, Yifei ;
Zhang, Cong ;
Liu, Jiangchuan .
IEEE INFOCOM 2022 - IEEE CONFERENCE ON COMPUTER COMMUNICATIONS WORKSHOPS (INFOCOM WKSHPS), 2022,
[26]   Joint Optimization of Edge Computing Server Deployment and User Offloading Associations in Wireless Edge Network via a Genetic Algorithm [J].
Song, Heekang ;
Gu, Bonjun ;
Son, Kyungrak ;
Choi, Wan .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04) :2535-2548
[27]  
Sun HR, 2017, IEEE INT WORK SIGN P
[28]   Resource Management for Computation Offloading in D2D-Aided Wireless Powered Mobile-Edge Computing Networks [J].
Sun, Mengying ;
Xu, Xiaodong ;
Huang, Yuzhen ;
Wu, Qihui ;
Tao, Xiaofeng ;
Zhang, Ping .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (10) :8005-8020
[29]   Offloading in Mobile Edge Computing: Task Allocation and Computational Frequency Scaling [J].
Thinh Quang Dinh ;
Tang, Jianhua ;
La, Quang Duy ;
Quek, Tony Q. S. .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2017, 65 (08) :3571-3584
[30]   Optimal Energy Allocation and Task Offloading Policy for Wireless Powered Mobile Edge Computing Systems [J].
Wang, Feng ;
Xu, Jie ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (04) :2443-2459