Deep Reinforcement Learning for Time-Energy Tradeoff Online Offloading in MEC-Enabled Industrial Internet of Things

被引:17
作者
Jiao, Xianlong [1 ]
Ou, Hongjun [1 ]
Chen, Shiguang [1 ]
Guo, Songtao [1 ]
Qu, Yuben [2 ,3 ]
Xiang, Chaocan [1 ]
Shang, Jiaxing [1 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Dynam Cognit Syst Electromagnet Spectrum S, Beijing 211106, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Coll Elect & Informat Engn, Nanjing 211106, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 06期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; industrial Internet of Things; mobile edge computing; online offloading; time-energy tradeoff; COMPUTATION RATE MAXIMIZATION; EDGE; OPTIMIZATION;
D O I
10.1109/TNSE.2023.3263169
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Mobile edge computing (MEC) has recently emerged as a promising technology to boost the integration ability of sensing, transmission and computation in industrial Internet of Things (IIoT). This paper investigates an MEC-enabled IIoT system, where multiple industrial devices may offload computation-intensive tasks to an edge server through wireless communication. We focus on the online offloading problem to optimize the tradeoff of the task accomplishing time and energy consumption. Time-varying wireless channels, random targeted task data sizes and dynamically changing residual energy as well as adaptively adjusted tradeoff weights make this problem highly challenging. Conventional optimization methods may lead to inefficient or even infeasible solutions. To efficiently tackle this problem, we leverage the deep reinforcement learning (DRL) technology to propose a time-energy tradeoff online offloading algorithm called TETO. In TETO, the online offloading decision policies are empirically learned via a well-designed DRL framework. TETO algorithm incorporates a stochastic strategy, the crossover and mutation technology and a novel feasible suboptimal offloading method to expand the offloading action search space with the provable feasibility guarantee. Extensive experimental results based on a real-world dataset show that, our TETO algorithm performs better than existing baseline algorithms, and obtains near-optimal performance with low CPU execution latency.
引用
收藏
页码:3465 / 3479
页数:15
相关论文
共 45 条
[31]   Joint Offloading and Computing Optimization in Wireless Powered Mobile-Edge Computing Systems [J].
Wang, Feng ;
Xu, Jie ;
Wang, Xin ;
Cui, Shuguang .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (03) :1784-1797
[32]   Edge-Based Communication Optimization for Distributed Federated Learning [J].
Wang, Tian ;
Liu, Yan ;
Zheng, Xi ;
Dai, Hong-Ning ;
Jia, Weijia ;
Xie, Mande .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (04) :2015-2024
[33]   Dynamic Edge Computation Offloading for Internet of Things With Energy Harvesting: A Learning Method [J].
Wei, Ziling ;
Zhao, Baokang ;
Su, Jinshu ;
Lu, Xicheng .
IEEE INTERNET OF THINGS JOURNAL, 2019, 6 (03) :4436-4447
[34]  
Wen YG, 2012, IEEE INFOCOM SER, P2716, DOI 10.1109/INFCOM.2012.6195685
[35]   A Complex Image Reduction Technique Using Genetic Algorithm for the MoM Solution of Half-Space MPIE [J].
Wu, Bi-Yi ;
Sheng, Xin-Qing .
IEEE TRANSACTIONS ON ANTENNAS AND PROPAGATION, 2015, 63 (08) :3727-3731
[36]   Reusing Delivery Drones for Urban Crowdsensing [J].
Xiang, Chaocan ;
Zhou, Yanlin ;
Dai, Haipeng ;
Qu, Yuben ;
He, Suining ;
Chen, Chao ;
Yang, Panlong .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2023, 22 (05) :2972-2988
[37]   Edge Computing-Empowered Large-Scale Traffic Data Recovery Leveraging Low-Rank Theory [J].
Xiang, Chaocan ;
Zhang, Zhao ;
Qu, Yuben ;
Lu, Dongyu ;
Fan, Xiaochen ;
Yang, Panlong ;
Wu, Fan .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2020, 7 (04) :2205-2218
[38]   Energy-Latency Tradeoff for Dynamic Computation Offloading in Vehicular Fog Computing [J].
Yadav, Rahul ;
Zhang, Weizhe ;
Kaiwartya, Omprakash ;
Song, Houbing ;
Yu, Shui .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (12) :14198-14211
[39]   Optimal Task Offloading and Resource Allocation in Mobile-Edge Computing With Inter-User Task Dependency [J].
Yan, Jia ;
Bi, Suzhi ;
Zhang, Ying Jun ;
Tao, Meixia .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (01) :235-250
[40]   Resource Management at the Network Edge: A Deep Reinforcement Learning Approach [J].
Zeng, Deze ;
Gu, Lin ;
Pan, Shengli ;
Cai, Jingjing ;
Guo, Song .
IEEE NETWORK, 2019, 33 (03) :26-33