Deep Reinforcement Learning for Time-Energy Tradeoff Online Offloading in MEC-Enabled Industrial Internet of Things

被引:17
作者
Jiao, Xianlong [1 ]
Ou, Hongjun [1 ]
Chen, Shiguang [1 ]
Guo, Songtao [1 ]
Qu, Yuben [2 ,3 ]
Xiang, Chaocan [1 ]
Shang, Jiaxing [1 ]
机构
[1] Chongqing Univ, Coll Comp Sci, Chongqing 400044, Peoples R China
[2] Minist Ind & Informat Technol, Key Lab Dynam Cognit Syst Electromagnet Spectrum S, Beijing 211106, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Coll Elect & Informat Engn, Nanjing 211106, Peoples R China
来源
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING | 2023年 / 10卷 / 06期
基金
中国国家自然科学基金;
关键词
Deep reinforcement learning; industrial Internet of Things; mobile edge computing; online offloading; time-energy tradeoff; COMPUTATION RATE MAXIMIZATION; EDGE; OPTIMIZATION;
D O I
10.1109/TNSE.2023.3263169
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Mobile edge computing (MEC) has recently emerged as a promising technology to boost the integration ability of sensing, transmission and computation in industrial Internet of Things (IIoT). This paper investigates an MEC-enabled IIoT system, where multiple industrial devices may offload computation-intensive tasks to an edge server through wireless communication. We focus on the online offloading problem to optimize the tradeoff of the task accomplishing time and energy consumption. Time-varying wireless channels, random targeted task data sizes and dynamically changing residual energy as well as adaptively adjusted tradeoff weights make this problem highly challenging. Conventional optimization methods may lead to inefficient or even infeasible solutions. To efficiently tackle this problem, we leverage the deep reinforcement learning (DRL) technology to propose a time-energy tradeoff online offloading algorithm called TETO. In TETO, the online offloading decision policies are empirically learned via a well-designed DRL framework. TETO algorithm incorporates a stochastic strategy, the crossover and mutation technology and a novel feasible suboptimal offloading method to expand the offloading action search space with the provable feasibility guarantee. Extensive experimental results based on a real-world dataset show that, our TETO algorithm performs better than existing baseline algorithms, and obtains near-optimal performance with low CPU execution latency.
引用
收藏
页码:3465 / 3479
页数:15
相关论文
共 45 条
[1]   Lyapunov-Guided Deep Reinforcement Learning for Stable Online Computation Offloading in Mobile-Edge Computing Networks [J].
Bi, Suzhi ;
Huang, Liang ;
Wang, Hui ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2021, 20 (11) :7519-7537
[2]   Joint Optimization of Service Caching Placement and Computation Offloading in Mobile Edge Computing Systems [J].
Bi, Suzhi ;
Huang, Liang ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (07) :4947-4963
[3]   Computation Rate Maximization for Wireless Powered Mobile-Edge Computing With Binary Computation Offloading [J].
Bi, Suzhi ;
Zhang, Ying Jun .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2018, 17 (06) :4177-4190
[4]   QoS-Aware Resource Bargaining for Federated Learning Over Edge Networks in Industrial IoT [J].
Chakraborty, Aishwariya ;
Misra, Sudip .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2023, 10 (05) :2769-2778
[5]   Edge Intelligence for Energy-Efficient Computation Offloading and Resource Allocation in 5G Beyond [J].
Dai, Yueyue ;
Zhang, Ke ;
Maharjan, Sabita ;
Zhang, Yan .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2020, 69 (10) :12175-12186
[6]   Intelligent Delay-Aware Partial Computing Task Offloading for Multiuser Industrial Internet of Things Through Edge Computing [J].
Deng, Xiaoheng ;
Yin, Jian ;
Guan, Peiyuan ;
Xiong, Neal N. ;
Zhang, Lan ;
Mumtaz, Shahid .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (04) :2954-2966
[7]   Computation Offloading and Resource Allocation in Vehicular Networks Based on Dual-Side Cost Minimization [J].
Du, Jianbo ;
Yu, F. Richard ;
Chu, Xiaoli ;
Feng, Jie ;
Lu, Guangyue .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (02) :1079-1092
[8]   Edge Intelligence-Driven Joint Offloading and Resource Allocation for Future 6G Industrial Internet of Things [J].
Gong, Yongkang ;
Yao, Haipeng ;
Wang, Jingjing ;
Li, Maozhen ;
Guo, Song .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2024, 11 (06) :5644-5655
[9]   Intelligent VNF Orchestration and Flow Scheduling via Model-Assisted Deep Reinforcement Learning [J].
Gu, Lin ;
Zeng, Deze ;
Li, Wei ;
Guo, Song ;
Zomaya, Albert Y. ;
Jin, Hai .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2020, 38 (02) :279-291
[10]   Energy-Efficient Dynamic Computation Offloading and Cooperative Task Scheduling in Mobile Cloud Computing [J].
Guo, Songtao ;
Liu, Jiadi ;
Yang, Yuanyuan ;
Xiao, Bin ;
Li, Zhetao .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2019, 18 (02) :319-333