Deep Reinforcement Learning-Based Task Offloading and Resource Allocation for Industrial IoT in MEC Federation System

被引:14
作者
Do, Huong Mai [1 ]
Tran, Tuan Phong
Yoo, Myungsik [2 ]
机构
[1] Soongsil Univ, Dept Informat Commun Convergence Technol, Seoul, South Korea
[2] Soongsil Univ, Sch Elect Engn, Seoul, South Korea
关键词
~MEC federation; IIoT; task offloading; resource allocation; Markov decision process; deep reinforcement learning; NETWORKS; INTERNET;
D O I
10.1109/ACCESS.2023.3302518
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The rapid growth of the Internet of Things (IoT) has resulted in the development of intelligent industrial systems known as Industrial IoT (IIoT). These systems integrate smart devices, sensors, cameras, and 5G technologies to enable automated data gathering and analysis boost production efficiency and overcome scalability issues. However, IoT devices have limited computer power, memory, and battery capacities. To address these challenges, mobile edge computing (MEC) has been introduced to IIoT systems to reduce the computational burden on the devices. While the dedicated MEC paradigm limits optimal resource utilization and load balancing, the MEC federation can potentially overcome these drawbacks. However, previous studies have relied on idealized assumptions when developing optimal models, raising concerns about their practical applicability. In this study, we investigated the joint decision offloading and resource allocation problem for MEC federation in the IIoT. Specifically, an optimization model was constructed based on all real-world factors influencing system performance. To minimize the total energy delay cost, the original problem was transformed into a Markov decision process. Considering task generation dynamics and continuity, we addressed the Markov decision process using a deep reinforcement learning method. We propose a deep deterministic policy gradient algorithm with prioritized experience replay (DDPG-PER)-based resource allocation that can handle high-dimensional continuity of action and state spaces. The simulation results indicate that the proposed approach effectively minimizes the energy-delay costs associated with tasks.
引用
收藏
页码:83150 / 83170
页数:21
相关论文
共 41 条
[1]   Biomedical IoT: Enabling Technologies, Architectural Elements, Challenges, and Future Directions [J].
Aledhari, Mohammed ;
Razzak, Rehma ;
Qolomany, Basheer ;
Al-Fuqaha, Ala ;
Saeed, Fahad .
IEEE ACCESS, 2022, 10 :31306-31339
[2]   Ensemble Technique With Optimal Feature Selection for Saudi Stock Market Prediction: A Novel Hybrid Red Deer-Grey Algorithm [J].
Alotaibi, Saud S. .
IEEE ACCESS, 2021, 9 :64929-64944
[3]   VeSoNet: Traffic-Aware Content Caching for Vehicular Social Networks Using Deep Reinforcement Learning [J].
Aung, Nyothiri ;
Dhelim, Sahraoui ;
Chen, Liming ;
Lakas, Abderrahmane ;
Zhang, Wenyin ;
Ning, Huansheng ;
Chaib, Souleyman ;
Kechadi, Mohand Tahar .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2023, 24 (08) :8638-8649
[4]   Adaptive Performance Modeling Framework for QoS-Aware Offloading in MEC-Based IIoT Systems [J].
Bebortta, Sujit ;
Senapati, Dilip ;
Panigrahi, Chhabi Rani ;
Pati, Bibudhendu .
IEEE INTERNET OF THINGS JOURNAL, 2022, 9 (12) :10162-10171
[5]  
Bertsekas Dimitri, 2021, Data networks
[6]   Task Offloading for Mobile Edge Computing in Software Defined Ultra-Dense Network [J].
Chen, Min ;
Hao, Yixue .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (03) :587-597
[7]   Deep Reinforcement Learning-Based Dynamic Resource Management for Mobile Edge Computing in Industrial Internet of Things [J].
Chen, Ying ;
Liu, Zhiyong ;
Zhang, Yongchao ;
Wu, Yuan ;
Chen, Xin ;
Zhao, Lian .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (07) :4925-4934
[8]   Task Co-Offloading for D2D-Assisted Mobile Edge Computing in Industrial Internet of Things [J].
Dai, Xingxia ;
Xiao, Zhu ;
Jiang, Hongbo ;
Alazab, Mamoun ;
Lui, John C. S. ;
Dustdar, Schahram ;
Liu, Jiangchuan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2023, 19 (01) :480-490
[9]   Intelligent Delay-Aware Partial Computing Task Offloading for Multiuser Industrial Internet of Things Through Edge Computing [J].
Deng, Xiaoheng ;
Yin, Jian ;
Guan, Peiyuan ;
Xiong, Neal N. ;
Zhang, Lan ;
Mumtaz, Shahid .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (04) :2954-2966
[10]   Joint Task Offloading and Resource Allocation for Accuracy-Aware Machine-Learning-Based IIoT Applications [J].
Fan, Wenhao ;
Li, Shenmeng ;
Liu, Jie ;
Su, Yi ;
Wu, Fan ;
Liu, Yuan'An .
IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (04) :3305-3321