Deep reinforcement learning-based dynamical task offloading for mobile edge computing

被引:2
作者
Xie, Bo [1 ]
Cui, Haixia [1 ]
机构
[1] South China Normal Univ, Sch Elect Sci & Engn, Sch Microelect, Foshan 528225, Peoples R China
基金
中国国家自然科学基金;
关键词
Task offloading; Energy consumption; Latency; Edge computing; Deep reinforcement learning; AWARE;
D O I
10.1007/s11227-024-06603-x
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
Edge computing holds considerable potential to augment the efficiency of computational and energy resources in mobile edge computing (MEC) through the application of task offloading technology. Task offloading involves the delegation of multiple tasks, generated by devices with limited resources, to an edge server or other devices equipped with enhanced capabilities, which facilitates more efficient processing times and energy utilization. This paper addresses significant challenges in MEC environments, particularly the issue of inaccurately perceived task rewards due to queuing delays in task offloading, which adversely affects the performance of deep reinforcement learning (DRL) strategies. We introduce the reward-aware proximal policy optimization (RAPPO) algorithm, which is specifically designed to enhance the accuracy of reward perception by refining data sampling methods. This adjustment enables RAPPO to accurately associate rewards with their respective tasks despite inherent delays, thereby enhancing decision-making and improving overall system performance in dynamic and uncertain environments. Simulation results demonstrate that the proposed algorithm achieves competitive performance compared to existing baseline schemes.
引用
收藏
页数:26
相关论文
共 29 条
[1]   Delay-Aware and Energy-Efficient Computation Offloading in Mobile-Edge Computing Using Deep Reinforcement Learning [J].
Ale, Laha ;
Zhang, Ning ;
Fang, Xiaojie ;
Chen, Xianfu ;
Wu, Shaohua ;
Li, Longzhuang .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2021, 7 (03) :881-892
[2]   Stable Online Computation Offloading via Lyapunov-guided Deep Reinforcement Learning [J].
Bi, Suzhi ;
Huang, Liang ;
Wang, Hui ;
Zhang, Ying-Jun Angela .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2021), 2021,
[3]   Reliability-Aware Personalized Deployment of Approximate Computation IoT Applications in Serverless Mobile Edge Computing [J].
Cao, Kun ;
Chen, Mingsong ;
Karnouskos, Stamatis ;
Hu, Shiyan .
IEEE TRANSACTIONS ON COMPUTER-AIDED DESIGN OF INTEGRATED CIRCUITS AND SYSTEMS, 2025, 44 (02) :430-443
[4]   Dynamic Resource Allocation and Computation Offloading for IoT Fog Computing System [J].
Chang, Zheng ;
Liu, Liqing ;
Guo, Xijuan ;
Sheng, Quan .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2021, 17 (05) :3348-3357
[5]  
Chen MH, 2017, IEEE INFOCOM SER
[6]   Deep reinforcement learning for computation offloading in mobile edge computing environment [J].
Chen, Miaojiang ;
Wang, Tian ;
Zhang, Shaobo ;
Liu, Anfeng .
COMPUTER COMMUNICATIONS, 2021, 175 (175) :1-12
[7]   Partial Computation Offloading in NOMA-Assisted Mobile-Edge Computing Systems Using Deep Reinforcement Learning [J].
Dat, Van Tuong ;
Truong, Thanh Phung ;
Nguyen, The-Vi ;
Noh, Wonjong ;
Cho, Sungrae .
IEEE INTERNET OF THINGS JOURNAL, 2021, 8 (17) :13196-13208
[8]   Distributed Machine Learning for Multiuser Mobile Edge Computing Systems [J].
Guo, Yinghao ;
Zhao, Rui ;
Lai, Shiwei ;
Fan, Lisheng ;
Lei, Xianfu ;
Karagiannidis, George K. .
IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2022, 16 (03) :460-473
[9]   Deep Reinforcement Learning-Based Task Assignment for Cooperative Mobile Edge Computing [J].
Hsieh, Li-Tse ;
Liu, Hang ;
Guo, Yang ;
Gazda, Robert .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2024, 23 (04) :3156-3171
[10]  
Khot V., 2023, 2023 INT C NETW MULT, P1, DOI [10.1109/NMITCON58196.2023.10275998, DOI 10.1109/NMITCON58196.2023.10275998]