Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment

被引:0
作者
Yiwei Zhang
Min Zhang
Caixia Fan
Fuqiang Li
Baofang Li
机构
[1] Henan Agricultural University,College of Sciences
[2] State Grid Henan Skills Training Center,undefined
来源
EURASIP Journal on Advances in Signal Processing | / 2021卷
关键词
Internet of Vehicles; Mobile edge computing; Reinforcement learning; Experience replay method; Resource allocation; Offloading strategy;
D O I
暂无
中图分类号
学科分类号
摘要
With the emergence and development of 5G technology, Mobile Edge Computing (MEC) has been closely integrated with Internet of Vehicles (IoV) technology, which can effectively support and improve network performance in IoV. However, the high-speed mobility of vehicles and diversity of communication quality make computing task offloading strategies more complex. To solve the problem, this paper proposes a computing resource allocation scheme based on deep reinforcement learning network for mobile edge computing scenarios in IoV. Firstly, the task resource allocation model for IoV in corresponding edge computing scenario is determined regarding the computing capacity of service nodes and vehicle moving speed as constraints. Besides, the mathematical model for task offloading and resource allocation is established with the minimum total computing cost as objective function. Then, deep Q-learning network based on deep reinforcement learning network is proposed to solve the mathematical model of resource allocation. Moreover, experience replay method is used to solve the instability of nonlinear approximate function neural network, which can avoid falling into dimension disaster and ensure the low-overhead and low-latency operation requirements of resource allocation. Finally, simulation results show that proposed scheme can effectively allocate the computing resources of IoV in edge computing environment. When the number of user uploaded data is 10K bits and the number of terminals is 15, it still shows the excellent network performance of low-overhead and low-latency.
引用
收藏
相关论文
共 50 条
[21]   Deep Multiagent Reinforcement Learning for Task Offloading and Resource Allocation in Satellite Edge Computing [J].
Jia, Min ;
Zhang, Liang ;
Wu, Jian ;
Guo, Qing ;
Zhang, Guowei ;
Gu, Xuemai .
IEEE INTERNET OF THINGS JOURNAL, 2025, 12 (04) :3832-3845
[22]   User Allocation in Mobile Edge Computing: A Deep Reinforcement Learning Approach [J].
Panda, Subrat Prasad ;
Banerjee, Ansuman ;
Bhattacharya, Arani .
2021 IEEE INTERNATIONAL CONFERENCE ON WEB SERVICES, ICWS 2021, 2021, :447-458
[23]   Security computing resource allocation based on deep reinforcement learning in serverless multi-cloud edge computing [J].
Zhang, Hang ;
Wang, Jinsong ;
Zhang, Hongwei ;
Bu, Chao .
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2024, 151 :152-161
[24]   Multi-Agent Deep Reinforcement Learning-Based Partial Task Offloading and Resource Allocation in Edge Computing Environment [J].
Ke, Hongchang ;
Wang, Hui ;
Sun, Hongbin .
ELECTRONICS, 2022, 11 (15)
[25]   Intelligent Resource Allocation in IoV Using Deep Reinforcement Learning to Minimize Latency [J].
Fofana, Namory ;
Ben Letaifa, Asma ;
Rachedi, Abderrezak .
2024 20TH INTERNATIONAL CONFERENCE ON WIRELESS AND MOBILE COMPUTING, NETWORKING AND COMMUNICATIONS, WIMOB, 2024,
[26]   Deep Reinforcement Learning With Dueling DQN for Partial Computation Offloading and Resource Allocation in Mobile Edge Computing [J].
Mustafa, Ehzaz ;
Shuja, Junaid ;
Rehman, Faisal ;
Namoun, Abdallah ;
Ali, Mazhar ;
Alourani, Abdullah .
IEEE ACCESS, 2025, 13 :94319-94335
[27]   Offloading and Resource Allocation With General Task Graph in Mobile Edge Computing: A Deep Reinforcement Learning Approach [J].
Yan, Jia ;
Bi, Suzhi ;
Zhang, Ying-Jun Angela .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (08) :5404-5419
[28]   Deep Reinforcement Learning Based Edge Computing Network Aided Resource Allocation Algorithm for Smart Grid [J].
Chi, Yingying ;
Zhang, Yi ;
Liu, Yong ;
Zhu, Hailong ;
Zheng, Zhe ;
Liu, Rui ;
Zhang, Peiying .
IEEE ACCESS, 2023, 11 :6541-6550
[29]   Green Heterogeneous Computing Powers Allocation Using Reinforcement Learning in SDN-IoV [J].
Liu, Yingjie ;
Wang, Dan ;
Song, Bin ;
Du, Xiaojiang .
IEEE TRANSACTIONS ON GREEN COMMUNICATIONS AND NETWORKING, 2023, 7 (02) :983-995
[30]   Federated deep reinforcement learning for task offloading and resource allocation in mobile edge computing-assisted vehicular networks [J].
Zhao, Xu ;
Wu, Yichuan ;
Zhao, Tianhao ;
Wang, Feiyu ;
Li, Maozhen .
JOURNAL OF NETWORK AND COMPUTER APPLICATIONS, 2024, 229