Computing resource allocation scheme of IOV using deep reinforcement learning in edge computing environment

被引:35
作者
Zhang, Yiwei [1 ]
Zhang, Min [2 ]
Fan, Caixia [1 ]
Li, Fuqiang [1 ]
Li, Baofang [1 ]
机构
[1] Henan Agr Univ, Coll Sci, Zhengzhou 450002, Henan, Peoples R China
[2] State Grid Henan Skills Training Ctr, Zhengzhou, Henan, Peoples R China
基金
中国国家自然科学基金;
关键词
Internet of Vehicles; Mobile edge computing; Reinforcement learning; Experience replay method; Resource allocation; Offloading strategy; INTELLIGENCE-EMPOWERED EDGE; VEHICULAR NETWORKS; INTERNET; VEHICLES; OPTIMIZATION; TECHNOLOGIES; ARCHITECTURE; SECURITY;
D O I
10.1186/s13634-021-00750-6
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
With the emergence and development of 5G technology, Mobile Edge Computing (MEC) has been closely integrated with Internet of Vehicles (IoV) technology, which can effectively support and improve network performance in IoV. However, the high-speed mobility of vehicles and diversity of communication quality make computing task offloading strategies more complex. To solve the problem, this paper proposes a computing resource allocation scheme based on deep reinforcement learning network for mobile edge computing scenarios in IoV. Firstly, the task resource allocation model for IoV in corresponding edge computing scenario is determined regarding the computing capacity of service nodes and vehicle moving speed as constraints. Besides, the mathematical model for task offloading and resource allocation is established with the minimum total computing cost as objective function. Then, deep Q-learning network based on deep reinforcement learning network is proposed to solve the mathematical model of resource allocation. Moreover, experience replay method is used to solve the instability of nonlinear approximate function neural network, which can avoid falling into dimension disaster and ensure the low-overhead and low-latency operation requirements of resource allocation. Finally, simulation results show that proposed scheme can effectively allocate the computing resources of IoV in edge computing environment. When the number of user uploaded data is 10K bits and the number of terminals is 15, it still shows the excellent network performance of low-overhead and low-latency.
引用
收藏
页数:19
相关论文
共 35 条
[1]   Mobile Edge Computing for Big-Data-Enabled Electric Vehicle Charging [J].
Cao, Yue ;
Song, Houbing ;
Kaiwartya, Omprakash ;
Zhou, Bingpeng ;
Zhuang, Yuan ;
Cao, Yang ;
Zhang, Xu .
IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (03) :150-156
[2]   ARTIFICIAL INTELLIGENCE EMPOWERED EDGE COMPUTING AND CACHING FOR INTERNET OF VEHICLES [J].
Dai, Yueyue ;
Xu, Du ;
Maharjan, Sabita ;
Qiao, Guanhua ;
Zhang, Yan .
IEEE WIRELESS COMMUNICATIONS, 2019, 26 (03) :12-18
[3]   Impact of Non-Orthogonal Multiple Access on the Offloading of Mobile Edge Computing [J].
Ding, Zhiguo ;
Fan, Pingzhi ;
Poor, H. Vincent .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2019, 67 (01) :375-390
[4]   MOBILE EDGE COMPUTING FOR THE INTERNET OF VEHICLES Offloading Framework and Job Scheduling [J].
Feng, Jingyun ;
Liu, Zhi ;
Wu, Celimuge ;
Ji, Yusheng .
IEEE VEHICULAR TECHNOLOGY MAGAZINE, 2019, 14 (01) :28-36
[5]   The Role of 5G Technologies: Challenges in Smart Cities and Intelligent Transportation Systems [J].
Guevara, Leonardo ;
Cheein, Fernando Auat .
SUSTAINABILITY, 2020, 12 (16)
[6]   Security in the Internet of Things Supported by Mobile Edge Computing [J].
He, Daojing ;
Chan, Sammy ;
Guizani, Mohsen .
IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (08) :56-61
[7]   RAVEC: An Optimal Resource Allocation Mechanism in Vehicular MEC Systems [J].
Hong, Gao-Feng ;
Su, Wei ;
Wen, Qi-Li ;
Wu, Peng-Lei .
JOURNAL OF INFORMATION SCIENCE AND ENGINEERING, 2020, 36 (04) :865-878
[8]   Artificial Intelligence-Empowered Edge of Vehicles: Architecture, Enabling Technologies, and Applications [J].
Ji, Hongjing ;
Alfarraj, Osama ;
Tolba, Amr .
IEEE ACCESS, 2020, 8 :61020-61034
[9]   Delay Analysis of Physical-Layer Key Generation in Dynamic Roadside-to-Vehicle Networks [J].
Jin, Rong ;
Du, Xianru ;
Zeng, Kai ;
Huang, Liqun ;
Xiao, Laiyuan ;
Xu, Jing .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2017, 66 (03) :2526-2535
[10]   A Novel Adaptive Resource Allocation Model Based on SMDP and Reinforcement Learning Algorithm in Vehicular Cloud System [J].
Liang, Hongbin ;
Zhang, Xiaohui ;
Zhang, Jin ;
Li, Qizhen ;
Zhou, Shuya ;
Zhao, Lian .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (10) :10018-10029