A resource allocation strategy for internet of vehicles using reinforcement learning in edge computing environment

被引:1
作者
Li, Yihong [1 ]
Liu, Zhengli [2 ]
Tao, Qi [3 ]
机构
[1] Zhaoqing Univ, Sch Comp Sci & Software, Sch Big Data, Zhaoqing 526000, Guangdong, Peoples R China
[2] Wuhan Univ, Sch Comp Sci, Wuhan 430000, Hubei, Peoples R China
[3] Wuhan Univ, Sch Cyber Sci & Engn, Wuhan 430000, Hubei, Peoples R China
关键词
Edge cloud computing; Reinforcement learning; Internet of vehicles; Resource allocation strategy; Double deep Q network model; Network delay; Computing energy consumption; TASK OFFLOADING STRATEGY; FOG; ARCHITECTURE;
D O I
10.1007/s00500-022-07544-4
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Because the traditional computing model can no longer meet the particularity of Internet of Vehicles tasks, aiming at its characteristics of high bandwidth, low latency and high reliability, this paper proposes a resource allocation strategy for Internet of Vehicles using reinforcement learning in edge cloud computing environment. First, a multi-layer resource allocation model for Internet of Vehicles is proposed, which uses the cooperation mode of edge cloud computing servers and roadside units to dynamically coordinate edge computing and content caching. Then, based on the construction of communication model, calculation model and cache model, make full use of idle resources in Internet of Vehicles to minimize network delay under the condition of limited energy consumption. Finally, the optimization goal is solved by two-layer deep Q network model, and the best resource allocation plan is obtained. The simulation results based on the Internet of Vehicles model show that the computational energy consumption and system delay of proposed strategy do not exceed 400 J and 600 ms, respectively. Besides, the overall effect of resource allocation is better than other comparison strategies and it has certain application prospects.
引用
收藏
页码:3999 / 4009
页数:11
相关论文
共 26 条
[1]   Task Offloading and Resource Allocation for Mobile Edge Computing by Deep Reinforcement Learning Based on SARSA [J].
Alfakih, Taha ;
Hassan, Mohammad Mehedi ;
Gumaei, Abdu ;
Savaglio, Claudio ;
Fortino, Giancarlo .
IEEE ACCESS, 2020, 8 :54074-54084
[2]   Survey on the Internet of Vehicles: Network Architectures and Applications [J].
Ji B. ;
Zhang X. ;
Mumtaz S. ;
Han C. ;
Li C. ;
Wen H. ;
Wang D. .
IEEE Communications Standards Magazine, 2020, 4 (01) :34-41
[3]   Utility Aware Offloading for Mobile-Edge Computing [J].
Bi, Ran ;
Liu, Qian ;
Ren, Jiankang ;
Tan, Guozhen .
TSINGHUA SCIENCE AND TECHNOLOGY, 2021, 26 (02) :239-250
[4]  
Cayamcela Manuel Eugenio Morocho, 2020, [The Journal of Korean Institute of Communications and Information Sciences, 한국통신학회논문지], V45, P622, DOI 10.7840/kics.2020.45.3.622
[5]   Green Internet of Vehicles: Architecture, Enabling Technologies, and Applications [J].
Chen, Handi ;
Zhao, Tingting ;
Li, Chengming ;
Guo, Yi .
IEEE ACCESS, 2019, 7 :179185-179198
[6]   ARTIFICIAL INTELLIGENCE EMPOWERED EDGE COMPUTING AND CACHING FOR INTERNET OF VEHICLES [J].
Dai, Yueyue ;
Xu, Du ;
Maharjan, Sabita ;
Qiao, Guanhua ;
Zhang, Yan .
IEEE WIRELESS COMMUNICATIONS, 2019, 26 (03) :12-18
[7]   Peace: Privacy-Preserving and Cost-Efficient Task Offloading for Mobile-Edge Computing [J].
He, Xiaofan ;
Jin, Richeng ;
Dai, Huaiyu .
IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2020, 19 (03) :1814-1824
[8]   Energy-Efficient Task Offloading for Time-Sensitive Applications in Fog Computing [J].
Jiang, Yu-Lin ;
Chen, Ya-Shu ;
Yang, Su-Wei ;
Wu, Chia-Hsueh .
IEEE SYSTEMS JOURNAL, 2019, 13 (03) :2930-2941
[9]   Advanced Deep Learning-Based Computational Offloading for Multilevel Vehicular Edge-Cloud Computing Networks [J].
Khayyat, Mashael ;
Elgendy, Ibrahim A. ;
Muthanna, Ammar ;
Alshahrani, Abdullah S. ;
Alharbi, Soltan ;
Koucheryavy, Andrey .
IEEE ACCESS, 2020, 8 :137052-137062
[10]   Self-Adaptive Power Control with Deep Reinforcement Learning for Millimeter-Wave Internet-of-Vehicles Video Caching [J].
Kwon, Dohyun ;
Kim, Joongheon ;
Mohaisen, David A. ;
Lee, Wonjun .
JOURNAL OF COMMUNICATIONS AND NETWORKS, 2020, 22 (04) :326-337