Reinforcement Learning Enabled Dynamic Resource Allocation in the Internet of Vehicles

被引:34
|
作者
Liang, Hongbin [1 ,2 ]
Zhang, Xiaohui [3 ,4 ]
Hong, Xintao [5 ,6 ]
Zhang, Zongyuan [7 ]
Li, Mushu [8 ]
Hu, Guangdi [9 ]
Hou, Fen [10 ,11 ]
机构
[1] Southwest Jiaotong Univ, Sch Transportat & Logist, Natl United Engn Lab Integrated & Intelligent Tra, Chengdu 611756, Peoples R China
[2] Southwest Jiaotong Univ, Natl Engn Lab Integrated Trans Portat Big Data Ap, Chengdu 611756, Peoples R China
[3] Nanjing NARI Informat & Commun Technol Co Ltd, Nanjing 210000, Peoples R China
[4] Southwest Jiaotong Univ, Sch Informat Sci & Technol, Chengdu 611756, Peoples R China
[5] Chengdu Technol Univ, Sch Econ & Management, Chengdu 611756, Peoples R China
[6] Southwest Jiaotong Univ, Sch Econ & Management, Chengdu 611756, Peoples R China
[7] Beijing Univ Technol, Fac Sci, Beijing 100124, Peoples R China
[8] Univ Waterloo, Dept Elect & Comp Engn, Waterloo, ON N2L 3G1, Canada
[9] Southwest Jiaotong Univ, Automot Res Inst, Chengdu 611756, Peoples R China
[10] Univ Macau, State Key Lab IoT Smart City, Macau, Peoples R China
[11] Univ Macau, Dept Elect & Comp Engn, Macau, Peoples R China
基金
中国国家自然科学基金;
关键词
Resource management; Computational modeling; Cloud computing; Learning (artificial intelligence); Vehicle dynamics; Dynamic scheduling; Hierarchical architecture; Internet of Vehicles (IoV); reinforcement learning; resource allocation; semi-Markov decision process (SMDP); VEHICULAR NETWORKS; CHANNEL ASSIGNMENT; SPECTRUM; FRAMEWORK;
D O I
10.1109/TII.2020.3019386
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an important application scenario of the industrial Internet of things, the Internet of Vehicles can significantly improve road safety, improve traffic management efficiency, and improve people's travel experience. Due to the high dynamics of the Internet of vehicles environment, the traditional resource optimization technologies cannot meet the requirements of the Internet of vehicles for dynamic communication, computing and storage resources optimization management, and artificial intelligence algorithms can adaptively obtain dynamic resource allocation schemes through self-learning. Therefore, adopting artificial intelligence techniques to optimize the dynamic resource of the Internet of Vehicles is the research focus of this article. In this article, we first model the Internet of Vehicles resource allocation problem as a semi-Markov decision process that introduces a resource reservation strategy and a secondary resource allocation mechanism. Then, the reinforcement learning algorithm is used to solve the model. Thereafter, it theoretically analyzes the joint optimization of computing and communication resources, models it as a hierarchical architecture, and uses hierarchical reinforcement learning to obtain the optimal system resource allocation plan. Finally, the results of simulation experiments show that the dynamic resource allocation scheme of the Internet of vehicles based on the reinforcement learning in this article greatly improve resource utilization and user quality of experience with guaranteeing system quality of service compared with the traditional greedy algorithm.
引用
收藏
页码:4957 / 4967
页数:11
相关论文
共 50 条
  • [1] Resource Allocation Strategy of Internet of Vehicles Using Reinforcement Learning
    Xi, Hongqi
    Sun, Huijuan
    JOURNAL OF INFORMATION PROCESSING SYSTEMS, 2022, 18 (03): : 443 - 456
  • [2] MEC-enabled resource allocation in Internet of Vehicles
    Xiao, Yijing
    Zhao, Junhui
    Zhang, Qingmiao
    Huang, Yuwen
    Quan, Haoyu
    Fan, Lisheng
    PHYSICAL COMMUNICATION, 2024, 65
  • [3] Multi-Agent Reinforcement Learning for Efficient Resource Allocation in Internet of Vehicles
    Wang, Jun-Han
    He, He
    Cha, Jaesang
    Jeong, Incheol
    Ahn, Chang-Jun
    ELECTRONICS, 2025, 14 (01):
  • [4] A resource allocation strategy for internet of vehicles using reinforcement learning in edge computing environment
    Li, Yihong
    Liu, Zhengli
    Tao, Qi
    SOFT COMPUTING, 2023, 27 (07) : 3999 - 4009
  • [5] A resource allocation strategy for internet of vehicles using reinforcement learning in edge computing environment
    Yihong Li
    Zhengli Liu
    Qi Tao
    Soft Computing, 2023, 27 : 3999 - 4009
  • [6] Deep Reinforcement Learning Based Dynamic Content Placement and Bandwidth Allocation in Internet of Vehicles
    Ma, Teng
    Chen, Xin
    Ma, Zhuo
    Jiao, Libo
    WIRELESS ALGORITHMS, SYSTEMS, AND APPLICATIONS, WASA 2021, PT III, 2021, 12939 : 244 - 253
  • [7] Adaptive Resource Allocation for Mobile Edge Computing in Internet of Vehicles: A Deep Reinforcement Learning Approach
    Zhao, Junhui
    Quan, Haoyu
    Xia, Minghua
    Wang, Dongming
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5834 - 5848
  • [8] Optimal Resource Allocation for Integrated Sensing and Communications in Internet of Vehicles: A Deep Reinforcement Learning Approach
    Liu, Congcong
    Xia, Minghua
    Zhao, Junhui
    Li, Huaicheng
    Gong, Yi
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (02) : 3028 - 3038
  • [9] A reinforcement learning approach to dynamic resource allocation
    Vengerov, David
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2007, 20 (03) : 383 - 390
  • [10] Multiagent Federated Reinforcement Learning for Resource Allocation in UAV-Enabled Internet of Medical Things Networks
    Seid, Abegaz Mohammed
    Erbad, Aiman
    Abishu, Hayla Nahom
    Albaseer, Abdullatif
    Abdallah, Mohamed
    Guizani, Mohsen
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (22) : 19695 - 19711