A Local Collaborative Distributed Reinforcement Learning Approach for Resource Allocation in V2X Networks

被引:0
|
作者
Zhang, Yue [1 ]
Tan, Guoping [1 ,2 ]
Zhou, Siyuan [1 ,2 ]
机构
[1] Hohai Univ, Sch Comp & Informat, Nanjing, Peoples R China
[2] Jiangsu Intelligent Transportat & Intelligent Dri, Nanjing, Peoples R China
基金
中国国家自然科学基金;
关键词
V2X; Resource allocation; Local collaboration; Reinforcement learning;
D O I
10.1007/978-3-030-86130-8_35
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this paper, we propose a resource allocation approach for V2X networks based on distributed reinforcement learning with local collaboration. We construct a local collaborative mechanism for sharing information among vehicles. In this model each vehicle is able to obtain the instantaneously information of the environment shared by neighboring vehicles. By adopting proximal policy optimization algorithm, we addressed the issues of the joint allocation of spectrum and transmit power in a distributed manner. The simulation results show that agents can effectively learn an optimized strategy by cooperating with other vehicles in the adjacent area, so as to maximize the ergodic V2I capacity of the whole system while meeting the strict delay limits of the V2V link.
引用
收藏
页码:442 / 454
页数:13
相关论文
共 50 条
  • [21] Spectrum-Energy-Efficient Mode Selection and Resource Allocation for Heterogeneous V2X Networks: A Federated Multi-Agent Deep Reinforcement Learning Approach
    Gui, Jinsong
    Lin, Liyan
    Deng, Xiaoheng
    Cai, Lin
    IEEE-ACM TRANSACTIONS ON NETWORKING, 2024, 32 (03) : 2689 - 2704
  • [22] Joint Resource Allocation for V2X Communications With Multi-Type Mean-Field Reinforcement Learning
    Xu, Yue
    Wu, Xiao
    Tang, Yi
    Shang, Jiaxing
    Zheng, Linjiang
    Zhao, Liang
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024,
  • [23] Resource Allocation for V2X Communications: A Local Search Based 3D Matching Approach
    Wei, Qing
    Sun, Wanlu
    Bai, Bo
    Wang, Li
    Strom, Erik G.
    Song, Mei
    2017 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC), 2017,
  • [24] Multi-agent deep reinforcement learning based resource management in heterogeneous V2X networks
    Junhui Zhao
    Fajin Hu
    Jiahang Li
    Yiwen Nie
    Digital Communications and Networks, 2025, 11 (01) : 182 - 190
  • [25] Multi-agent deep reinforcement learning based resource management in heterogeneous V2X networks
    Zhao, Junhui
    Hu, Fajin
    Li, Jiahang
    Nie, Yiwen
    Digital Communications and Networks, 2025, 11 (01) : 182 - 190
  • [26] An Efficient Deep Reinforcement Learning Based Distributed Channel Multiplexing Framework for V2X Communication Networks
    Hu, Run
    Wang, Xinguo
    Su, Yuyuan
    Yang, Bin
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 154 - 160
  • [27] Learning-Based Resource Allocation for Ultra-Reliable V2X Networks With Partial CSI
    Chai, Guanhua
    Wu, Weihua
    Yang, Qinghai
    Liu, Runzi
    Yu, F. Richard
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (10) : 6532 - 6546
  • [28] Resource Allocation in V2X Networks: From Classical Optimization to Machine Learning-Based Solutions
    Parvini, Mohammad
    Schulz, Philipp
    Fettweis, Gerhard
    IEEE OPEN JOURNAL OF THE COMMUNICATIONS SOCIETY, 2024, 5 : 1958 - 1974
  • [29] Platoon Partition and Resource Allocation for Ultra-Reliable V2X Networks
    Chai, Guanhua
    Wu, Weihua
    Yang, Qinghai
    Qin, Meng
    Wu, Yan
    Yu, F. Richard
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (01) : 147 - 161
  • [30] Deep Reinforcement Learning based Distributed Resource Allocation for V2V Broadcasting
    Ye, Hao
    Li, Geoffrey Ye
    2018 14TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2018, : 440 - 445