TacNet: A Tactic-Interactive Resource Allocation Method for Vehicular Networks

被引:5
作者
Fu, Xiaoyuan [1 ]
Yuan, Quan [1 ]
Zhuang, Zirui [1 ]
Li, Yang [1 ]
Liao, Jianxin [1 ]
Zhao, Dongmei [2 ]
机构
[1] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[2] McMaster Univ, Dept Elect & Comp Engn, Hamilton, ON L8S 4K1, Canada
来源
IEEE INTERNET OF THINGS JOURNAL | 2024年 / 11卷 / 08期
关键词
Resource management; Decision making; Quality of service; Training; Task analysis; Vehicle-to-infrastructure; Vehicle dynamics; Digital twin (DT); multiagent deep reinforcement learning (MADRL); resource allocation; vehicular networks; REINFORCEMENT; VEHICLES; COLLECTION;
D O I
10.1109/JIOT.2023.3345853
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To support safety driving and various on-board services, efficient resource allocation is crucial for the promising implement of vehicle platooning in intelligent transportation systems (ITSs). The resource allocation of vehicle-to-everything (V2X) communications for vehicular platoons is studied in this article. First, a multiobjective function is formulated to jointly optimize sub-band and power allocation to satisfy Quality-of- Service (QoS) in vehicular networks. With the advantage of dealing with complex decision-making problems in multiagent systems, distributed multiagent deep reinforcement learning (MADRL) stands out for resource allocation of vehicular networks. However, it faces the challenge of cooperation aging when every agent is only learning from information of others to form a cooperation model in the training process. Considering the random and dynamic combination of vehicles in vehicle platooning, a tactic-interactive MADRL method named as TacNet is then proposed to improve the cooperation efficiency of multiple agents. In TacNet, the tactics of other agents will be encoded and transmitted through interactive communications among agents. In addition, with the development of vehicular edge computing (VEC), digital twin (DT) networks are constructed to assist offloading computation-intensive resource allocation tasks in vehicles to the edge. The superiority of the proposed method is verified through extensive simulation results, which refers to convergence and performance of satisfying diversified QoS requirements compared with state-of-the-art MADRL methods.
引用
收藏
页码:14370 / 14382
页数:13
相关论文
共 41 条
  • [1] Ackermann J, 2019, Arxiv, DOI arXiv:1910.01465
  • [2] Performance Enhancement of C-V2X Mode 4 with Balanced Resource Allocation
    Ali, Moin
    Hwang, Hyundong
    Kim, Young-Tak
    [J]. IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 2750 - 2755
  • [3] Collaborative Caching Strategy for RL-Based Content Downloading Algorithm in Clustered Vehicular Networks
    Bi, Xiaodan
    Zhao, Lian
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (11) : 9585 - 9596
  • [4] Task-Efficiency Oriented V2X Communications: Digital Twin Meets Mobile Edge Computing
    Cai, Guoqiang
    Fan, Bo
    Dong, Yiwei
    Li, Tongfei
    Wu, Yuan
    Zhang, Yan
    [J]. IEEE WIRELESS COMMUNICATIONS, 2024, 31 (02) : 149 - 155
  • [5] ACP-Based Energy-Efficient Schemes for Sustainable Intelligent Transportation Systems
    Chen, Jicheng
    Zhang, Yongkang
    Teng, Siyu
    Chen, Yuanyuan
    Zhang, Hui
    Wang, Fei-Yue
    [J]. IEEE TRANSACTIONS ON INTELLIGENT VEHICLES, 2023, 8 (05): : 3224 - 3227
  • [6] Ubiquitous Control Over Heterogeneous Vehicles: A Digital Twin Empowered Edge AI Approach
    Fan, Bo
    Su, Zixun
    Chen, Yanyan
    Wu, Yuan
    Xu, Chengzhong
    Quek, Tony Q. S.
    [J]. IEEE WIRELESS COMMUNICATIONS, 2023, 30 (01) : 166 - 173
  • [7] Joint C-V2X Based Offloading and Resource Allocation in Multi-Tier Vehicular Edge Computing System
    Feng, Weiyang
    Lin, Siyu
    Zhang, Ning
    Wang, Gongpu
    Ai, Bo
    Cai, Lin
    [J]. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (02) : 432 - 445
  • [8] Joint Offloading Scheduling and Resource Allocation in Vehicular Edge Computing: A Two Layer Solution
    Gao, Jian
    Kuang, Zhufang
    Gao, Jie
    Zhao, Lian
    [J]. IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (03) : 3999 - 4009
  • [9] Age of Information, Latency, and Reliability in Intelligent Vehicular Networks
    Guo, Chongtao
    Wang, Xijun
    Liang, Le
    Li, Geoffrey Ye
    [J]. IEEE NETWORK, 2023, 37 (06): : 109 - 116
  • [10] FIVE DISRUPTIVE TECHNOLOGIES IN 6G TO SUPPORT DIGITAL TWIN NETWORKS
    Guo, Qi
    Tang, Fengxiao
    Rodrigues, Tiago Koketsu
    Kato, Nei
    [J]. IEEE WIRELESS COMMUNICATIONS, 2024, 31 (01) : 149 - 155