Multi-Agent Task Assignment in Vehicular Edge Computing: A Regret-Matching Learning-Based Approach

被引:3
|
作者
Nguyen, Bach Long [1 ]
Nguyen, Duong D. [2 ]
Nguyen, Hung X. [2 ]
Ngo, Duy T. [3 ]
Wagner, Markus [1 ]
机构
[1] Monash Univ, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[3] Univ Newcastle, Sch Engn, Callaghan, NSW 2308, Australia
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 02期
基金
澳大利亚研究理事会;
关键词
Correlated equilibrium; intelligent transportation systems; multi-agent learning; regret matching; task assignment; vehicular edge computing; REINFORCEMENT; EQUILIBRIUM; COMPLEXITY; MIGRATION; VEHICLES;
D O I
10.1109/TETCI.2023.3339540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicular edge computing has emerged as a solution for enabling computation-intensive applications within Intelligent Transportation Systems (ITS), encompassing domains like autonomous driving and augmented reality. Despite notable progress in this domain, the efficient allocation of constrained computational resources to a spectrum of time-critical ITS tasks remains a substantial challenge. We address this challenge by devising an innovative task assignment scheme tailored for vehicles navigating a highway. Given the high speed of vehicles and the limited communication radius of roadside units (RSUs), the dynamic migration of computation tasks among multiple servers becomes imperative. We present a novel approach that formulates the task assignment challenge as a binary nonlinear programming (BNLP) problem, managing the allocation of computation tasks from vehicles to RSUs and a macrocell base station. To tackle the potentially large dimensionality of this optimization problem, we develop a distributed multi-agent regret-matching learning algorithm. Incorporating the method of regret minimization, our proposed algorithm employs a forgetting mechanism that enables a continuous learning process, thereby accommodating the high mobility of vehicle networks. We prove that this algorithm converges towards correlated equilibrium solutions for our BNLP formulation. Extensive simulations, grounded in practical parameter settings, underscore the algorithm's ability to minimize total delay and task processing costs, while ensuring equitable utility distribution among agents.
引用
收藏
页码:1527 / 1539
页数:13
相关论文
共 50 条
  • [21] A dynamic task assignment model for aviation emergency rescue based on multi-agent reinforcement learning
    Shen, Yang
    Wang, Xianbing
    Wang, Huajun
    Guo, Yongchen
    Chen, Xiang
    Han, Jiaqi
    JOURNAL OF SAFETY SCIENCE AND RESILIENCE, 2023, 4 (03): : 284 - 293
  • [22] Computation Task Assignment in Vehicular Fog Computing: A Learning Approach via Neighbor Advice
    Rejiba, Zeineb
    Masip-Bruin, Xavier
    Marin-Tordera, Eva
    2019 IEEE 18TH INTERNATIONAL SYMPOSIUM ON NETWORK COMPUTING AND APPLICATIONS (NCA), 2019, : 376 - 380
  • [23] Road Side Unit-Assisted Learning-Based Partial Task Offloading for Vehicular Edge Computing System
    Li, Song
    Sun, Weibin
    Ni, Qiang
    Sun, Yanjing
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2024, 73 (04) : 5546 - 5555
  • [24] Task Assignment in Mobile Edge Computing Networks: A Deep Reinforcement Learning Approach
    Feng, Mingjie
    Zhao, Qi
    Sullivan, Nichole
    Chen, Genshe
    Pham, Khanh
    Blasch, Erik
    SENSORS AND SYSTEMS FOR SPACE APPLICATIONS XIV, 2021, 11755
  • [25] Decentralized Task Assignment for Mobile Crowdsensing With Multi-Agent Deep Reinforcement Learning
    Xu, Chenghao
    Song, Wei
    IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (18) : 16564 - 16578
  • [26] Computation Resource Allocation and Task Assignment Optimization in Vehicular Fog Computing: A Contract-Matching Approach
    Zhou, Zhenyu
    Liu, Pengju
    Feng, Junhao
    Zhang, Yan
    Mumtaz, Shahid
    Rodriguez, Jonathan
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2019, 68 (04) : 3113 - 3125
  • [27] A Deep Reinforcement Learning-Based Resource Management Game in Vehicular Edge Computing
    Zhu, Xiaoyu
    Luo, Yueyi
    Liu, Anfeng
    Xiong, Neal N.
    Dong, Mianxiong
    Zhang, Shaobo
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (03) : 2422 - 2433
  • [28] Multi-objective task offloading for highly dynamic heterogeneous Vehicular Edge Computing: An efficient reinforcement learning approach
    Huang, Zhidong
    Wu, Xiaofei
    Dong, ShouBin
    COMPUTER COMMUNICATIONS, 2024, 225 : 27 - 43
  • [29] Cooperative task assignment in spatial crowdsourcing via multi-agent deep reinforcement learning?
    Zhao, Pengcheng
    Li, Xiang
    Gao, Shang
    Wei, Xiaohui
    JOURNAL OF SYSTEMS ARCHITECTURE, 2022, 128
  • [30] Task assignment strategy in LEO-muti-access edge computing based on matching game
    Haoyu Wang
    Jianwei An
    Hao Zhou
    Computing, 2023, 105 : 1571 - 1596