Multi-Agent Task Assignment in Vehicular Edge Computing: A Regret-Matching Learning-Based Approach

被引:3
|
作者
Nguyen, Bach Long [1 ]
Nguyen, Duong D. [2 ]
Nguyen, Hung X. [2 ]
Ngo, Duy T. [3 ]
Wagner, Markus [1 ]
机构
[1] Monash Univ, Dept Data Sci & AI, Clayton, Vic 3800, Australia
[2] Univ Adelaide, Sch Comp Sci, Adelaide, SA 5005, Australia
[3] Univ Newcastle, Sch Engn, Callaghan, NSW 2308, Australia
来源
IEEE TRANSACTIONS ON EMERGING TOPICS IN COMPUTATIONAL INTELLIGENCE | 2024年 / 8卷 / 02期
基金
澳大利亚研究理事会;
关键词
Correlated equilibrium; intelligent transportation systems; multi-agent learning; regret matching; task assignment; vehicular edge computing; REINFORCEMENT; EQUILIBRIUM; COMPLEXITY; MIGRATION; VEHICLES;
D O I
10.1109/TETCI.2023.3339540
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Vehicular edge computing has emerged as a solution for enabling computation-intensive applications within Intelligent Transportation Systems (ITS), encompassing domains like autonomous driving and augmented reality. Despite notable progress in this domain, the efficient allocation of constrained computational resources to a spectrum of time-critical ITS tasks remains a substantial challenge. We address this challenge by devising an innovative task assignment scheme tailored for vehicles navigating a highway. Given the high speed of vehicles and the limited communication radius of roadside units (RSUs), the dynamic migration of computation tasks among multiple servers becomes imperative. We present a novel approach that formulates the task assignment challenge as a binary nonlinear programming (BNLP) problem, managing the allocation of computation tasks from vehicles to RSUs and a macrocell base station. To tackle the potentially large dimensionality of this optimization problem, we develop a distributed multi-agent regret-matching learning algorithm. Incorporating the method of regret minimization, our proposed algorithm employs a forgetting mechanism that enables a continuous learning process, thereby accommodating the high mobility of vehicle networks. We prove that this algorithm converges towards correlated equilibrium solutions for our BNLP formulation. Extensive simulations, grounded in practical parameter settings, underscore the algorithm's ability to minimize total delay and task processing costs, while ensuring equitable utility distribution among agents.
引用
收藏
页码:1527 / 1539
页数:13
相关论文
共 50 条
  • [41] Multi-agent policy learning-based path planning for autonomous mobile robots
    Zhang, Lixiang
    Cai, Ze
    Yan, Yan
    Yang, Chen
    Hu, Yaoguang
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [42] Deep Reinforcement Learning-Based Adaptive Computation Offloading and Power Allocation in Vehicular Edge Computing Networks
    Qiu, Bin
    Wang, Yunxiao
    Xiao, Hailin
    Zhang, Zhongshan
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (10) : 13339 - 13349
  • [43] Value-based reinforcement learning approaches for task offloading in Delay Constrained Vehicular Edge Computing
    Do Bao Son
    Ta Huu Binh
    Vo, Hiep Khac
    Binh Minh Nguyen
    Huynh Thi Thanh Binh
    Yu, Shui
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2022, 113
  • [44] A collaborative computation and dependency-aware task offloading method for vehicular edge computing: a reinforcement learning approach
    Liu, Guozhi
    Dai, Fei
    Huang, Bi
    Qiang, Zhenping
    Wang, Shuai
    Li, Lecheng
    JOURNAL OF CLOUD COMPUTING-ADVANCES SYSTEMS AND APPLICATIONS, 2022, 11 (01):
  • [45] A collaborative computation and dependency-aware task offloading method for vehicular edge computing: a reinforcement learning approach
    Guozhi Liu
    Fei Dai
    Bi Huang
    Zhenping Qiang
    Shuai Wang
    Lecheng Li
    Journal of Cloud Computing, 11
  • [46] Partial observation learning-based task offloading and spectrum allocation in UAV collaborative edge computing
    Fan, Chaoqiong
    Wu, Xinyu
    Li, Bin
    Zhao, Chenglin
    DIGITAL COMMUNICATIONS AND NETWORKS, 2024, 10 (06) : 1635 - 1643
  • [47] A Distributed Deep Reinforcement Learning-based Optimization Scheme for Vehicle Edge Computing Task Offloading
    Li, Bingxian
    Zhu, Lin
    Tan, Long
    PROCEEDINGS OF THE 2024 27 TH INTERNATIONAL CONFERENCE ON COMPUTER SUPPORTED COOPERATIVE WORK IN DESIGN, CSCWD 2024, 2024, : 218 - 223
  • [48] Multi-Agent Reinforcement Learning-Based Passenger Spoofing Attack on Mobility-as-a-Service
    Chu, Kai-Fung
    Guo, Weisi
    IEEE TRANSACTIONS ON DEPENDABLE AND SECURE COMPUTING, 2024, 21 (06) : 5565 - 5581
  • [49] An RSU-crossed dependent task offloading scheme for vehicular edge computing based on deep reinforcement learning
    Bi, Xiang
    Shi, Jianing
    Zhang, Benhong
    Lyu, Zengwei
    Huang, Lingjie
    INTERNATIONAL JOURNAL OF SENSOR NETWORKS, 2023, 41 (04) : 244 - 256
  • [50] A bandwidth-fair migration-enabled task offloading for vehicular edge computing: a deep reinforcement learning approach
    Tang, Chaogang
    Li, Zhao
    Xiao, Shuo
    Wu, Huaming
    Chen, Wei
    CCF TRANSACTIONS ON PERVASIVE COMPUTING AND INTERACTION, 2024, 6 (03) : 255 - 270