Resource Allocation for Metaverse Experience Optimization: A Multi-Objective Multi-Agent Evolutionary Reinforcement Learning Approach

被引:0
|
作者
Feng, Lei [1 ]
Jiang, Xiaoyi [1 ]
Sun, Yao [2 ]
Niyato, Dusit [3 ]
Zhou, Yu [1 ]
Gu, Shiyi [1 ]
Yang, Zhixiang [1 ]
Yang, Yang [1 ]
Zhou, Fanqin [1 ]
机构
[1] Beijing Univ Posts & Telecommun BUPT, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] Univ Glasgow, James Watt Sch Engn, Glasgow City, Scotland
[3] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore City, Singapore
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Metaverse; Quality of experience; Delays; Resource management; Optimization; Heuristic algorithms; Rendering (computer graphics); Wireless communication; Energy consumption; Costs; Metaverse experience; multi-objective optimization; resource allocation; Meta-Immersion; energy consumption; VIRTUAL-REALITY; LATENCY;
D O I
10.1109/TMC.2024.3509680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the Metaverse, real-time, concurrent services such as virtual classrooms and immersive gaming require local graphic rendering to maintain low latency. However, the limited processing power and battery capacity of user devices make it challenging to balance Quality of Experience (QoE) and terminal energy consumption. In this paper, we investigate a multi-objective optimization problem (MOP) regarding power control and rendering capacity allocation by formulating it as a multi-objective optimization problem. This problem aims to minimize energy consumption while maximizing Meta-Immersion (MI), a metric that integrates objective network performance with subjective user perception. To solve this problem, we propose a Multi-Objective Multi-Agent Evolutionary Reinforcement Learning with User-Object-Attention (M2ERL-UOA) algorithm. The algorithm employs a prediction-driven evolutionary learning mechanism for multi-agents, coupled with optimized rendering capacity decisions for virtual objects. The algorithm can yield a superior Pareto front that attains the Nash equilibrium. Simulation results demonstrate that the proposed algorithm can generate Pareto fronts, effectively adapts to dynamic user preferences, and significantly reduces decision-making time compared to several benchmarks.
引用
收藏
页码:3473 / 3488
页数:16
相关论文
共 50 条
  • [1] Multi-Agent Deep Reinforcement Learning for Resource Allocation in the Multi-Objective HetNet
    Nie, Hongrui
    Li, Shaosheng
    Liu, Yong
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 116 - 121
  • [2] Multi-Agent Deep Reinforcement Learning based Multi-Objective Resource Optimization in a Distributed Manufacturing System
    Shen, Xinchang
    Tham, Chen-Khong
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [3] Optimization of Resource Allocation for V2X Security Communication Based on Multi-Agent Reinforcement Learning
    Ji, Baofeng
    Dong, Bingyi
    Li, Da
    Wang, Yi
    Yang, Luxi
    Tsimenidis, Charalampos
    Menon, Varun G.
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (02) : 1849 - 1861
  • [4] Multi-Objective Optimization in Disaster Backup with Reinforcement Learning
    Yi, Shanwen
    Qin, Yao
    Wang, Hua
    MATHEMATICS, 2025, 13 (03)
  • [5] A multi-objective multi-agent deep reinforcement learning approach to residential appliance scheduling
    Lu, Junlin
    Mannion, Patrick
    Mason, Karl
    IET SMART GRID, 2022, 5 (04) : 260 - 280
  • [6] A novel multi-objective optimization based multi-agent deep reinforcement learning approach for microgrid resources planning
    Abid, Md. Shadman
    Apon, Hasan Jamil
    Hossain, Salman
    Ahmed, Ashik
    Ahshan, Razzaqul
    Lipu, M. S. Hossain
    APPLIED ENERGY, 2024, 353
  • [7] Multi-Agent Deep Reinforcement Learning-Based Resource Allocation for Cognitive Radio Networks
    Mei, Ruru
    Wang, Zhugang
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2025, 74 (03) : 4744 - 4757
  • [8] Underwater Acoustic MAC Protocol for Multi-Objective Optimization Based on Multi-Agent Reinforcement Learning
    Jiang, Jinfang
    Dong, Yiling
    Han, Guangjie
    Su, Gang
    DRONES, 2025, 9 (02)
  • [9] Multi-objective optimization of truss structure using multi-agent reinforcement learning and graph representation
    Kupwiwat, Chi-tathon
    Hayashi, Kazuki
    Ohsaki, Makoto
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2024, 129
  • [10] Joint Multi-Objective Optimization for Radio Access Network Slicing Using Multi-Agent Deep Reinforcement Learning
    Zhou, Guorong
    Zhao, Liqiang
    Zheng, Gan
    Xie, Zhijie
    Song, Shenghui
    Chen, Kwang-Cheng
    IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (09) : 11828 - 11843