Resource Allocation for Metaverse Experience Optimization: A Multi-Objective Multi-Agent Evolutionary Reinforcement Learning Approach

被引:0
作者
Feng, Lei [1 ]
Jiang, Xiaoyi [1 ]
Sun, Yao [2 ]
Niyato, Dusit [3 ]
Zhou, Yu [1 ]
Gu, Shiyi [1 ]
Yang, Zhixiang [1 ]
Yang, Yang [1 ]
Zhou, Fanqin [1 ]
机构
[1] Beijing Univ Posts & Telecommun BUPT, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] Univ Glasgow, James Watt Sch Engn, Glasgow City, Scotland
[3] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore City, Singapore
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Metaverse; Quality of experience; Delays; Resource management; Optimization; Heuristic algorithms; Rendering (computer graphics); Wireless communication; Energy consumption; Costs; Metaverse experience; multi-objective optimization; resource allocation; Meta-Immersion; energy consumption; VIRTUAL-REALITY; LATENCY;
D O I
10.1109/TMC.2024.3509680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the Metaverse, real-time, concurrent services such as virtual classrooms and immersive gaming require local graphic rendering to maintain low latency. However, the limited processing power and battery capacity of user devices make it challenging to balance Quality of Experience (QoE) and terminal energy consumption. In this paper, we investigate a multi-objective optimization problem (MOP) regarding power control and rendering capacity allocation by formulating it as a multi-objective optimization problem. This problem aims to minimize energy consumption while maximizing Meta-Immersion (MI), a metric that integrates objective network performance with subjective user perception. To solve this problem, we propose a Multi-Objective Multi-Agent Evolutionary Reinforcement Learning with User-Object-Attention (M2ERL-UOA) algorithm. The algorithm employs a prediction-driven evolutionary learning mechanism for multi-agents, coupled with optimized rendering capacity decisions for virtual objects. The algorithm can yield a superior Pareto front that attains the Nash equilibrium. Simulation results demonstrate that the proposed algorithm can generate Pareto fronts, effectively adapts to dynamic user preferences, and significantly reduces decision-making time compared to several benchmarks.
引用
收藏
页码:3473 / 3488
页数:16
相关论文
共 50 条
  • [21] A resource allocation-based multi-objective evolutionary algorithm for large-scale multi-objective optimization
    Yang, Wanting
    Liu, Jianchang
    Zhang, Wei
    Zhang, Xinnan
    SOFT COMPUTING, 2023, 27 (23) : 17809 - 17831
  • [22] Multi-agent reinforcement learning for intelligent resource allocation in IIoT networks
    Rosenberger, Julia
    Urlaub, Michael
    Schramm, Dieter
    2021 IEEE GLOBAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND INTERNET OF THINGS (GCAIOT), 2021, : 118 - 119
  • [23] Multi-Agent Reinforcement Learning for Efficient Resource Allocation in Internet of Vehicles
    Wang, Jun-Han
    He, He
    Cha, Jaesang
    Jeong, Incheol
    Ahn, Chang-Jun
    ELECTRONICS, 2025, 14 (01):
  • [24] A Multi-agent genetic algorithm for multi-objective optimization
    Akopov, Andranik S.
    Hevencev, Maxim A.
    2013 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC 2013), 2013, : 1391 - 1395
  • [25] A resource allocation-based multi-objective evolutionary algorithm for large-scale multi-objective optimization
    Wanting Yang
    Jianchang Liu
    Wei Zhang
    Xinnan Zhang
    Soft Computing, 2023, 27 : 17809 - 17831
  • [26] Multi-Agent Reinforcement Learning for Slicing Resource Allocation in Vehicular Networks
    Cui, Yaping
    Shi, Hongji
    Wang, Ruyan
    He, Peng
    Wu, Dapeng
    Huang, Xinyun
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (02) : 2005 - 2016
  • [27] A Multi-Agent Collaborative Environment Learning Method for UAV Deployment and Resource Allocation
    Dai, Zhaojun
    Zhang, Yan
    Zhang, Wancheng
    Luo, Xinran
    He, Zunwen
    IEEE TRANSACTIONS ON SIGNAL AND INFORMATION PROCESSING OVER NETWORKS, 2022, 8 (120-130): : 120 - 130
  • [28] Multi-Objective Optimization Using Adaptive Distributed Reinforcement Learning
    Tan, Jing
    Khalili, Ramin
    Karl, Holger
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2024, 25 (09) : 10777 - 10789
  • [29] Evolutionary Multi-Objective Optimization Algorithm for Resource Allocation Using Deep Neural Network in Ultra-Dense Networks
    Sharma, Nidhi
    Kumar, Krishan
    IEEE TRANSACTIONS ON NETWORK AND SERVICE MANAGEMENT, 2024, 21 (02): : 2111 - 2124
  • [30] Multi-Agent Deep Reinforcement Learning for Enhancement of Distributed Resource Allocation in Vehicular Network
    Urmonov, Odilbek
    Aliev, Hayotjon
    Kim, HyungWon
    IEEE SYSTEMS JOURNAL, 2023, 17 (01): : 491 - 502