Resource Allocation for Metaverse Experience Optimization: A Multi-Objective Multi-Agent Evolutionary Reinforcement Learning Approach

被引:0
|
作者
Feng, Lei [1 ]
Jiang, Xiaoyi [1 ]
Sun, Yao [2 ]
Niyato, Dusit [3 ]
Zhou, Yu [1 ]
Gu, Shiyi [1 ]
Yang, Zhixiang [1 ]
Yang, Yang [1 ]
Zhou, Fanqin [1 ]
机构
[1] Beijing Univ Posts & Telecommun BUPT, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] Univ Glasgow, James Watt Sch Engn, Glasgow City, Scotland
[3] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore City, Singapore
基金
新加坡国家研究基金会; 中国国家自然科学基金;
关键词
Metaverse; Quality of experience; Delays; Resource management; Optimization; Heuristic algorithms; Rendering (computer graphics); Wireless communication; Energy consumption; Costs; Metaverse experience; multi-objective optimization; resource allocation; Meta-Immersion; energy consumption; VIRTUAL-REALITY; LATENCY;
D O I
10.1109/TMC.2024.3509680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the Metaverse, real-time, concurrent services such as virtual classrooms and immersive gaming require local graphic rendering to maintain low latency. However, the limited processing power and battery capacity of user devices make it challenging to balance Quality of Experience (QoE) and terminal energy consumption. In this paper, we investigate a multi-objective optimization problem (MOP) regarding power control and rendering capacity allocation by formulating it as a multi-objective optimization problem. This problem aims to minimize energy consumption while maximizing Meta-Immersion (MI), a metric that integrates objective network performance with subjective user perception. To solve this problem, we propose a Multi-Objective Multi-Agent Evolutionary Reinforcement Learning with User-Object-Attention (M2ERL-UOA) algorithm. The algorithm employs a prediction-driven evolutionary learning mechanism for multi-agents, coupled with optimized rendering capacity decisions for virtual objects. The algorithm can yield a superior Pareto front that attains the Nash equilibrium. Simulation results demonstrate that the proposed algorithm can generate Pareto fronts, effectively adapts to dynamic user preferences, and significantly reduces decision-making time compared to several benchmarks.
引用
收藏
页码:3473 / 3488
页数:16
相关论文
共 50 条
  • [1] Multi-Agent Deep Reinforcement Learning for Resource Allocation in the Multi-Objective HetNet
    Nie, Hongrui
    Li, Shaosheng
    Liu, Yong
    IWCMC 2021: 2021 17TH INTERNATIONAL WIRELESS COMMUNICATIONS & MOBILE COMPUTING CONFERENCE (IWCMC), 2021, : 116 - 121
  • [2] Multi-Agent Deep Reinforcement Learning based Multi-Objective Resource Optimization in a Distributed Manufacturing System
    Shen, Xinchang
    Tham, Chen-Khong
    2024 IEEE 99TH VEHICULAR TECHNOLOGY CONFERENCE, VTC2024-SPRING, 2024,
  • [3] Multi-objective optimization of turbine blade profiles based on multi-agent reinforcement learning
    Li, Lele
    Zhang, Weihao
    Li, Ya
    Jiang, Chiju
    Wang, Yufan
    ENERGY CONVERSION AND MANAGEMENT, 2023, 297
  • [4] A multi-objective multi-agent deep reinforcement learning approach to residential appliance scheduling
    Lu, Junlin
    Mannion, Patrick
    Mason, Karl
    IET SMART GRID, 2022, 5 (04) : 260 - 280
  • [5] A new Approach on Multi-Agent Multi-Objective Reinforcement Learning based on agents' preferences
    Asl, Zeinab Daavarani
    Derhami, Vali
    Yazdian-Dehkordi, Mehdi
    2017 19TH CSI INTERNATIONAL SYMPOSIUM ON ARTIFICIAL INTELLIGENCE AND SIGNAL PROCESSING (AISP), 2017, : 75 - 79
  • [6] A Dynamic Resource Allocation Strategy with Reinforcement Learning for Multimodal Multi-objective Optimization
    Dang, Qian-Long
    Xu, Wei
    Yuan, Yang-Fei
    MACHINE INTELLIGENCE RESEARCH, 2022, 19 (02) : 138 - 152
  • [7] A Dynamic Resource Allocation Strategy with Reinforcement Learning for Multimodal Multi-objective Optimization
    Qian-Long Dang
    Wei Xu
    Yang-Fei Yuan
    Machine Intelligence Research, 2022, 19 (02) : 138 - 152
  • [8] A Dynamic Resource Allocation Strategy with Reinforcement Learning for Multimodal Multi-objective Optimization
    Qian-Long Dang
    Wei Xu
    Yang-Fei Yuan
    Machine Intelligence Research, 2022, 19 : 138 - 152
  • [9] A novel multi-objective optimization based multi-agent deep reinforcement learning approach for microgrid resources planning
    Abid, Md. Shadman
    Apon, Hasan Jamil
    Hossain, Salman
    Ahmed, Ashik
    Ahshan, Razzaqul
    Lipu, M. S. Hossain
    APPLIED ENERGY, 2024, 353
  • [10] Efficient Constrained Evolutionary Multi-Agent System for Multi-objective Optimization
    Siwik, Leszek
    Sikorski, Piotr
    2008 IEEE CONGRESS ON EVOLUTIONARY COMPUTATION, VOLS 1-8, 2008, : 3212 - 3219