Resource Allocation for Metaverse Experience Optimization: A Multi-Objective Multi-Agent Evolutionary Reinforcement Learning Approach

被引:1
作者
Feng, Lei [1 ]
Jiang, Xiaoyi [1 ]
Sun, Yao [2 ]
Niyato, Dusit [3 ]
Zhou, Yu [1 ]
Gu, Shiyi [1 ]
Yang, Zhixiang [1 ]
Yang, Yang [1 ]
Zhou, Fanqin [1 ]
机构
[1] Beijing Univ Posts & Telecommun BUPT, State Key Lab Networking & Switching Technol, Beijing, Peoples R China
[2] Univ Glasgow, James Watt Sch Engn, Glasgow City, Scotland
[3] Nanyang Technol Univ, Coll Comp & Data Sci, Singapore City, Singapore
基金
中国国家自然科学基金; 新加坡国家研究基金会;
关键词
Metaverse; Quality of experience; Delays; Resource management; Optimization; Heuristic algorithms; Rendering (computer graphics); Wireless communication; Energy consumption; Costs; Metaverse experience; multi-objective optimization; resource allocation; Meta-Immersion; energy consumption; VIRTUAL-REALITY; LATENCY;
D O I
10.1109/TMC.2024.3509680
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In the Metaverse, real-time, concurrent services such as virtual classrooms and immersive gaming require local graphic rendering to maintain low latency. However, the limited processing power and battery capacity of user devices make it challenging to balance Quality of Experience (QoE) and terminal energy consumption. In this paper, we investigate a multi-objective optimization problem (MOP) regarding power control and rendering capacity allocation by formulating it as a multi-objective optimization problem. This problem aims to minimize energy consumption while maximizing Meta-Immersion (MI), a metric that integrates objective network performance with subjective user perception. To solve this problem, we propose a Multi-Objective Multi-Agent Evolutionary Reinforcement Learning with User-Object-Attention (M2ERL-UOA) algorithm. The algorithm employs a prediction-driven evolutionary learning mechanism for multi-agents, coupled with optimized rendering capacity decisions for virtual objects. The algorithm can yield a superior Pareto front that attains the Nash equilibrium. Simulation results demonstrate that the proposed algorithm can generate Pareto fronts, effectively adapts to dynamic user preferences, and significantly reduces decision-making time compared to several benchmarks.
引用
收藏
页码:3473 / 3488
页数:16
相关论文
共 63 条
[1]   URLLC for 5G and Beyond: Requirements, Enabling Incumbent Technologies and Network Intelligence [J].
Ali, Rashid ;
Zikria, Yousaf Bin ;
Bashir, Ali Kashif ;
Garg, Sahil ;
Kim, Hyung Seok .
IEEE ACCESS, 2021, 9 :67064-67095
[2]   Dynamic Partial Computation Offloading for the Metaverse in In-Network Computing [J].
Aliyu, Ibrahim ;
Oh, Seungmin ;
Ko, Namseok ;
Um, Tai-Won ;
Kim, Jinsul .
IEEE ACCESS, 2024, 12 :11615-11630
[3]   Efficient Multi-Player Computation Offloading for VR Edge-Cloud Computing Systems [J].
Alshahrani, Abdullah ;
Elgendy, Ibrahim A. ;
Muthanna, Ammar ;
Alghamdi, Ahmed Mohammed ;
Alshamrani, Adel .
APPLIED SCIENCES-BASEL, 2020, 10 (16)
[4]   Anxiety increases the feeling of presence in virtual reality [J].
Bouchard, Stephane ;
St-Jacques, Julie ;
Robillard, Genevieve ;
Renaud, Patrice .
PRESENCE-VIRTUAL AND AUGMENTED REALITY, 2008, 17 (04) :376-391
[5]   Assessment of Driver Attention during a Safety Critical Situation in VR to Generate VR-based Training [J].
Bozkir, Efe ;
Geisler, David ;
Kasneci, Enkelejda .
ACM CONFERENCE ON APPLIED PERCEPTION (SAP 2019), 2019,
[6]   Effects of End-to-end Latency on User Experience and Performance in Immersive Virtual Reality Applications [J].
Caserman, Polona ;
Martinussen, Michelle ;
Goebel, Stefan .
ENTERTAINMENT COMPUTING AND SERIOUS GAMES, ICEC-JCSG 2019, 2019, 11863 :57-69
[7]   SGPL: An Intelligent Game-Based Secure Collaborative Communication Scheme for Metaverse Over 5G and Beyond Networks [J].
Chen, Miaojiang ;
Liu, Anfeng ;
Xiong, Neal N. ;
Song, Houbing ;
Leung, Victor C. M. .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2024, 42 (03) :767-782
[8]   GPDS: A multi-agent deep reinforcement learning game for anti-jamming secure computing in MEC network [J].
Chen, Miaojiang ;
Liu, Wei ;
Zhang, Ning ;
Li, Junling ;
Ren, Yingying ;
Yi, Meng ;
Liu, Anfeng .
EXPERT SYSTEMS WITH APPLICATIONS, 2022, 210
[9]   Virtual Reality Over Wireless Networks: Quality-of-Service Model and Learning-Based Resource Management [J].
Chen, Mingzhe ;
Saad, Walid ;
Yin, Changchuan .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2018, 66 (11) :5621-5635
[10]   AIGC-Based Evolvable Digital Twin Networks: A Road to the Intelligent Metaverse [J].
Chen, Xuehan ;
Luo, Linfeng ;
Tang, Fengxiao ;
Zhao, Ming ;
Kato, Nei .
IEEE NETWORK, 2024, 38 (06) :370-379