Mechanism Design for Semantic Communication in UAV-Assisted Metaverse: A Combinatorial Auction Approach

被引:7
作者
Liew, Zi Qin [1 ]
Xu, Minrui [2 ]
Lim, Wei Yang Bryan [2 ]
Xiong, Zehui [3 ]
Niyato, Dusit [2 ]
Kim, Dong In [4 ]
机构
[1] Nanyang Technol Univ, Alibaba NTU Singapore Joint Res Inst, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[3] Singapore Univ Technol & Design, Pillar Informat Syst Technol & Design, Singapore 487372, Singapore
[4] Sungkyunkwan Univ, Dept Elect & Comp Engn, Suwon 16419, South Korea
基金
新加坡国家研究基金会;
关键词
Semantics; Metaverse; Cost accounting; Synchronization; Communication systems; Data models; Costs; Age of information; incentive mechanism; metaverse; semantic communication; AGE;
D O I
10.1109/TVT.2023.3317069
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Metaverse enables users to experience a virtual space that resembles the real world. In the Metaverse, virtual service providers (VSPs) maintain digital twins (DTs) of real-world entities to offer innovative services such as virtual conferences and tourism. However, to provide a realistic experience, VSPs need to collect up-to-date and relevant data, which is latency-sensitive and resource-intensive, from edge devices such as unmanned aerial vehicles (UAVs). To address this challenge, we propose a semantic communication framework that leverages extraction and trading of scene graphs to reduce communication costs and motivate data transfer for Metaverse services. In the framework, we propose a semantic communication system where data for building DTs is encoded as semantic information, such as scene graphs. VSPs can use these graphs to build or update their DTs. To facilitate data trading between VSPs and edge nodes, we introduce a combinatorial auction-based incentive mechanism where we model the valuation of semantic data based on relatedness, freshness, and semantic values. We measure the relatedness based on the similarity between targeted objects of VSPs and the objects present in the real-world data. We use the age of information (AoI) to quantify data freshness and evaluate the semantic value using the information richness of the scene graphs. Simulation results show that our system can maintain the model's mean recall performance using only 12.5% of features during transmission. Our mechanism increases the average update frequency effectively. The theoretical analysis proves that the proposed mechanism guarantees the desired properties of individual rationality and incentive compatibility.
引用
收藏
页码:2236 / 2251
页数:16
相关论文
共 46 条
[11]   A Dynamic Resource Allocation Framework for Synchronizing Metaverse with IoT Service and Data [J].
Han, Yue ;
Niyato, Dusit ;
Leung, Cyril ;
Miao, Chunyan ;
Kim, Dong In .
IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, :1196-1201
[12]   Semantic Information Market For The Metaverse: An Auction Based Approach [J].
Ismail, Lotfi ;
Niyato, Dusit ;
Sun, Sumei ;
Kim, Dong In ;
Erol-Kantarci, Melike ;
Miao, Chunyan .
2022 IEEE FUTURE NETWORKS WORLD FORUM, FNWF, 2022, :628-633
[13]   Wireless Semantic Communications for Video Conferencing [J].
Jiang, Peiwen ;
Wen, Chao-Kai ;
Jin, Shi ;
Li, Geoffrey Ye .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (01) :230-244
[14]   Reliable Distributed Computing for Metaverse: A Hierarchical Game-Theoretic Approach [J].
Jiang, Yuna ;
Kang, Jiawen ;
Niyato, Dusit ;
Ge, Xiaohu ;
Xiong, Zehui ;
Miao, Chunyan ;
Shen, Xuemin .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2023, 72 (01) :1084-1100
[15]   Toward an Automated Auction Framework for Wireless Federated Learning Services Market [J].
Jiao, Yutao ;
Wang, Ping ;
Niyato, Dusit ;
Lin, Bin ;
Kim, Dong In .
IEEE TRANSACTIONS ON MOBILE COMPUTING, 2021, 20 (10) :3034-3048
[16]   Image Generation from Scene Graphs [J].
Johnson, Justin ;
Gupta, Agrim ;
Li Fei-Fei .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1219-1228
[17]   Orchestrated Scheduling and Multi-Agent Deep Reinforcement Learning for Cloud-Assisted Multi-UAV Charging Systems [J].
Jung, Soyi ;
Yun, Won Joon ;
Shin, MyungJae ;
Kim, Joongheon ;
Kim, Jae-Hyun .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2021, 70 (06) :5362-5377
[18]  
Knyazev B., 2020, PROC BRIT MACH VIS C
[19]  
Koner R, 2021, Arxiv, DOI arXiv:2004.06193
[20]  
Le DA, 2020, 2020 IEEE CONFERENCE ON VIRTUAL REALITY AND 3D USER INTERFACES WORKSHOPS (VRW 2020), P485, DOI [10.1109/VRW50115.2020.0-175, 10.1109/VRW50115.2020.00101]