Mechanism Design for Semantic Communication in UAV-Assisted Metaverse: A Combinatorial Auction Approach

被引:7
作者
Liew, Zi Qin [1 ]
Xu, Minrui [2 ]
Lim, Wei Yang Bryan [2 ]
Xiong, Zehui [3 ]
Niyato, Dusit [2 ]
Kim, Dong In [4 ]
机构
[1] Nanyang Technol Univ, Alibaba NTU Singapore Joint Res Inst, Singapore 639798, Singapore
[2] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
[3] Singapore Univ Technol & Design, Pillar Informat Syst Technol & Design, Singapore 487372, Singapore
[4] Sungkyunkwan Univ, Dept Elect & Comp Engn, Suwon 16419, South Korea
基金
新加坡国家研究基金会;
关键词
Semantics; Metaverse; Cost accounting; Synchronization; Communication systems; Data models; Costs; Age of information; incentive mechanism; metaverse; semantic communication; AGE;
D O I
10.1109/TVT.2023.3317069
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Metaverse enables users to experience a virtual space that resembles the real world. In the Metaverse, virtual service providers (VSPs) maintain digital twins (DTs) of real-world entities to offer innovative services such as virtual conferences and tourism. However, to provide a realistic experience, VSPs need to collect up-to-date and relevant data, which is latency-sensitive and resource-intensive, from edge devices such as unmanned aerial vehicles (UAVs). To address this challenge, we propose a semantic communication framework that leverages extraction and trading of scene graphs to reduce communication costs and motivate data transfer for Metaverse services. In the framework, we propose a semantic communication system where data for building DTs is encoded as semantic information, such as scene graphs. VSPs can use these graphs to build or update their DTs. To facilitate data trading between VSPs and edge nodes, we introduce a combinatorial auction-based incentive mechanism where we model the valuation of semantic data based on relatedness, freshness, and semantic values. We measure the relatedness based on the similarity between targeted objects of VSPs and the objects present in the real-world data. We use the age of information (AoI) to quantify data freshness and evaluate the semantic value using the information richness of the scene graphs. Simulation results show that our system can maintain the model's mean recall performance using only 12.5% of features during transmission. Our mechanism increases the average update frequency effectively. The theoretical analysis proves that the proposed mechanism guarantees the desired properties of individual rationality and incentive compatibility.
引用
收藏
页码:2236 / 2251
页数:16
相关论文
共 46 条
[1]  
Bondy J. A., 1976, Graph theory with applications
[2]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[3]   Performance Optimization for Wireless Semantic Communications over Energy Harvesting Networks [J].
Chen, Mingzhe ;
Wang, Yining ;
Poor, H. Vincent .
2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, :8647-8651
[4]   A Review on UAV Wireless Charging: Fundamentals, Applications, Charging Techniques and Standards [J].
Chittoor, Prithvi Krishna ;
Chokkalingam, Bharatiraja ;
Mihet-Popa, Lucian .
IEEE ACCESS, 2021, 9 :69235-69266
[5]   Vehicle Assisted Computing Offloading for Unmanned Aerial Vehicles in Smart City [J].
Dai, Minghui ;
Su, Zhou ;
Xu, Qichao ;
Zhang, Ning .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2021, 22 (03) :1932-1944
[6]   3D Virtual Worlds and the Metaverse: Current Status and Future Possibilities [J].
Dionisio, John David N. ;
Burns, William G., II ;
Gilbert, Richard .
ACM COMPUTING SURVEYS, 2013, 45 (03)
[7]  
Dong M, 2012, IEEE INFOCOM SER, P2282, DOI 10.1109/INFCOM.2012.6195615
[8]  
Du H., 2022, IEEE NETWORK
[9]   Strangers in a Strange Land: New Experimental System for Understanding Driving Culture Using VR [J].
Goedicke, David ;
Zolkov, Carmel ;
Friedman, Natalie ;
Wise, Talia ;
Parush, Avi ;
Ju, Wendy .
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY, 2022, 71 (04) :3399-3413
[10]   Flight Time Minimization of UAV for Data Collection Over Wireless Sensor Networks [J].
Gong, Jie ;
Chang, Tsung-Hui ;
Shen, Chao ;
Chen, Xiang .
IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2018, 36 (09) :1942-1954