Imitation Learning-Based Implicit Semantic-Aware Communication Networks: Multi-Layer Representation and Collaborative Reasoning

被引:22
作者
Xiao, Yong [1 ,2 ,3 ]
Sun, Zijian [1 ]
Shi, Guangming [2 ,3 ,4 ]
Niyato, Dusit [5 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Guangdong, Peoples R China
[3] Pazhou Lab Huangpu, Guangzhou 510555, Guangdong, Peoples R China
[4] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Shanxi, Peoples R China
[5] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Semantic communication; implicit semantic-aware communication; multi-layer representation; multi-tier computing; collaborative reasoning; federated edge intelligence; SYSTEM; FOG;
D O I
10.1109/JSAC.2022.3229419
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic communication has recently attracted significant interest from both industry and academia due to its potential to transform the existing data-focused communication architecture towards a more generally intelligent and goal-oriented semantic-aware networking system. Despite its promising potential, semantic communications and semantic-aware networking are still in their infancy. Most existing works focus on transporting and delivering the explicit semantic information, e.g., labels or features of objects, that can be directly identified from the source signal. The original definition of semantics as well as recent results in cognitive neuroscience suggest that it is the implicit semantic information, in particular the hidden relations connecting different concepts and feature items that play the fundamental role in recognizing, communicating, and delivering the real semantic meanings of messages. Motivated by this observation, we propose a novel reasoning-based implicit semantic-aware communication network architecture that allows destination users to directly learn a reasoning mechanism that can automatically generate complex implicit semantic information based on a limited clue information sent by the source users. Our proposed architecture can be implemented in a multi-tier cloud/edge computing networks in which multiple tiers of cloud data center (CDC) and edge servers can collaborate and support efficient semantic encoding, decoding, and implicit semantic interpretation for multiple end-users. We introduce a new multi-layer representation of semantic information taking into consideration both the hierarchical structure of implicit semantics as well as the personalized inference preference of individual users. We model the semantic reasoning process as a reinforcement learning process and then propose an imitation-based semantic reasoning mechanism learning (iRML) solution to learning a reasoning policy that imitates the inference behavior of the source user. A federated graph convolutional network (GCN)-based collaborative reasoning solution is proposed to allow multiple edge servers to jointly construct a shared semantic interpretation model based on decentralized semantic message samples. Extensive experiments have been conducted based on real-world datasets to evaluate the performance of our proposed architecture. Numerical results confirm that iRML offers up to 25.8 dB improvement on the semantic symbol error rate, compared to the semantic-irrelevant communication solutions.
引用
收藏
页码:639 / 658
页数:20
相关论文
共 51 条
[21]  
Santhanavijayan A., 2021, Intelligent System Design. Proceedings of Intelligent System Design: INDIA 2019. Advances in Intelligent Systems and Computing (AISC 1171), P247, DOI 10.1007/978-981-15-5400-1_25
[22]   Hierarchical reasoning by neural circuits in the frontal cortex [J].
Sarafyazd, Morteza ;
Jazayeri, Mehrdad .
SCIENCE, 2019, 364 (6441) :652-+
[23]   Collective Classification in Network Data [J].
Sen, Prithviraj ;
Namata, Galileo ;
Bilgic, Mustafa ;
Getoor, Lise ;
Gallagher, Brian ;
Eliassi-Rad, Tina .
AI MAGAZINE, 2008, 29 (03) :93-106
[24]  
Sequoiah-Grayson S., 2022, The Stanford Encyclopedia of Philosophy
[25]  
Shannon C E., 1948, The Bell System Technical Journal, V27, P379, DOI [DOI 10.1002/J.1538-7305.1948.TB01338.X, 10.1002/j.1538-7305.1948.tb01338.x]
[26]  
Tai KS, 2015, Arxiv, DOI arXiv:1503.00075
[27]  
Shi G., 2022, IEEE ICC WORKSHOP, P1
[28]   From Semantic Communication to Semantic-Aware Networking: Model, Architecture, and Open Problems [J].
Shi, Guangming ;
Xiao, Yong ;
Li, Yingyu ;
Xie, Xuemei .
IEEE COMMUNICATIONS MAGAZINE, 2021, 59 (08) :44-50
[29]  
Toutanova K., 2015, P EMNLP, P1499
[30]   Joint Task Offloading and Caching for Massive MIMO-Aided Multi-Tier Computing Networks [J].
Wang, Kunlun ;
Chen, Wen ;
Li, Jun ;
Yang, Yang ;
Hanzo, Lajos .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (03) :1820-1833