Imitation Learning-Based Implicit Semantic-Aware Communication Networks: Multi-Layer Representation and Collaborative Reasoning

被引:22
作者
Xiao, Yong [1 ,2 ,3 ]
Sun, Zijian [1 ]
Shi, Guangming [2 ,3 ,4 ]
Niyato, Dusit [5 ]
机构
[1] Huazhong Univ Sci & Technol, Sch Elect Informat & Commun, Wuhan 430074, Peoples R China
[2] Peng Cheng Lab, Shenzhen 518055, Guangdong, Peoples R China
[3] Pazhou Lab Huangpu, Guangzhou 510555, Guangdong, Peoples R China
[4] Xidian Univ, Sch Artificial Intelligence, Xian 710071, Shanxi, Peoples R China
[5] Nanyang Technol Univ, Sch Comp Sci & Engn, Singapore 639798, Singapore
基金
中国国家自然科学基金;
关键词
Semantic communication; implicit semantic-aware communication; multi-layer representation; multi-tier computing; collaborative reasoning; federated edge intelligence; SYSTEM; FOG;
D O I
10.1109/JSAC.2022.3229419
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic communication has recently attracted significant interest from both industry and academia due to its potential to transform the existing data-focused communication architecture towards a more generally intelligent and goal-oriented semantic-aware networking system. Despite its promising potential, semantic communications and semantic-aware networking are still in their infancy. Most existing works focus on transporting and delivering the explicit semantic information, e.g., labels or features of objects, that can be directly identified from the source signal. The original definition of semantics as well as recent results in cognitive neuroscience suggest that it is the implicit semantic information, in particular the hidden relations connecting different concepts and feature items that play the fundamental role in recognizing, communicating, and delivering the real semantic meanings of messages. Motivated by this observation, we propose a novel reasoning-based implicit semantic-aware communication network architecture that allows destination users to directly learn a reasoning mechanism that can automatically generate complex implicit semantic information based on a limited clue information sent by the source users. Our proposed architecture can be implemented in a multi-tier cloud/edge computing networks in which multiple tiers of cloud data center (CDC) and edge servers can collaborate and support efficient semantic encoding, decoding, and implicit semantic interpretation for multiple end-users. We introduce a new multi-layer representation of semantic information taking into consideration both the hierarchical structure of implicit semantics as well as the personalized inference preference of individual users. We model the semantic reasoning process as a reinforcement learning process and then propose an imitation-based semantic reasoning mechanism learning (iRML) solution to learning a reasoning policy that imitates the inference behavior of the source user. A federated graph convolutional network (GCN)-based collaborative reasoning solution is proposed to allow multiple edge servers to jointly construct a shared semantic interpretation model based on decentralized semantic message samples. Extensive experiments have been conducted based on real-world datasets to evaluate the performance of our proposed architecture. Numerical results confirm that iRML offers up to 25.8 dB improvement on the semantic symbol error rate, compared to the semantic-irrelevant communication solutions.
引用
收藏
页码:639 / 658
页数:20
相关论文
共 51 条
[1]  
Dieng AB, 2017, Arxiv, DOI arXiv:1611.01702
[2]   Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging Studies [J].
Binder, Jeffrey R. ;
Desai, Rutvik H. ;
Graves, William W. ;
Conant, Lisa L. .
CEREBRAL CORTEX, 2009, 19 (12) :2767-2796
[3]   Deep Joint Source-Channel Coding for Wireless Image Transmission [J].
Bourtsoulatze, Eirina ;
Kurka, David Burth ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (03) :567-579
[4]  
Breal M., 1897, Essai de semantique (Science des significations)
[5]  
Carnap R., 1952, 247 MIT RES LAB ELCT
[6]   DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs [J].
Chen, Liang-Chieh ;
Papandreou, George ;
Kokkinos, Iasonas ;
Murphy, Kevin ;
Yuille, Alan L. .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2018, 40 (04) :834-848
[7]   Fog as a Service Technology [J].
Chen, Nanxi ;
Yang, Yang ;
Zhang, Tao ;
Zhou, Ming-Tuo ;
Luo, Xiliang ;
Zao, John K. .
IEEE COMMUNICATIONS MAGAZINE, 2018, 56 (11) :95-101
[8]   The Semantic Communication Game [J].
Guler, Basak ;
Yener, Aylin ;
Swami, Ananthram .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2018, 4 (04) :787-802
[9]  
Jie Bao, 2011, 2011 IEEE First International Network Science Workshop (NSW 2011), P110, DOI 10.1109/NSW.2011.6004632
[10]   Learning Neural Audio Embeddings for Grounding Semantics in Auditory Perception [J].
Kiela, Douwe ;
Clark, Stephen .
JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2017, 60 :1003-1030