Semantic Information Recovery in Wireless Networks

被引:12
作者
Beck, Edgar [1 ]
Bockelmann, Carsten [1 ]
Dekorsy, Armin [1 ]
机构
[1] Univ Bremen, Dept Commun Engn, D-28359 Bremen, Germany
关键词
semantic communication; wireless communications; wireless networks; infomax; information bottleneck; machine learning; task-oriented communication; goal-oriented communication; SOURCE-CHANNEL COMMUNICATION; VECTOR QUANTIZATION;
D O I
10.3390/s23146347
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Motivated by the recent success of Machine Learning (ML) tools in wireless communications, the idea of semantic communication by Weaver from 1949 has gained attention. It breaks with Shannon's classic design paradigm by aiming to transmit the meaning of a message, i.e., semantics, rather than its exact version and, thus, enables savings in information rate. In this work, we extend the fundamental approach from Basu et al. for modeling semantics to the complete communications Markov chain. Thus, we model semantics by means of hidden random variables and define the semantic communication task as the data-reduced and reliable transmission of messages over a communication channel such that semantics is best preserved. We consider this task as an end-to-end Information Bottleneck problem, enabling compression while preserving relevant information. As a solution approach, we propose the ML-based semantic communication system SINFONY and use it for a distributed multipoint scenario; SINFONY communicates the meaning behind multiple messages that are observed at different senders to a single receiver for semantic recovery. We analyze SINFONY by processing images as message examples. Numerical results reveal a tremendous rate-normalized SNR shift up to 20 dB compared to classically designed communication systems.
引用
收藏
页数:23
相关论文
共 53 条
[1]  
Abadi M., 2016, arXiv
[2]  
Alemi AA., 2017, PROC 5 INT C LEARN R, P1
[3]   Preserving quality of information by using semantic relationships [J].
Basu, P. ;
Bao, J. ;
Dean, M. ;
Hendler, J. .
PERVASIVE AND MOBILE COMPUTING, 2014, 11 :188-202
[4]  
Beck E., 2023, ZENODO, DOI [10.5281/zenodo.8006567, DOI 10.5281/ZENODO.8006567]
[5]  
Beck E, 2024, Arxiv, DOI arXiv:2305.03571
[6]   Swarm Exploration and Communications: A First Step towards Mutually-Aware Integration by Probabilistic Learning [J].
Beck, Edgar ;
Shin, Ban-Sok ;
Wang, Shengdi ;
Wiedemann, Thomas ;
Shutin, Dmitriy ;
Dekorsy, Armin .
ELECTRONICS, 2023, 12 (08)
[7]   CMDNet: Learning a Probabilistic Relaxation of Discrete Variables for Soft Detection With Low Complexity [J].
Beck, Edgar ;
Bockelmann, Carsten ;
Dekorsy, Armin .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2021, 69 (12) :8214-8227
[8]  
Belghazi MI, 2018, PR MACH LEARN RES, V80
[9]   Deep Joint Source-Channel Coding for Wireless Image Transmission [J].
Bourtsoulatze, Eirina ;
Kurka, David Burth ;
Gunduz, Deniz .
IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (03) :567-579
[10]  
Cover T.M., 2006, Elements of information theory. Wiley series in telecommunications and signal processing, DOI DOI 10.1002/047174882X