Deep Joint Source-Channel Coding for Semantic Communications

被引:22
|
作者
Xu, Jialong [1 ]
Tung, Tze-Yang [2 ]
Ai, Bo [1 ,3 ]
Chen, Wei [1 ]
Sun, Yuxuan [4 ]
Gunduz, Deniz [5 ]
机构
[1] Beijing Jiaotong Univ, Beijing, Peoples R China
[2] Imperial Coll London, London, England
[3] Zhengzhou Univ, Zhengzhou, Peoples R China
[4] Beijing Jiaotong Univ, Sch Elect & Informat Engn, Beijing, Peoples R China
[5] Imperial Coll London, Informat Proc & Commun Lab IPC Lab, London, England
基金
英国工程与自然科学研究理事会; 北京市自然科学基金;
关键词
Deep learning; Wireless communication; Codes; Human-machine systems; Semantics; Receivers; Performance gain; IMAGE TRANSMISSION; SYSTEM;
D O I
10.1109/MCOM.004.2200819
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Semantic communications is considered a promising technology that will increase the efficiency of next-generation communication systems, particularly human-machine and machine-type communications. In contrast to the source-agnostic approach of conventional wireless communication systems, semantic communications seek to ensure that only relevant information for the underlying task is communicated to the receiver. Considering most semantic communication applications have strict latency, bandwidth, and power constraints, a prominent approach is to model them as a joint source-channel coding (JSCC) problem. Although JSCC has been a long-standing open problem in communication and coding theory, remarkable performance gains have been made recently over existing separate source and channel coding systems, particularly in low-la-tency and low-power scenarios. Recent progress has been made thanks to the adoption of deep learning techniques for joint source-channel code design that outperform the concatenation of state-of-the-art compression and channel coding schemes, which are the result of decades-long research efforts. In this article, we present an adaptive deep learning based JSCC (DeepJSCC) architecture for semantic communications, introduce its design principles, highlight its benefits, and outline future research challenges that lie ahead.
引用
收藏
页码:42 / 48
页数:7
相关论文
共 50 条
  • [21] A New Joint Source-Channel Coding for Short-Packet Communications
    Wang, Qianfan
    Chen, Yanzhi
    Liang, Jifan
    Ma, Xiao
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2024, 72 (01) : 28 - 37
  • [22] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE RETRIEVAL
    Jankowski, Mikolaj
    Gunduz, Deniz
    Mikolajczyk, Krystian
    2020 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, 2020, : 5070 - 5074
  • [23] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 4774 - 4778
  • [24] Semantic Communications for Image Recovery and Classification via Deep Joint Source and Channel Coding
    Lyu, Zhonghao
    Zhu, Guangxu
    Xu, Jie
    Ai, Bo
    Cui, Shuguang
    IEEE TRANSACTIONS ON WIRELESS COMMUNICATIONS, 2024, 23 (08) : 8388 - 8404
  • [25] ARITHMETIC CODING FOR JOINT SOURCE-CHANNEL CODING
    Spiteri, Trevor
    Buttigieg, Victor
    SIGMAP 2010: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND MULTIMEDIA APPLICATION, 2010, : 5 - 14
  • [26] On hierarchical joint source-channel coding
    Steinberg, Y
    Merhav, N
    2004 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY, PROCEEDINGS, 2004, : 363 - 363
  • [27] Joint source-channel coding with feedback
    Kostina, Victoria
    Polyanskiy, Yury
    Verdu, Sergio
    2015 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY (ISIT), 2015, : 276 - 280
  • [28] Joint Source-Channel Coding with Adaptation
    Minh-Quang Nguyen
    Hang Nguyen
    Renault, Eric
    Phan-Thuan Do
    2016 IEEE SIXTH INTERNATIONAL CONFERENCE ON COMMUNICATIONS AND ELECTRONICS (ICCE), 2016, : 77 - 81
  • [29] Neural Joint Source-Channel Coding
    Choi, Kristy
    Tatwawadi, Kedar
    Grover, Aditya
    Weissman, Tsachy
    Ermon, Stefano
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 97, 2019, 97
  • [30] Joint Source-Channel CELP Coding
    Pleshkova-Bekiarska, Snejana G.
    RADIOENGINEERING, 2008, 17 (03) : 92 - 95