Deep Separate Source-channel Coding for Semantic-aware Image Transmission

被引:0
|
作者
Huang, Jianhao [1 ,2 ]
Li, Dongxu [1 ,2 ]
Huang, Chuan [1 ,2 ,3 ]
Qin, Xiaoqi [4 ]
Zhang, Wei [5 ]
机构
[1] Chinese Univ Hong Kong, Future Network Intelligence Inst, Shenzhen 518172, Peoples R China
[2] Chinese Univ Hong Kong, Sch Sci & Engn, Shenzhen 518172, Peoples R China
[3] Peng Cheng Lab, Shenzhen 518066, Peoples R China
[4] Beijing Univ Posts & Telecommun, State Key Lab Networking & Switching Technol, Beijing 100876, Peoples R China
[5] Univ New South Wales, Sch Elect Engn & Telecommun, Sydney, NSW 4385, Australia
来源
ICC 2023-IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS | 2023年
关键词
D O I
10.1109/ICC45041.2023.10279073
中图分类号
TN [电子技术、通信技术];
学科分类号
0809 ;
摘要
This paper proposes a deep separate source-channel coding (DSSCC) scheme for the semantic-aware image transmission, where image is lossily compressed and transmitted to receiver for recovery and processing certain semantic tasks. To improve the compression efficiency, the forward adaption (FA) method is incorporated into the DSSCC scheme to capture the density information of compressed features as side information. For a typical application of image classification task, we derive a novel rate-distortion optimization problem by analyzing the Bayesian model of the FA-based DSSCC framework. Then, a variational autoencoder approach is proposed to effectively compress image for semantic-aware transmission by minimizing the proposed rate-distortion problem. Simulation results reveal that the proposed FA-based DSSCC scheme achieves better image recovery and classification performance in most scenarios, compared to the classical compression schemes and the emerging deep joint source-channel schemes.
引用
收藏
页码:5626 / 5631
页数:6
相关论文
共 50 条
  • [1] Deep Joint Source-Channel Coding for Wireless Image Transmission with Semantic Importance
    Sun, Qizheng
    Guo, Caili
    Yang, Yang
    Chen, Jiujiu
    Tang, Rui
    Liu, Chuanhong
    2022 IEEE 96TH VEHICULAR TECHNOLOGY CONFERENCE (VTC2022-FALL), 2022,
  • [2] Generative Joint Source-Channel Coding for Semantic Image Transmission
    Erdemir, Ecenaz
    Tung, Tze-Yang
    Dragotti, Pier Luigi
    Gunduz, Deniz
    IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS, 2023, 41 (08) : 2645 - 2657
  • [3] Deep Source-Channel Coding for Sentence Semantic Transmission With HARQ
    Jiang, Peiwen
    Wen, Chao-Kai
    Jin, Shi
    Li, Geoffrey Ye
    IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (08) : 5225 - 5240
  • [4] Deep Joint Source-Channel Coding for Wireless Image Transmission
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2019, 5 (03) : 567 - 579
  • [5] DEEP JOINT SOURCE-CHANNEL CODING FOR WIRELESS IMAGE TRANSMISSION
    Bourtsoulatze, Eirina
    Kurka, David Burth
    Gunduz, Deniz
    2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2019, : 4774 - 4778
  • [6] DISTRIBUTED IMAGE TRANSMISSION USING DEEP JOINT SOURCE-CHANNEL CODING
    Wang, Sixian
    Yang, Ke
    Dai, Jincheng
    Niu, Kai
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 5208 - 5212
  • [7] Deep Joint Source-Channel Coding for Image Transmission With Visual Protection
    Xu, Jialong
    Ai, Bo
    Chen, Wei
    Wang, Ning
    Rodrigues, Miguel
    IEEE TRANSACTIONS ON COGNITIVE COMMUNICATIONS AND NETWORKING, 2023, 9 (06) : 1399 - 1411
  • [8] Deep Joint Source-Channel Coding for Semantic Communications
    Xu, Jialong
    Tung, Tze-Yang
    Ai, Bo
    Chen, Wei
    Sun, Yuxuan
    Gunduz, Deniz
    IEEE COMMUNICATIONS MAGAZINE, 2023, 61 (11) : 42 - 48
  • [9] Deep Joint Source-Channel Coding for Wireless Image Transmission with Adaptive Models
    Song, Mengshu
    Ma, Nan
    Dong, Chen
    Xu, Xiaodong
    Zhang, Ping
    ELECTRONICS, 2023, 12 (22)
  • [10] Deep Joint Source-Channel Coding for Wireless Image Transmission with Entropy-Aware Adaptive Rate Control
    Chen, Weixuan
    Chen, Yuhao
    Yang, Qianqian
    Huang, Chongwen
    Wang, Qian
    Zhang, Zhaoyang
    IEEE CONFERENCE ON GLOBAL COMMUNICATIONS, GLOBECOM, 2023, : 2239 - 2244