Adaptive Information Bottleneck Guided Joint Source and Channel Coding for Image Transmission

被引:18
作者
Sun, Lunan [1 ]
Yang, Yang [1 ]
Chen, Mingzhe [2 ,3 ]
Guo, Caili [4 ]
Saad, Walid [5 ]
Poor, H. Vincent [6 ]
机构
[1] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing Key Lab Network Syst Architecture & Conver, Beijing 100876, Peoples R China
[2] Univ Miami, Dept Elect & Comp Engn, Coral Gables, FL 33146 USA
[3] Univ Miami, Inst Data Sci & Comp, Coral Gables, FL 33146 USA
[4] Beijing Univ Posts & Telecommun, Sch Informat & Commun Engn, Beijing Lab Adv Informat Net works, Beijing 100876, Peoples R China
[5] Virginia Tech, Bradley Dept Elect & Comp Engn, Wireless VT Grp, Arlington, VA 24061 USA
[6] Princeton Univ, Dept Elect & Comp Engn, Princeton, NJ 08544 USA
基金
中国国家自然科学基金; 美国国家科学基金会; 北京市自然科学基金;
关键词
Information bottleneck; joint source and channel coding; image transmission; CHECK; BLOCK;
D O I
10.1109/JSAC.2023.3288238
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Joint source and channel coding (JSCC) for image transmission has attracted increasing attention due to its robustness and high efficiency. However, the existing deep JSCC research mainly focuses on minimizing the distortion between the transmitted and received information under a fixed number of available channels. Therefore, the transmitted rate may be far more than its required minimum value. In this paper, an adaptive information bottleneck (IB) guided joint source and channel coding (AIB-JSCC) method is proposed for image transmission. The goal of AIB-JSCC is to reduce the transmission rate while improving the image reconstruction quality. In particular, a new IB objective for image transmission is proposed so as to minimize the distortion and the transmission rate. A mathematically tractable lower bound on the proposed objective is derived, and then, adopted as the loss function of AIB-JSCC. To trade off compression and reconstruction quality, an adaptive algorithm is proposed to adjust the hyperparameter of the proposed loss function dynamically according to the distortion during the training. Experimental results show that AIB-JSCC can significantly reduce the required amount of transmitted data and improve the reconstruction quality and downstream task accuracy.
引用
收藏
页码:2628 / 2644
页数:17
相关论文
共 55 条
[21]   To code, or not to code: Lossy source-channel communication revisited [J].
Gastpar, M ;
Rimoldi, B ;
Vetterli, M .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2003, 49 (05) :1147-1158
[22]  
Google, 2015, WebP Compression Study
[23]   Iterative decoding of binary block and convolutional codes [J].
Hagenauer, J ;
Offer, E ;
Papke, L .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1996, 42 (02) :429-445
[24]   Source-optimized channel coding for digital transmission channels [J].
Heinen, S ;
Vary, P .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2005, 53 (04) :592-600
[25]  
Huleihel W, 2017, IEEE INT SYMP INFO, P91, DOI 10.1109/ISIT.2017.8006496
[26]   Deep Source-Channel Coding for Sentence Semantic Transmission With HARQ [J].
Jiang, Peiwen ;
Wen, Chao-Kai ;
Jin, Shi ;
Li, Geoffrey Ye .
IEEE TRANSACTIONS ON COMMUNICATIONS, 2022, 70 (08) :5225-5240
[27]   DeepJSCC-F: Deep joint source-channel coding of images with feedback [J].
Kurka D.B. ;
Gündüz D. .
IEEE Journal on Selected Areas in Information Theory, 2020, 1 (01) :178-193
[28]   Human-level concept learning through probabilistic program induction [J].
Lake, Brenden M. ;
Salakhutdinov, Ruslan ;
Tenenbaum, Joshua B. .
SCIENCE, 2015, 350 (6266) :1332-1338
[29]   Gradient-based learning applied to document recognition [J].
Lecun, Y ;
Bottou, L ;
Bengio, Y ;
Haffner, P .
PROCEEDINGS OF THE IEEE, 1998, 86 (11) :2278-2324
[30]  
Lee J, 2021, Advances in Neural Information Processing Systems, V34