A Lower Bound on the Expected Distortion of Joint Source-Channel Coding

被引:1
作者
Kochman, Yuval [1 ]
Ordentlich, Or [1 ]
Polyanskiy, Yury [2 ]
机构
[1] Hebrew Univ Jerusalem, Rachel & Selim Benin Sch Comp Sci & Engn, IL-91904 Jerusalem, Israel
[2] MIT, 77 Massachusetts Ave, Cambridge, MA 02139 USA
基金
以色列科学基金会;
关键词
Joint source-channel coding; finite blocklength; binary symmetric channel (BSC); broadcast channel; OUTER BOUNDS; ENTROPY; EXPONENT; REGION;
D O I
10.1109/TIT.2020.2983148
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
We consider the classic joint source-channel coding problem of transmitting a memoryless source over a memoryless channel. The focus of this work is on the long-standing open problem of finding the rate of convergence of the smallest attainable expected distortion to its asymptotic value, as a function of the blocklength n. Our main result is that in general the convergence rate is not faster than n(-1/2). In particular, we show that for the problem of transmitting i.i.d uniform bits over a binary symmetric channels with Hamming distortion, the smallest attainable distortion (bit error rate) is at least Omega(n(-1/2)) above the asymptotic value, if the "bandwidth expansion ratio" is above 1.
引用
收藏
页码:4722 / 4741
页数:20
相关论文
共 36 条
[1]  
Ajjanagadde G, 2015, ANN ALLERTON CONF, P434, DOI 10.1109/ALLERTON.2015.7447036
[2]   Moderate Deviations in Channel Coding [J].
Altug, Yucel ;
Wagner, Aaron B. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (08) :4417-4426
[3]  
[Anonymous], 2006, Elements of information theory
[4]  
[Anonymous], 1995, Limit theorems of probability theory. Sequences of independent random variables, DOI DOI 10.1214/08-EJS176
[5]   On the distortion SNR exponent of hybrid digital-analog space-time coding [J].
Caire, Giuseppe ;
Narayanan, Krishna .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2007, 53 (08) :2867-2878
[6]   Rate Region of Gaussian Multiple Description Coding With Individual and Central Distortion Constraints [J].
Chen, Jun .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2009, 55 (09) :3991-4005
[8]  
Da Wang, 2012, Proceedings of the 2012 IEEE International Symposium on Information Theory - ISIT, P2117, DOI 10.1109/ISIT.2012.6283736
[9]  
Da Wang, 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton), P180
[10]  
El Gamal A., 2011, Network Information Theory