A Dichotomy of Functions in Distributed Coding: An Information Spectral Approach

被引:10
作者
Kuzuoka, Shigeaki [1 ]
Watanabe, Shun [2 ]
机构
[1] Wakayama Univ, Fac Syst Engn, Wakayama 6408510, Japan
[2] Tokyo Univ Agr & Technol, Dept Comp & Informat Sci, Tokyo 1848588, Japan
基金
日本学术振兴会;
关键词
Distributed computing; information-spectrum method; Slepian-Wolf coding; CORRELATED SOURCES;
D O I
10.1109/TIT.2015.2458871
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The problem of distributed data compression for function computation is considered, where: 1) the function to be computed is not necessarily symbolwise function and 2) the information source has memory and may not be stationary nor ergodic. We introduce the class of smooth sources and give a sufficient condition on functions so that the achievable rate region for computing coincides with the Slepian-Wolf region (i.e., the rate region for reproducing the entire source) for any smooth sources. Moreover, for symbolwise functions, the necessary and sufficient condition for the coincidence is established. Our result for the full side-information case is a generalization of the result by Ahlswede and Csiszar to sources with memory; our dichotomy theorem is different from Han and Kobayashi's dichotomy theorem, which reveals an effect of memory in distributed function computation. All results are given not only for fixed-length coding but also for variable-length coding in a unified manner. Furthermore, for the full side-information case, the error probability in the moderate deviation regime is also investigated.
引用
收藏
页码:5028 / 5041
页数:14
相关论文
共 18 条
[1]   TO GET A BIT OF INFORMATION MAY BE AS HARD AS TO GET FULL INFORMATION [J].
AHLSWEDE, R ;
CSISZAR, I .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1981, 27 (04) :398-408
[2]   Moderate Deviations in Channel Coding [J].
Altug, Yucel ;
Wagner, Aaron B. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (08) :4417-4426
[3]  
[Anonymous], 2011, Information theory: Coding theorems for discrete memoryless systems
[4]  
Billingsley P., 1995, Probability and Measure, Vthird
[5]  
Cover Thomas M., 2006, Elements of Information Theory, V2nd
[6]  
El Gamal A., 2011, Network Information Theory
[7]  
ELIAS P, 1975, IEEE T INFORM THEORY, V21, P194, DOI 10.1109/TIT.1975.1055349
[8]  
Gamal A. E., 1983, IEEE T INFORM THEORY, V29, P931
[9]  
Han T. S., 2002, INFORM SPECTRUM METH
[10]   DICHOTOMY OF FUNCTIONS F(X, Y) OF CORRELATED SOURCES (X, Y). [J].
Han, Te Sun ;
Kobayashi, Kingo .
IEEE Transactions on Information Theory, 1987, IT-33 (01) :69-76