Balanced information inequalities

被引:26
作者
Chan, TH [1 ]
机构
[1] Univ Toronto, Dept Elect & Comp Engn, Toronto, ON M5S 3G4, Canada
关键词
balanced information inequalities; entropy; group inequalities; quasi-uniform random variables;
D O I
10.1109/TIT.2003.820037
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this correspondence, we are interested in linear information inequalities, both discrete and continuous ones. We show that every discrete information inequality is associated with a "balanced" information inequality and a set of "residual weights." To prove the inequality, it is necessary and sufficient to prove that its "balanced" version is valid and all its residual weights are nonnegative. For a continuous information inequality, we prove that it is valid if and only if its discrete counterpart is balanced and valid.
引用
收藏
页码:3261 / 3267
页数:7
相关论文
共 10 条
[1]   On a relation between information inequalities and group theory [J].
Chan, TH ;
Yeung, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2002, 48 (07) :1992-1995
[2]  
CHAN TH, COMMUN INFORM SYST, V1, P241
[3]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[4]  
CSISZAR I, 1981, INFORMATION THEORY C
[5]   THE STRUCTURE OF THE I-MEASURE OF A MARKOV-CHAIN [J].
KAWABATA, T ;
YEUNG, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1992, 38 (03) :1146-1149
[6]  
PIPPENGER N, 1986, 1986 SPEC PROBL COMM
[7]   A framework for linear information inequalities [J].
Yeung, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1997, 43 (06) :1924-1934
[8]   A NEW OUTLOOK ON SHANNON-INFORMATION MEASURES [J].
YEUNG, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1991, 37 (03) :466-474
[9]   A non-Shannon-type conditional inequality of information quantities [J].
Zhang, Z ;
Yeung, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1997, 43 (06) :1982-1986
[10]   On characterization of entropy function via information inequalities [J].
Zhang, Z ;
Yeung, RW .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (04) :1440-1452