Information theoretical properties of Tsallis entropies

被引:103
作者
Furuichi, S [1 ]
机构
[1] Tokyo Univ Sci, Dept Elect & Comp Sci, Yamaguchi 7560884, Japan
关键词
D O I
10.1063/1.2165744
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A chain rule and a subadditivity for the entropy of type beta, which is one of the nonadditive entropies, were derived by Daroczy. In this paper, we study the further relations among Tsallis type entropies which are typical nonadditive entropies. The chain rule is generalized by showing it for Tsallis relative entropy and the nonadditive entropy. We show some inequalities related to Tsallis entropies, especially the strong subadditivity for Tsallis type entropies and the subadditivity for the nonadditive entropies. The subadditivity and the strong subadditivity naturally lead to define Tsallis mutual entropy and Tsallis conditional mutual entropy, respectively, and then we show again chain rules for Tsallis mutual entropies. We give properties of entropic distances in terms of Tsallis entropies. Finally we show parametrically extended results based on information theory. (c) 2006 American Institute of Physics.
引用
收藏
页数:18
相关论文
共 28 条
[1]   Axioms and uniqueness theorem for Tsallis entropy [J].
Abe, S .
PHYSICS LETTERS A, 2000, 271 (1-2) :74-79
[2]   Stability of Tsallis entropy and instabilities of Renyi and normalized Tsallis entropies:: A basis for q-exponential distributions -: art. no. 046134 [J].
Abe, S .
PHYSICAL REVIEW E, 2002, 66 (04) :6
[3]   Nonadditive conditional entropy and its significance for local realism [J].
Abe, S ;
Rajagopal, AK .
PHYSICA A, 2001, 289 (1-2) :157-164
[4]  
ACZEL J, 1975, MEASURES INFORMATION
[5]  
[Anonymous], 1962, WAHRSCHEINLICHKEITSR
[6]  
[Anonymous], 1952, INEQUALITY
[7]   Information gain within generalized thermostatistics (vol 39, pg 6490, 1998) [J].
Borland, L ;
Plastino, AR ;
Tsallis, C .
JOURNAL OF MATHEMATICAL PHYSICS, 1999, 40 (04) :2196-2196
[8]  
Cover T. M., 2005, ELEM INF THEORY, DOI 10.1002/047174882X
[9]   GENERALIZED INFORMATION FUNCTIONS [J].
DAROCZY, Z .
INFORMATION AND CONTROL, 1970, 16 (01) :36-&
[10]   Generalization of Shannon's theorem for Tsallis entropy [J].
dosSantos, RJV .
JOURNAL OF MATHEMATICAL PHYSICS, 1997, 38 (08) :4104-4107