Conditional Renyi Entropies

被引:55
作者
Teixeira, Andreia [1 ]
Matos, Armando [2 ,3 ]
Antunes, Luis [1 ]
机构
[1] Univ Porto, Inst Telecomunicacoes, Fac Ciencias, P-4169007 Oporto, Portugal
[2] Univ Porto, Dept Comp Sci, P-4169007 Oporto, Portugal
[3] Univ Porto, Lab Artificial Intelligence & Comp Sci, P-4169007 Oporto, Portugal
关键词
Conditional entropies; Renyi entropy;
D O I
10.1109/TIT.2012.2192713
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
There is no generally accepted definition of conditional Renyi entropy. The (unconditional) Renyi entropy depends on a parameter alpha, which for the case of min-entropy takes the value infinity. Even for this particular case, there are several proposals for the definition of conditional entropy. This paper describes three general definitions of conditional Renyi entropy that were found or suggested in the literature. Their properties are studied and their values, as a function of alpha, are compared. The particular case of min-entropy is widely used in cryptography as a security parameter; this case is studied in some detail.
引用
收藏
页码:4273 / 4277
页数:5
相关论文
共 14 条
[1]  
[Anonymous], 1961, P 4 BERK S MATH STAT
[2]   Long memory and volatility clustering: Is the empirical evidence consistent across stock markets? [J].
Bentes, Sonia R. ;
Menezes, Rui ;
Mendes, Diana A. .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2008, 387 (15) :3826-3830
[3]  
Cachin C., 1997, THESIS SWISS FEDERAL
[4]  
Cover T., 2002, WILEY SERIES TELECOM
[5]   GENERALIZED CUTOFF RATES AND RENYIS INFORMATION MEASURES [J].
CSISZAR, I .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (01) :26-34
[6]   Some properties of Renyi entropy and Renyi entropy rate [J].
Golshani, Leila ;
Pasha, Einollah ;
Yari, Gholamhossein .
INFORMATION SCIENCES, 2009, 179 (14) :2426-2433
[7]  
Hsiao CY, 2007, LECT NOTES COMPUT SC, V4515, P169
[8]   Generalized statistics: yet another generalization [J].
Jizba, P ;
Arimitsu, T .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2004, 340 (1-3) :110-116
[9]   The world according to Renyi: thermodynamics of multifractal systems [J].
Jizba, P ;
Arimitsu, T .
ANNALS OF PHYSICS, 2004, 312 (01) :17-59
[10]   The asymptotics of posterior entropy and error probability for Bayesian estimation [J].
Kanaya, F ;
Han, TS .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1995, 41 (06) :1988-1992