Convexity and robustness of the Renyi entropy

被引:7
作者
Buryak, Filipp [1 ]
Mishura, Yuliya [1 ]
机构
[1] Kyiv Natl Taras Shevchenko Univ, Fac Mech & Math, Dept Probabil Theory Stat & Actuarial Math, Volodymyrska 64, UA-01601 Kiev, Ukraine
来源
MODERN STOCHASTICS-THEORY AND APPLICATIONS | 2021年 / 8卷 / 03期
关键词
Discrete distribution; Renyi entropy; convexity; DIVERGENCE;
D O I
10.15559/21-VMSTA185
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We study convexity properties of the Renyi entropy as function of alpha > 0 on finite alphabets. We also describe robustness of the Renyi entropy on finite alphabets, and it turns out that the rate of respective convergence depends on initial alphabet. We establish convergence of the disturbed entropy when the initial distribution is uniform but the number of events increases to infinity and prove that the limit of Renyi entropy of the binomial distribution is equal to Renyi entropy of the Poisson distribution.
引用
收藏
页码:387 / 412
页数:26
相关论文
共 16 条
[11]  
Ho SW, 2015, IEEE INT SYMP INFO, P745, DOI 10.1109/ISIT.2015.7282554
[12]   Statistical mechanics based on Renyi entropy [J].
Lenzi, EK ;
Mendes, RS ;
da Silva, LR .
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2000, 280 (3-4) :337-345
[13]  
Renyi A, 1961, P 4 BERK S MATH STAT, V1
[14]   Tight Bounds on the Renyi Entropy via Majorization with Applications to Guessing and Compression [J].
Sason, Igal .
ENTROPY, 2018, 20 (12)
[15]   Renyi Divergence and Kullback-Leibler Divergence [J].
van Erven, Tim ;
Harremoes, Peter .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) :3797-3820
[16]   Multiscale multifractal multiproperty analysis of financial time series based on Renyi entropy [J].
Yang Yujun ;
Li Jianping ;
Yang Yimei .
INTERNATIONAL JOURNAL OF MODERN PHYSICS C, 2017, 28 (02)