Optimal Transport to Renyi Entropies

被引:0
作者
Rioul, Olivier [1 ]
机构
[1] Univ Paris Saclay, Telecom ParisTech, LTCI, F-75013 Paris, France
来源
GEOMETRIC SCIENCE OF INFORMATION, GSI 2017 | 2017年 / 10589卷
关键词
Renyi entropy; Entropy-power inequality; Optimal transport; POWER; INEQUALITY;
D O I
10.1007/978-3-319-68445-1_17
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Recently, an optimal transportation argument was proposed by the author to provide a simple proof of Shannon's entropy-power inequality. Interestingly, such a proof could have been given by Shannon himself in his 1948 seminal paper. In fact, by 1948 Shannon established all the ingredients necessary for the proof and the transport argument takes the form of a simple change of variables. In this paper, the optimal transportation argument is extended to Renyi entropies in relation to Shannon's entropy-power inequality and to a reverse version involving a certain conditional entropy. The transportation argument turns out to coincide with Barthe's proof of sharp direct and reverse Young's convolutional inequalities and can be applied to derive recent Renyi entropy-power inequalities.
引用
收藏
页码:143 / 150
页数:8
相关论文
共 8 条
[1]   Optimal Young's inequality and its converse: A simple proof [J].
Barthe, F .
GEOMETRIC AND FUNCTIONAL ANALYSIS, 1998, 8 (02) :234-242
[2]   Entropy Power Inequality for the Renyi Entropy [J].
Bobkov, Sergey G. ;
Chistyakov, Gennadiy P. .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2015, 61 (02) :708-714
[3]   On Renyi Entropy Power Inequalities [J].
Ram, Eshed ;
Sason, Igal .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2016, 62 (12) :6800-6815
[4]  
Rioul O, 2017, 2017 INFORMATION THEORY AND APPLICATIONS WORKSHOP (ITA)
[5]   Yet Another Proof of the Entropy Power Inequality [J].
Rioul, Olivier .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2017, 63 (06) :3595-3599
[6]   Information Theoretic Proofs of Entropy Power Inequalities [J].
Rioul, Olivier .
IEEE TRANSACTIONS ON INFORMATION THEORY, 2011, 57 (01) :33-55
[7]  
Shannon C. E., 2017, THEORIE MATH COMMUNI
[8]   A MATHEMATICAL THEORY OF COMMUNICATION [J].
SHANNON, CE .
BELL SYSTEM TECHNICAL JOURNAL, 1948, 27 (04) :623-656