Interpretations of Renyi entropies and divergences

被引:32
|
作者
Harremoës, P [1 ]
机构
[1] Univ Copenhagen, Dept Math, DK-2100 Copenhagen, Denmark
关键词
convexity; Kraft's inequality; Renyi divergence; Renyi entropy;
D O I
10.1016/j.physa.2006.01.012
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
In this paper a new operational definition of Renyi divergence and Renyi entropy is presented. Other operational definitions are mentioned. (c) 2006 Elsevier B.V. All rights reserved.
引用
收藏
页码:57 / 62
页数:6
相关论文
共 50 条
  • [21] Variational Representations and Neural Network Estimation of Renyi Divergences
    Birrell, Jeremiah
    Dupuis, Paul
    Katsoulakis, Markos A.
    Rey-Bellet, Luc
    Wang, Jie
    SIAM JOURNAL ON MATHEMATICS OF DATA SCIENCE, 2021, 3 (04): : 1093 - 1116
  • [22] Real and spurious contributions for the Shannon, Renyi and Tsallis entropies
    Campos, Diogenes
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2010, 389 (18) : 3761 - 3768
  • [23] Rigorous bounds for Renyi entropies of spherically symmetric potentials
    Sanchez-Moreno, Pablo
    Zozor, Steeve
    Dehesa, Jesus S.
    BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING, 2010, 1305 : 192 - +
  • [24] Renyi and Tsallis entropies for incomplete or overcomplete systems of events
    Campos, Diogenes
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2010, 389 (05) : 981 - 992
  • [25] Variational representations related to quantum Renyi relative entropies
    Shi, Guanghua
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2021, 610 : 257 - 273
  • [26] Renyi and Tsallis and Shannon entropies on D-posets
    Alizadeh, Leila
    Ebrahimi, Mohammad
    JOURNAL OF INTELLIGENT & FUZZY SYSTEMS, 2018, 34 (04) : 2771 - 2781
  • [27] Thermal properties of the Renyi entropies of free bosons and fermions
    Drut, Joaquin E.
    Porter, William J.
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2017, 50 (14)
  • [28] The validity of the third law of thermodynamics for the Renyi and homogeneous entropies
    Bagci, G. Baris
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2015, 437 : 405 - 407
  • [29] Tsallis and Renyi entropies in fractional diffusion and entropy production
    Essex, C
    Schulzky, C
    Franz, A
    Hoffmann, KH
    PHYSICA A, 2000, 284 (1-4): : 299 - 308
  • [30] Geometric relative entropies and barycentric Rényi divergences
    Mosonyi, Milan
    Bunth, Gergely
    Vrana, Peter
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2024, 699 : 159 - 276