Khinchin's Fourth Axiom of Entropy Revisited

被引:0
|
作者
Zhang, Zhiyi [1 ]
Huang, Hongwei [2 ]
Xu, Hao [2 ]
机构
[1] Univ N Carolina, Dept Math & Stat, Charlotte, NC 28223 USA
[2] Wells Fargo Bank, Charlotte, NC 28282 USA
来源
STATS | 2023年 / 6卷 / 03期
关键词
Khinchin's axioms; escort distributions; independence-dependence preserving; power function; entropy uniqueness;
D O I
10.3390/stats6030049
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
The Boltzmann-Gibbs-Shannon (BGS) entropy is the only entropy form satisfying four conditions known as Khinchin's axioms. The uniqueness theorem of the BGS entropy, plus the fact that Shannon's mutual information completely characterizes independence between the two underlying random elements, puts the BGS entropy in a special place in many fields of study. In this article, the fourth axiom is replaced by a slightly weakened condition: an entropy whose associated mutual information is zero if and only if the two underlying random elements are independent. Under the weaker fourth axiom, other forms of entropy are sought by way of escort transformations. Two main results are reported in this article. First, there are many entropies other than the BGS entropy satisfying the weaker condition, yet retaining all the desirable utilities of the BGS entropy. Second, by way of escort transformations, the newly identified entropies are the only ones satisfying the weaker axioms.
引用
收藏
页码:763 / 772
页数:10
相关论文
共 50 条
  • [1] Beyond the Shannon-Khinchin formulation: The composability axiom and the universal-group entropy
    Tempesta, Piergiulio
    ANNALS OF PHYSICS, 2016, 365 : 180 - 197
  • [2] The Khinchin inequality for multiple sums revisited
    Raposo, Anselmo
    Teixeira, Katiuscia B.
    BULLETIN OF THE BELGIAN MATHEMATICAL SOCIETY-SIMON STEVIN, 2023, 30 (02) : 163 - 175
  • [3] The Fourth Axiom of Similarity Measures
    Chu, Chun-Hsiao
    Yen, Chih-Ping
    Lin, Yi-Fong
    SYMMETRY-BASEL, 2020, 12 (10): : 1 - 19
  • [4] AXIOM OF INFORMATION - ENTROPY
    CARTER, JW
    NOTICES OF THE AMERICAN MATHEMATICAL SOCIETY, 1976, 23 (05): : A497 - A497
  • [5] TOPOLOGY WITHOUT THE UNION AXIOM (REVISITED)
    Bentley, H. L.
    Ori, R. G.
    QUAESTIONES MATHEMATICAE, 2014, 37 (02) : 265 - 277
  • [6] Khinchin's inequality for operators
    Jameson, GJO
    GLASGOW MATHEMATICAL JOURNAL, 1996, 38 : 327 - 336
  • [7] Alternative Entropy Measures and Generalized Khinchin-Shannon Inequalities
    Mondaini, Rubem P.
    de Albuquerque Neto, Simao C.
    ENTROPY, 2021, 23 (12)
  • [8] Infinite combinatorics revisited in the absence of Axiom of choice
    Csernak, Tamas
    Soukup, Lajos
    ARCHIVE FOR MATHEMATICAL LOGIC, 2024,
  • [9] The fourth coast, revisited
    Kim, John
    ANTHROPOCENE REVIEW, 2021, 8 (03): : 241 - 249
  • [10] Entropy Production and Information Gain in Axiom A Systems
    Jiang, Da-Quan
    Qian, Min
    Qian, Min-Ping
    MATHEMATICAL THEORY OF NONEQUILIBRIUM STEADY STATES: ON THE FRONTIER OF PROBABILITY AND DYNAMICAL SYSTEMS, 2004, 1833 : 159 - 188