AN INVOLUTION INEQUALITY FOR THE KULLBACK-LEIBLER DIVERGENCE

被引：0
|
作者：
Pinelis, Iosif [1 ]
机构：
[1] Michigan Technol Univ, Dept Math Sci, Houghton, MI 49931 USA
来源：
MATHEMATICAL INEQUALITIES & APPLICATIONS | 2017年 / 20卷 / 01期
关键词：
Kullback-Leibler divergence; involution; reflection; inequalities; mixtures of distributions;
D O I：
10.7153/mia-20-17
中图分类号：
O1 [数学];
学科分类号：
0701 ; 070101 ;
摘要：
Let R-t := t P+(1-t)P-t, where t is an element of (0,1), P is a probability measure, and Pt is the push-forward image of P under a measurable involution.. An inequality involving the Kullback-Leibler divergence of R-t from P is given. It is shown that the role of the involution is essential.
引用
收藏
页码：233 / 235
页数：3
相关论文
共 50 条
  • [1] Renyi Divergence and Kullback-Leibler Divergence
    van Erven, Tim
    Harremoes, Peter
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) : 3797 - 3820
  • [2] The fractional Kullback-Leibler divergence
    Alexopoulos, A.
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2021, 54 (07)
  • [3] ON INFORMATION GAIN, KULLBACK-LEIBLER DIVERGENCE, ENTROPY PRODUCTION AND THE INVOLUTION KERNEL
    Lopes, Artur O.
    Mengue, Jairo K.
    DISCRETE AND CONTINUOUS DYNAMICAL SYSTEMS, 2022, 42 (07) : 3593 - 3627
  • [4] BOUNDS FOR KULLBACK-LEIBLER DIVERGENCE
    Popescu, Pantelimon G.
    Dragomir, Sever S.
    Slusanschi, Emil I.
    Stanasila, Octavian N.
    ELECTRONIC JOURNAL OF DIFFERENTIAL EQUATIONS, 2016,
  • [5] On the Interventional Kullback-Leibler Divergence
    Wildberger, Jonas
    Guo, Siyuan
    Bhattacharyya, Arnab
    Schoelkopf, Bernhard
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 328 - 349
  • [6] Kullback-Leibler Divergence Revisited
    Raiber, Fiana
    Kurland, Oren
    ICTIR'17: PROCEEDINGS OF THE 2017 ACM SIGIR INTERNATIONAL CONFERENCE THEORY OF INFORMATION RETRIEVAL, 2017, : 117 - 124
  • [7] Model Fusion with Kullback-Leibler Divergence
    Claici, Sebastian
    Yurochkin, Mikhail
    Ghosh, Soumya
    Solomon, Justin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [8] Kullback-Leibler Divergence Metric Learning
    Ji, Shuyi
    Zhang, Zizhao
    Ying, Shihui
    Wang, Liejun
    Zhao, Xibin
    Gao, Yue
    IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (04) : 2047 - 2058
  • [9] Nonparametric Estimation of Kullback-Leibler Divergence
    Zhang, Zhiyi
    Grabchak, Michael
    NEURAL COMPUTATION, 2014, 26 (11) : 2570 - 2593
  • [10] Use of Kullback-Leibler divergence for forgetting
    Karny, Miroslav
    Andrysek, Josef
    INTERNATIONAL JOURNAL OF ADAPTIVE CONTROL AND SIGNAL PROCESSING, 2009, 23 (10) : 961 - 975
12345