On calibration of Kullback-Leibler divergence via prediction

被引:0
|
作者
Keyes, TK
Levy, MS
机构
[1] GE, Corp Res & Dev, Schenectady, NY 12301 USA
[2] Univ Cincinnati, Dept Quantitat Anal & Operat Management, Cincinnati, OH 45221 USA
关键词
Bayesian; estimative; linear models; predicting densities;
D O I
10.1080/03610929908832283
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper we evaluate mean Kullback-Leibler divergence via predicting densities arising from various prediction methods applied to the multivariate single-sample normal model. We demonstrate that the degrees of freedom which index Geisser-Cornfield predictive densities are helpful in divergence calibration. Alternative calibrations are derived based on sample size considerations. An application of each method to univariate prediction from the gamma model is provided. Comparisons are made with a probability-based calibration method.
引用
收藏
页码:67 / 85
页数:19
相关论文
共 50 条
  • [1] Renyi Divergence and Kullback-Leibler Divergence
    van Erven, Tim
    Harremoes, Peter
    IEEE TRANSACTIONS ON INFORMATION THEORY, 2014, 60 (07) : 3797 - 3820
  • [2] The fractional Kullback-Leibler divergence
    Alexopoulos, A.
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2021, 54 (07)
  • [3] BOUNDS FOR KULLBACK-LEIBLER DIVERGENCE
    Popescu, Pantelimon G.
    Dragomir, Sever S.
    Slusanschi, Emil I.
    Stanasila, Octavian N.
    ELECTRONIC JOURNAL OF DIFFERENTIAL EQUATIONS, 2016,
  • [4] On the Interventional Kullback-Leibler Divergence
    Wildberger, Jonas
    Guo, Siyuan
    Bhattacharyya, Arnab
    Schoelkopf, Bernhard
    CONFERENCE ON CAUSAL LEARNING AND REASONING, VOL 213, 2023, 213 : 328 - 349
  • [5] Kullback-Leibler Divergence Revisited
    Raiber, Fiana
    Kurland, Oren
    ICTIR'17: PROCEEDINGS OF THE 2017 ACM SIGIR INTERNATIONAL CONFERENCE THEORY OF INFORMATION RETRIEVAL, 2017, : 117 - 124
  • [6] Ellipticity and Circularity Measuring via Kullback-Leibler Divergence
    Misztal, Krzysztof
    Tabor, Jacek
    JOURNAL OF MATHEMATICAL IMAGING AND VISION, 2016, 55 (01) : 136 - 150
  • [7] Detection of Test Collusion via Kullback-Leibler Divergence
    Belov, Dmitry I.
    JOURNAL OF EDUCATIONAL MEASUREMENT, 2013, 50 (02) : 141 - 163
  • [8] Blind Deblurring of Barcodes via Kullback-Leibler Divergence
    Rioux, Gabriel
    Scarvelis, Christopher
    Choksi, Rustum
    Hoheisel, Tim
    Marechal, Pierre
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (01) : 77 - 88
  • [9] Unifying Computational Entropies via Kullback-Leibler Divergence
    Agrawal, Rohit
    Chen, Yi-Hsiu
    Horel, Thibaut
    Vadhan, Salil
    ADVANCES IN CRYPTOLOGY - CRYPTO 2019, PT II, 2019, 11693 : 831 - 858
  • [10] Model Fusion with Kullback-Leibler Divergence
    Claici, Sebastian
    Yurochkin, Mikhail
    Ghosh, Soumya
    Solomon, Justin
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119