On calibration of Kullback-Leibler divergence via prediction

被引:0
|
作者
Keyes, TK
Levy, MS
机构
[1] GE, Corp Res & Dev, Schenectady, NY 12301 USA
[2] Univ Cincinnati, Dept Quantitat Anal & Operat Management, Cincinnati, OH 45221 USA
关键词
Bayesian; estimative; linear models; predicting densities;
D O I
10.1080/03610929908832283
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this paper we evaluate mean Kullback-Leibler divergence via predicting densities arising from various prediction methods applied to the multivariate single-sample normal model. We demonstrate that the degrees of freedom which index Geisser-Cornfield predictive densities are helpful in divergence calibration. Alternative calibrations are derived based on sample size considerations. An application of each method to univariate prediction from the gamma model is provided. Comparisons are made with a probability-based calibration method.
引用
收藏
页码:67 / 85
页数:19
相关论文
共 50 条
  • [21] Distributions of the Kullback-Leibler divergence with applications
    Belov, Dmitry I.
    Armstrong, Ronald D.
    BRITISH JOURNAL OF MATHEMATICAL & STATISTICAL PSYCHOLOGY, 2011, 64 (02): : 291 - 309
  • [22] Model Fusion with Kullback-Leibler Divergence
    Claici, Sebastian
    Yurochkin, Mikhail
    Ghosh, Soumya
    Solomon, Justin
    25TH AMERICAS CONFERENCE ON INFORMATION SYSTEMS (AMCIS 2019), 2019,
  • [23] A generalization of the Kullback-Leibler divergence and its properties
    Yamano, Takuya
    JOURNAL OF MATHEMATICAL PHYSICS, 2009, 50 (04)
  • [24] Computation of Kullback-Leibler Divergence in Bayesian Networks
    Moral, Serafin
    Cano, Andres
    Gomez-Olmedo, Manuel
    ENTROPY, 2021, 23 (09)
  • [25] Kullback-Leibler Divergence Estimation of Continuous Distributions
    Perez-Cruz, Fernando
    2008 IEEE INTERNATIONAL SYMPOSIUM ON INFORMATION THEORY PROCEEDINGS, VOLS 1-6, 2008, : 1666 - 1670
  • [26] Generalization of the Kullback-Leibler divergence in the Tsallis statistics
    Huang, Juntao
    Yong, Wen-An
    Hong, Liu
    JOURNAL OF MATHEMATICAL ANALYSIS AND APPLICATIONS, 2016, 436 (01) : 501 - 512
  • [27] Human tracking with variable prediction steps based on Kullback-Leibler divergence
    Takemura, Noriko
    Nakamura, Yutaka
    Matsumoto, Yoshio
    Ishiguro, Hiroshi
    ARTIFICIAL LIFE AND ROBOTICS, 2010, 15 (01) : 111 - 116
  • [28] Kullback-Leibler Divergence for Nonnegative Matrix Factorization
    Yang, Zhirong
    Zhang, He
    Yuan, Zhijian
    Oja, Erkki
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2011, PT I, 2011, 6791 : 250 - 257
  • [29] Acoustic environment identification by Kullback-Leibler divergence
    Delgado-Gutierrez, G.
    Rodriguez-Santos, F.
    Jimenez-Ramirez, O.
    Vazquez-Medina, R.
    FORENSIC SCIENCE INTERNATIONAL, 2017, 281 : 134 - 140
  • [30] Minimization of the Kullback-Leibler Divergence for Nonlinear Estimation
    Darling, Jacob E.
    DeMars, Kyle J.
    JOURNAL OF GUIDANCE CONTROL AND DYNAMICS, 2017, 40 (07) : 1739 - 1748