A criterion for model selection in the presence incomplete data based on Kullback's symmetric divergence

被引:0
|
作者
Seghouane, AK [1 ]
Bekara, M [1 ]
Fleury, G [1 ]
机构
[1] Ecole Super Elect, Serv Mesures, F-91192 Gif Sur Yvette, France
来源
BAYESIAN INFERENCE AND MAXIMUM ENTROPY METHODS IN SCIENCE AND ENGINEERING | 2004年 / 707卷
关键词
D O I
暂无
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
A criterion is proposed for model selection in the presence of incomplete data. It's construction is based on the motivations provided for the KIC criterion that has been recently developed and for the PDIO criterion. The proposed criterion serves as an asymptotically unbiased estimator of the complete data Kullback-Leibler symmetric divergence between a candidate model and the generating model. It is therefore a natural extension of KIC to settings where the observed data is incomplete and is equivalent to KIC when there is no missing data. The proposed criterion differs from PDIO (predictive divergence for incomplete observation models) in its goodness of fit term and its complexity term. Unlike AIC, KIC and PDIO this criterion can be evaluated using only complete data tools, readily available through the EM and SEM algorithms. The performance of the proposed criterion relative the ones of PDIO, KIC and AIC are examined in a simulation study.
引用
收藏
页码:429 / 441
页数:13
相关论文
共 50 条
  • [31] Bias-corrected Kullback-Leibler distance criterion based model selection with covariables missing at random
    Wei, Yuting
    Wang, Qihua
    Duan, Xiaogang
    Qin, Jing
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2021, 160
  • [32] A nonparametric assessment of model adequacy based on Kullback-Leibler divergence
    Ping-Hung Hsieh
    Statistics and Computing, 2013, 23 : 149 - 162
  • [33] A nonparametric assessment of model adequacy based on Kullback-Leibler divergence
    Hsieh, Ping-Hung
    STATISTICS AND COMPUTING, 2013, 23 (02) : 149 - 162
  • [34] A New Wavelet Thresholding Method for Speech Enhancement Based on Symmetric Kullback-Leibler Divergence
    Tabibian, Shima
    Akbari, Ahmad
    Nasersharif, Babak
    2009 14TH INTERNATIONAL COMPUTER CONFERENCE, 2009, : 494 - +
  • [35] AN ACOUSTIC MODEL BASED ON KULLBACK-LEIBLER DIVERGENCE FOR POSTERIOR FEATURES
    Aradilla, Guillermo
    Vepa, Jithendra
    Bourlard, Herve
    2007 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH, AND SIGNAL PROCESSING, VOL IV, PTS 1-3, 2007, : 657 - +
  • [36] Nonlocal total variation based on symmetric Kullback-Leibler divergence for the ultrasound image despeckling
    Shujun Liang
    Feng Yang
    Tiexiang Wen
    Zhewei Yao
    Qinghua Huang
    Chengke Ye
    BMC Medical Imaging, 17
  • [37] A Signaling Pathway Analysis Model Based on Kullback-Leibler Divergence
    Wei, Hang
    Zheng, Haoran
    Xu, Yang
    2015 INTERNATIONAL SYMPOSIUM ON BIOELECTRONICS AND BIOINFORMATICS (ISBB), 2015, : 124 - 127
  • [38] Speech enhancement using a wavelet thresholding method based on symmetric Kullback-Leibler divergence
    Tabibian, Shima
    Akbari, Ahmad
    Nasersharif, Babak
    SIGNAL PROCESSING, 2015, 106 : 184 - 197
  • [39] Kullback-Leibler Divergence Based ISAC Constellation and Beamforming Design in the Presence of Clutter
    TANG Shuntian
    WANG Xinyi
    XIA Fanghao
    FEI Zesong
    ZTE Communications, 2024, 22 (03) : 4 - 12
  • [40] Nonlocal total variation based on symmetric Kullback-Leibler divergence for the ultrasound image despeckling
    Liang, Shujun
    Yang, Feng
    Wen, Tiexiang
    Yao, Zhewei
    Huang, Qinghua
    Ye, Chengke
    BMC MEDICAL IMAGING, 2017, 17