A new model selection criterion based on information geometry

被引:0
作者
Liu, YH [1 ]
Luo, SW [1 ]
Li, AJ [1 ]
Yu, HB [1 ]
机构
[1] Beijing Jiaotong Univ, Dept Comp Sci, Beijing 100044, Peoples R China
来源
2004 7TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS 1-3 | 2004年
关键词
model selection; information geometry; geometric complexity; geometric fitness;
D O I
暂无
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a new model selection criterion based on information geometry-Information Geometric Model Selection Criterion (IGMSC) which is reparametrization invariant, and gives the proof IGMSC computes the geometric complexity of the model by regarding the model space as the manifold and estimates the model-data geometric fitness by using the divergence between the true distribution and the asymptotic distribution, enduing complexity and fitness with clear geometric significance. IGMSC gives the theoretic support of model selection in the framework of information geometry.
引用
收藏
页码:1562 / 1565
页数:4
相关论文
共 11 条
[1]  
AMARI, 1985, DIFFERENTIAL GEOMETR
[2]   The minimum description length principle in coding and modeling [J].
Barron, A ;
Rissanen, J ;
Yu, B .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (06) :2743-2760
[3]   ON THE INFORMATION-BASED MEASURE OF COVARIANCE COMPLEXITY AND ITS APPLICATION TO THE EVALUATION OF MULTIVARIATE LINEAR-MODELS [J].
BOZDOGAN, H .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1990, 19 (01) :221-278
[4]  
HECKERMAN D, 2000, COMPARISON SCI ENG C, V10, P55
[5]  
KVERH B, ANAL DIFFERENT MODEL
[6]  
[罗四维 Luo Siwei], 2003, [计算机研究与发展, Journal of Computer Research and Development], V40, P668
[7]  
MYUNG IJ, 1997, P NATL ACAD SCI USA, P11170
[8]   Fisher information and stochastic complexity [J].
Rissanen, JJ .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1996, 42 (01) :40-47
[9]  
YAN PF, 2000, ARTIFICIAL NEURAL NE, P83
[10]   An asymptotic property of model selection criteria [J].
Yang, YH ;
Barron, AR .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1998, 44 (01) :95-116