Sparse model selection and parameter identification

被引:0
作者
Duan, XJ [1 ]
Wang, ZM [1 ]
机构
[1] Natl Univ Def Technol, Inst Syst Engn, Changsha, Peoples R China
来源
2003 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-5, PROCEEDINGS | 2003年
关键词
sparse model selection; parameter identification; Sparse Component Analysis;
D O I
10.1109/ICMLC.2003.1259779
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Model selection generally considers the tradeoff between the model fidelity and its complexity, which is realized by structural risk minimization. By the regularization-based Sparse Component Analysis method, a novel regularization function is constructed, then a new principle of model selection is presented with corresponding algorithm of coefficient solution. Finally, a noisy polynomial signal with missing term is presented, which is processed to get the coefficients by our method and the Least Square method respectively. Numeric results demonstrate that our method can identify the missing term and solve the coefficient accurately at the same time. However, the Least Square method must be used combining with different model order selection criteria and the estimated coefficients are not accurate.
引用
收藏
页码:1746 / 1751
页数:6
相关论文
共 12 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]  
CETIN M, 2002, P SPIE C ALG SAR I 9, V4727
[3]  
CETIN M, 2002, P 2002 IEEE INT C AC
[4]   Atomic decomposition by basis pursuit [J].
Chen, SSB ;
Donoho, DL ;
Saunders, MA .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1998, 20 (01) :33-61
[5]   ENTROPY-BASED ALGORITHMS FOR BEST BASIS SELECTION [J].
COIFMAN, RR ;
WICKERHAUSER, MV .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1992, 38 (02) :713-718
[6]  
Donoho D.L., 2000, SPARSE COMPONENTS IM
[7]  
Feng Yu-Qiang, 2001, Journal of the Harbin Institute of Technology, V33, P24
[8]   MATCHING PURSUITS WITH TIME-FREQUENCY DICTIONARIES [J].
MALLAT, SG ;
ZHANG, ZF .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 1993, 41 (12) :3397-3415
[9]   MODELING BY SHORTEST DATA DESCRIPTION [J].
RISSANEN, J .
AUTOMATICA, 1978, 14 (05) :465-471
[10]   A UNIVERSAL PRIOR FOR INTEGERS AND ESTIMATION BY MINIMUM DESCRIPTION LENGTH [J].
RISSANEN, J .
ANNALS OF STATISTICS, 1983, 11 (02) :416-431