Level choice in truncated total least squares

被引:25
作者
Sima, Diana M. [1 ]
Van Huffel, Sabine [1 ]
机构
[1] Katholieke Univ Leuven, Dept Elect Engn, B-3001 Heverlee, Belgium
关键词
truncated singular value decomposition; truncated total least squares; filter factors; effective number of parameters; model selection; generalized cross validation; information criteria;
D O I
10.1016/j.csda.2007.05.015
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
The method of truncated total least squares (TTLS) is an alternative to the classical truncated singular value decomposition (TSVD) used for the regularization of ill-conditioned linear systems. Truncation methods aim at limiting the contribution of noise or rounding errors by cutting off a certain number of terms in an expansion such as the singular value decomposition. To this end a truncation level k must be carefully chosen. The TTLS solution becomes more significantly dominated by noise or errors when the truncation level k is overestimated than the TSVD solution does. Model selection methods that are often applied in the context of the TSVD are modified to be applied in the context of the TTLS. The proposed modified generalized cross validation (GCV) combined with the TTLS method performs better than the classical GCV combined with the TSVD, especially, when both the coefficient matrix and the right-hand side are contaminated by noise. (c) 2007 Elsevier B.V. All rights reserved.
引用
收藏
页码:1103 / 1118
页数:16
相关论文
共 19 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]  
[Anonymous], 1990, SPLINE MODELS OBSERV
[3]   SMOOTHING NOISY DATA WITH SPLINE FUNCTIONS [J].
WAHBA, G .
NUMERISCHE MATHEMATIK, 1975, 24 (05) :383-393
[4]   Regularization by truncated total least squares [J].
Fierro, RD ;
Golub, GH ;
Hansen, PC ;
OLeary, DP .
SIAM JOURNAL ON SCIENTIFIC COMPUTING, 1997, 18 (04) :1223-1241
[5]  
Golub G. H., 1996, MATRIX COMPUTATIONS
[6]   AN ANALYSIS OF THE TOTAL LEAST-SQUARES PROBLEM [J].
GOLUB, GH ;
VANLOAN, CF .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1980, 17 (06) :883-893
[7]   GENERALIZED CROSS-VALIDATION AS A METHOD FOR CHOOSING A GOOD RIDGE PARAMETER [J].
GOLUB, GH ;
HEATH, M ;
WAHBA, G .
TECHNOMETRICS, 1979, 21 (02) :215-223
[8]  
Hansen P. C., 1994, Numerical Algorithms, V6, P1, DOI 10.1007/BF02149761
[9]  
Hansen P. C., 1998, Rank-Deficient and Discrete Ill-Posed Problems
[10]   Exploiting residual information in the parameter choice for discrete ill-posed problems [J].
Hansen, PC ;
Kilmer, ME ;
Kjeldsen, RH .
BIT NUMERICAL MATHEMATICS, 2006, 46 (01) :41-59