Leading impulse response identification via the Elastic Net criterion

被引:8
作者
Calafiore, Giuseppe C. [1 ]
Novara, Carlo [1 ]
Taragna, Michele [1 ]
机构
[1] Politecn Torino, Dipartimento Automat & Informat, Corso Duca Abruzzi 24, I-10129 Turin, Italy
关键词
FIR identification; l(1) regularization; Elastic Net; Lasso; Sparsity; SYSTEM-IDENTIFICATION; REGULARIZATION; NOISE; SELECTION; DESIGN;
D O I
10.1016/j.automatica.2017.01.011
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper deals with the problem of finding a low-complexity estimate of the impulse response of a linear time-invariant discrete-time dynamic system from noise-corrupted input-output data. To this purpose, we introduce an identification criterion formed by the average (over the input perturbations) of a standard prediction error cost, plus an l(1) regularization term which promotes sparse solutions. While it is well known that such criteria do provide solutions with many zeros, a critical issue in our identification context is where these zeros are located, since sensible low-order models should be zero in the tail of the impulse response. The flavor of the key results in this paper is that, under quite standard assumptions (such as i.i.d. input and noise sequences and system stability), the estimate of the impulse response resulting from the proposed criterion is indeed identically zero from a certain time index n(l) (named the leading order) onwards, with arbitrarily high probability, for a sufficiently large data cardinality N. Numerical experiments are reported that support the theoretical results, and comparisons are made with some other state-of-the-art methodologies. (C) 2017 Elsevier Ltd. All rights reserved.
引用
收藏
页码:75 / 87
页数:13
相关论文
共 24 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]  
[Anonymous], 1999, SYSTEM IDENTIFICATIO
[3]   TRAINING WITH NOISE IS EQUIVALENT TO TIKHONOV REGULARIZATION [J].
BISHOP, CM .
NEURAL COMPUTATION, 1995, 7 (01) :108-116
[4]  
Calafiore G. C., 2016, 55 IEEE C DEC CONTR, P2926
[5]   On the estimation of transfer functions, regularizations and Gaussian processes-Revisited [J].
Chen, Tianshi ;
Ohlsson, Henrik ;
Ljung, Lennart .
AUTOMATICA, 2012, 48 (08) :1525-1535
[6]   Elastic-net regularization in learning theory [J].
De Mol, Christine ;
De Vito, Ernesto ;
Rosasco, Lorenzo .
JOURNAL OF COMPLEXITY, 2009, 25 (02) :201-230
[7]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22
[8]  
Kollar I., 1994, P IFAC SYSID94 COP D, V4, P23
[9]  
Kollar I., 1994, FREQUENCY DOMAIN SYS
[10]  
Ljung Lennart., 1999, The -Astrom symposium on control, P15