Model selection by LASSO methods in a change-point model

被引:38
作者
Ciuperca, Gabriela [1 ]
机构
[1] Univ Lyon 1, Inst Camille Jordan, CNRS, UMR 5208, F-69622 Villeurbanne, France
关键词
LASSO; Change-points; Selection criterion; Asymptotic behavior; Oracle properties; VARIABLE SELECTION; ADAPTIVE LASSO; MULTIPLE; ASYMPTOTICS; LIKELIHOOD;
D O I
10.1007/s00362-012-0482-x
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The paper considers a linear regression model with multiple change-points occurring at unknown times. The LASSO technique is very interesting since it allows simultaneously the parametric estimation, including the change-points estimation, and the automatic variable selection. The asymptotic properties of the LASSO-type (which has as particular case the LASSO estimator) and of the adaptive LASSO estimators are studied. For this last estimator the Oracle properties are proved. In both cases, a model selection criterion is proposed. Numerical examples are provided showing the performances of the adaptive LASSO estimator compared to the least squares estimator.
引用
收藏
页码:349 / 374
页数:26
相关论文
共 20 条
[1]   STRONG REPRESENTATIONS FOR LAD ESTIMATORS IN LINEAR-MODELS [J].
BABU, GJ .
PROBABILITY THEORY AND RELATED FIELDS, 1989, 83 (04) :547-558
[2]   Estimating and testing linear models with multiple structural changes [J].
Bai, JS ;
Perron, P .
ECONOMETRICA, 1998, 66 (01) :47-78
[3]   Estimation of multiple-regime regressions with least absolutes deviation [J].
Bai, JS .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 1998, 74 (01) :103-134
[4]   SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR [J].
Bickel, Peter J. ;
Ritov, Ya'acov ;
Tsybakov, Alexandre B. .
ANNALS OF STATISTICS, 2009, 37 (04) :1705-1732
[5]   Estimating nonlinear regression with and without change-points by the LAD method [J].
Ciuperca, Gabriela .
ANNALS OF THE INSTITUTE OF STATISTICAL MATHEMATICS, 2011, 63 (04) :717-743
[6]   Penalized least absolute deviations estimation for nonlinear model with change-points [J].
Ciuperca, Gabriela .
STATISTICAL PAPERS, 2011, 52 (02) :371-390
[7]   The M-estimation in a multi-phase random nonlinear model [J].
Ciuperca, Gabriela .
STATISTICS & PROBABILITY LETTERS, 2009, 79 (05) :573-580
[8]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[9]   ESTIMATION, PREDICTION AND INFERENCE FOR THE LASSO RANDOM EFFECTS MODEL [J].
Foster, Scott D. ;
Verbyla, Arunas P. ;
Pitchford, Wayne S. .
AUSTRALIAN & NEW ZEALAND JOURNAL OF STATISTICS, 2009, 51 (01) :43-61
[10]   Multiple Change-Point Estimation With a Total Variation Penalty [J].
Harchaoui, Z. ;
Levy-Leduc, C. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2010, 105 (492) :1480-1493