Robust variable selection for additive coefficient models

被引:0
作者
Zou, Hang [1 ]
Huang, Xiaowen [2 ]
Jiang, Yunlu [2 ]
机构
[1] Guangdong Univ Foreign Studies, Sch Math & Stat, Guangzhou 510006, Peoples R China
[2] Jinan Univ, Coll Econ, Dept Stat & Data Sci, Guangzhou 510632, Peoples R China
关键词
Additive coefficient models; Exponential squared loss function; B-splines; Robustness; Variable selection; NONCONCAVE PENALIZED LIKELIHOOD; REGRESSION;
D O I
10.1007/s00180-024-01524-y
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Additive coefficient models generalize linear regression models by assuming that the relationship between the response and some covariates is linear, while their regression coefficients are additive functions. Because of its advantages in dealing with the "curse of dimensionality", additive coefficient models gain a lot of attention. The commonly used estimation methods for additive coefficient models are not robust against high leverage points. To circumvent this difficulty, we develop a robust variable selection procedure based on the exponential squared loss function and group penalty for the additive coefficient models, which can tackle outliers in the response and covariates simultaneously. Under some regularity conditions, we show that the oracle estimator is a local solution of the proposed method. Furthermore, we apply the local linear approximation and minorization-maximization algorithm for the implementation of the proposed estimator. Meanwhile, we propose a data-driven procedure to select the tuning parameters. Simulation studies and an application to a plasma beta-carotene level data set illustrate that the proposed method can offer more reliable results than other existing methods in contamination schemes.
引用
收藏
页码:977 / 997
页数:21
相关论文
共 36 条
[1]  
Bertsekas D.P., 1995, NONLINEAR PROGRAMMIN, DOI DOI 10.1057/PALGRAVE.JORS.2600425
[2]   NONLINEAR ADDITIVE ARX MODELS [J].
CHEN, R ;
TSAY, RS .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (423) :955-967
[3]   FUNCTIONAL-COEFFICIENT AUTOREGRESSIVE MODELS [J].
CHEN, R ;
TSAY, RS .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1993, 88 (421) :298-308
[4]   Pursuit of dynamic structure in quantile additive models with longitudinal data [J].
Cui, Xia ;
Zhao, Weihua ;
Lian, Heng ;
Liang, Hua .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2019, 130 :42-60
[5]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[6]   Quantile regression for additive coefficient models in high dimensions [J].
Fan, Zengyan ;
Lian, Heng .
JOURNAL OF MULTIVARIATE ANALYSIS, 2018, 164 :54-64
[7]   Variable selection in high-dimensional partially linear additive models for composite quantile regression [J].
Guo, Jie ;
Tang, Manlai ;
Tian, Maozai ;
Zhu, Kai .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2013, 65 :56-67
[8]  
HASTIE T, 1993, J ROY STAT SOC B MET, V55, P757
[9]  
He P., 2023, COMMUN STAT-THEOR M, V27, P1
[10]   A tutorial on MM algorithms [J].
Hunter, DR ;
Lange, K .
AMERICAN STATISTICIAN, 2004, 58 (01) :30-37