FUNCTIONAL ADDITIVE REGRESSION

被引:90
作者
Fan, Yingying [1 ]
James, Gareth M. [1 ]
Radchenk, Peter [1 ]
机构
[1] Univ So Calif, Marshall Sch Business, Data Sci & Operat Dept, Los Angeles, CA 90089 USA
基金
美国国家科学基金会;
关键词
Functional regression; shrinkage; single index model; variable selection; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; MODEL; SINGLE; ESTIMATORS;
D O I
10.1214/15-AOS1346
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We suggest a new method, called Functional Additive Regression, or FAR, for efficiently performing high-dimensional functional regression. FAR extends the usual linear regression model involving a functional predictor, X(t), and a scalar response, Y, in two key respects. First, FAR uses a penalized least squares optimization approach to efficiently deal with high-dimensional problems involving a large number of functional predictors. Second, FAR extends beyond the standard linear regression setting to fit general nonlinear additive models. We demonstrate that FAR can be implemented with a wide range of penalty functions using a highly efficient coordinate descent algorithm. Theoretical results are developed which provide motivation for the FAR optimization criterion. Finally, we show through simulations and two real data sets that FAR can significantly outperform competing methods.
引用
收藏
页码:2296 / 2325
页数:30
相关论文
共 42 条
[21]   VARIABLE SELECTION IN NONPARAMETRIC ADDITIVE MODELS [J].
Huang, Jian ;
Horowitz, Joel L. ;
Wei, Fengrong .
ANNALS OF STATISTICS, 2010, 38 (04) :2282-2313
[22]   Functional adaptive model estimation [J].
James, GM ;
Silverman, BW .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2005, 100 (470) :565-576
[23]   Generalized linear models with functional predictors [J].
James, GM .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2002, 64 :411-432
[25]   Functional partial linear model [J].
Lian, Heng .
JOURNAL OF NONPARAMETRIC STATISTICS, 2011, 23 (01) :115-128
[26]  
Loh PL, 2015, J MACH LEARN RES, V16, P559
[27]   A UNIFIED APPROACH TO MODEL SELECTION AND SPARSE RECOVERY USING REGULARIZED LEAST SQUARES [J].
Lv, Jinchi ;
Fan, Yingying .
ANNALS OF STATISTICS, 2009, 37 (6A) :3498-3528
[28]   The ARHD model [J].
Mas, Andre ;
Pumo, Besnik .
JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2007, 137 (02) :538-553
[29]   HIGH-DIMENSIONAL ADDITIVE MODELING [J].
Meier, Lukas ;
van de Geer, Sara ;
Buehlmann, Peter .
ANNALS OF STATISTICS, 2009, 37 (6B) :3779-3821
[30]   Functional Additive Models [J].
Mueller, Hans-Georg ;
Yao, Fang .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2008, 103 (484) :1534-1544