FUNCTIONAL ADDITIVE REGRESSION

被引:90
作者
Fan, Yingying [1 ]
James, Gareth M. [1 ]
Radchenk, Peter [1 ]
机构
[1] Univ So Calif, Marshall Sch Business, Data Sci & Operat Dept, Los Angeles, CA 90089 USA
基金
美国国家科学基金会;
关键词
Functional regression; shrinkage; single index model; variable selection; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; MODEL; SINGLE; ESTIMATORS;
D O I
10.1214/15-AOS1346
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We suggest a new method, called Functional Additive Regression, or FAR, for efficiently performing high-dimensional functional regression. FAR extends the usual linear regression model involving a functional predictor, X(t), and a scalar response, Y, in two key respects. First, FAR uses a penalized least squares optimization approach to efficiently deal with high-dimensional problems involving a large number of functional predictors. Second, FAR extends beyond the standard linear regression setting to fit general nonlinear additive models. We demonstrate that FAR can be implemented with a wide range of penalty functions using a highly efficient coordinate descent algorithm. Theoretical results are developed which provide motivation for the FAR optimization criterion. Finally, we show through simulations and two real data sets that FAR can significantly outperform competing methods.
引用
收藏
页码:2296 / 2325
页数:30
相关论文
共 42 条
[31]   Generalized functional linear models [J].
Müller, HG ;
Stadtmüller, U .
ANNALS OF STATISTICS, 2005, 33 (02) :774-805
[32]  
Ramsay J., 2005, Functional Data Analysis
[33]   Sparse additive models [J].
Ravikumar, Pradeep ;
Lafferty, John ;
Liu, Han ;
Wasserman, Larry .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 :1009-1030
[34]  
Schumaker L., 2007, SPLINE FUNCTIONS BAS, DOI DOI 10.1017/CBO9780511618994
[35]   STANDARDIZATION AND THE GROUP LASSO PENALTY [J].
Simon, Noah ;
Tibshirani, Robert .
STATISTICA SINICA, 2012, 22 (03) :983-1001
[36]   Significance analysis of time course microarray experiments [J].
Storey, JD ;
Xiao, WZ ;
Leek, JT ;
Tompkins, RG ;
Davis, RW .
PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (36) :12837-12842
[37]  
Wasserman L., 2006, Springer Texts in Statistics
[38]   Penalized spline estimation for partially linear single-index models [J].
Yu, Y ;
Ruppert, D .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2002, 97 (460) :1042-1054
[39]  
Zhou S, 1998, ANN STAT, V26, P1760
[40]   A Bayesian Hierarchical Model for Classification with Selection of Functional Predictors [J].
Zhu, Hongxiao ;
Vannucci, Marina ;
Cox, Dennis D. .
BIOMETRICS, 2010, 66 (02) :463-473