FUNCTIONAL ADDITIVE REGRESSION

被引:86
作者
Fan, Yingying [1 ]
James, Gareth M. [1 ]
Radchenk, Peter [1 ]
机构
[1] Univ So Calif, Marshall Sch Business, Data Sci & Operat Dept, Los Angeles, CA 90089 USA
基金
美国国家科学基金会;
关键词
Functional regression; shrinkage; single index model; variable selection; NONCONCAVE PENALIZED LIKELIHOOD; VARIABLE SELECTION; MODEL; SINGLE; ESTIMATORS;
D O I
10.1214/15-AOS1346
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We suggest a new method, called Functional Additive Regression, or FAR, for efficiently performing high-dimensional functional regression. FAR extends the usual linear regression model involving a functional predictor, X(t), and a scalar response, Y, in two key respects. First, FAR uses a penalized least squares optimization approach to efficiently deal with high-dimensional problems involving a large number of functional predictors. Second, FAR extends beyond the standard linear regression setting to fit general nonlinear additive models. We demonstrate that FAR can be implemented with a wide range of penalty functions using a highly efficient coordinate descent algorithm. Theoretical results are developed which provide motivation for the FAR optimization criterion. Finally, we show through simulations and two real data sets that FAR can significantly outperform competing methods.
引用
收藏
页码:2296 / 2325
页数:30
相关论文
共 42 条
  • [31] Generalized functional linear models
    Müller, HG
    Stadtmüller, U
    [J]. ANNALS OF STATISTICS, 2005, 33 (02) : 774 - 805
  • [32] Ramsay J., 2005, Functional Data Analysis
  • [33] Sparse additive models
    Ravikumar, Pradeep
    Lafferty, John
    Liu, Han
    Wasserman, Larry
    [J]. JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2009, 71 : 1009 - 1030
  • [34] Schumaker L., 2007, SPLINE FUNCTIONS BAS, DOI DOI 10.1017/CBO9780511618994
  • [35] STANDARDIZATION AND THE GROUP LASSO PENALTY
    Simon, Noah
    Tibshirani, Robert
    [J]. STATISTICA SINICA, 2012, 22 (03) : 983 - 1001
  • [36] Significance analysis of time course microarray experiments
    Storey, JD
    Xiao, WZ
    Leek, JT
    Tompkins, RG
    Davis, RW
    [J]. PROCEEDINGS OF THE NATIONAL ACADEMY OF SCIENCES OF THE UNITED STATES OF AMERICA, 2005, 102 (36) : 12837 - 12842
  • [37] Wasserman L., 2006, Springer Texts in Statistics
  • [38] Penalized spline estimation for partially linear single-index models
    Yu, Y
    Ruppert, D
    [J]. JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2002, 97 (460) : 1042 - 1054
  • [39] Zhou S, 1998, ANN STAT, V26, P1760
  • [40] A Bayesian Hierarchical Model for Classification with Selection of Functional Predictors
    Zhu, Hongxiao
    Vannucci, Marina
    Cox, Dennis D.
    [J]. BIOMETRICS, 2010, 66 (02) : 463 - 473