Simultaneous variable selection and smoothing for high-dimensional function-on-scalar regression

被引:14
作者
Parodi, Alice [1 ]
Reimherr, Matthew [2 ]
机构
[1] Politecn Milan, MOX Dept Math, Milan, Italy
[2] Penn State Univ, Dept Stat, University Pk, PA 16802 USA
来源
ELECTRONIC JOURNAL OF STATISTICS | 2018年 / 12卷 / 02期
关键词
Nonlinear regression; variable selection; functional data analysis; reproducing kernel Hilbert space; minimax convergence; VARYING-COEFFICIENT MODELS; ADAPTIVE LASSO; CHILDHOOD;
D O I
10.1214/18-EJS1509
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present a new methodology, called FLAME, which simultaneously selects important predictors and produces smooth estimates in a function-on-scalar linear model with a large number of scalar predictors. Our framework applies quite generally by viewing the functional outcomes as elements of an arbitrary real separable Hilbert space. To select important predictors while also producing smooth parameter estimates, we utilize operators to define subspaces that are imbued with certain desirable properties as determined by the practitioner and the setting, such as smoothness or periodicity. In special cases one can show that these subspaces correspond to Reproducing Kernel Hilbert Spaces, however our methodology applies more broadly. We provide a very fast algorithm for computing the estimators, which is based on a functional coordinate descent, and an B. package, flm, whose backend is written in C++. Asymptotic properties of the estimators are developed and simulations are provided to illustrate the advantages of FLAME over existing methods, both in terms of statistical performance and computational efficiency. We conclude with an application to childhood asthma, where we find a potentially important genetic mutation that was not selected by previous functional data based methods.
引用
收藏
页码:4602 / 4639
页数:38
相关论文
共 38 条
[1]  
[Anonymous], 1963, Linear operators. Part II: Spectral theory. Self adjoint operators in Hilbert space
[2]  
[Anonymous], 2015, Advances in Neural Information Processing Systems
[3]   The function-on-scalar LASSO with applications to longitudinal GWAS [J].
Barber, Rina Foygel ;
Reimherr, Matthew ;
Schill, Thomas .
ELECTRONIC JOURNAL OF STATISTICS, 2017, 11 (01) :1351-1389
[4]  
Barbu V., 2012, CONVEXITY OPTIMIZATI
[5]  
Bauschke HH, 2011, CMS BOOKS MATH, P1, DOI 10.1007/978-1-4419-9467-7
[6]  
Berlinet Alain, 2011, REPRODUCING KERNEL H
[7]  
BOYD S., 2004, CONVEX OPTIMIZATION, DOI 10.1017/CBO9780511804441
[8]   Variable selection in high-dimensional linear models: partially faithful distributions and the PC-simple algorithm [J].
Buehlmann, P. ;
Kalisch, M. ;
Maathuis, M. H. .
BIOMETRIKA, 2010, 97 (02) :261-278
[9]   CLT in functional linear regression models [J].
Cardot, Herve ;
Mas, Andre ;
Sarda, Pascal .
PROBABILITY THEORY AND RELATED FIELDS, 2007, 138 (3-4) :325-361
[10]   Variable selection in function-on-scalar regression [J].
Chen, Yakuan ;
Goldsmith, Jeff ;
Ogden, R. Todd .
STAT, 2016, 5 (01) :88-101