A nonparametric empirical Bayes approach to large-scale multivariate regression

被引:4
作者
Wang, Yihe [1 ]
Zhao, Sihai Dave [1 ]
机构
[1] Univ Illinois, Dept Stat, Urbana, IL 61820 USA
关键词
Compound decision; Multivariate regression; Nonparametric; Empirical Bayes; CONVEX-OPTIMIZATION; MAXIMUM-LIKELIHOOD; LINEAR-REGRESSION; MODELS;
D O I
10.1016/j.csda.2020.107130
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Multivariate regression has many applications, ranging from time series prediction to genomics. Borrowing information across the outcomes can improve prediction error, even when outcomes are statistically independent. Many methods exist to implement this strategy, for example the multiresponse lasso, but choosing the optimal method for a given dataset is difficult. These issues are addressed by establishing a connection between multivariate linear regression and compound decision problems. A nonparametric empirical Bayes procedure that can learn the optimal regression method from the data itself is proposed. Furthermore, the proposed procedure is free of tuning parameters and performs well in simulations and in a multiple stock price prediction problem. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页数:13
相关论文
共 36 条
[1]   ESTIMATING LINEAR RESTRICTIONS ON REGRESSION COEFFICIENTS FOR MULTIVARIATE NORMAL DISTRIBUTIONS [J].
ANDERSON, TW .
ANNALS OF MATHEMATICAL STATISTICS, 1951, 22 (03) :327-351
[2]   Predicting multivariate responses in multiple linear regression [J].
Breiman, L ;
Friedman, JH .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1997, 59 (01) :3-37
[3]   ADAPTIVE MULTIVARIATE RIDGE-REGRESSION [J].
BROWN, PJ ;
ZIDEK, JV .
ANNALS OF STATISTICS, 1980, 8 (01) :64-74
[4]  
Calhoun Vince D, 2012, IEEE Rev Biomed Eng, V5, P60, DOI 10.1109/RBME.2012.2211076
[5]  
Dicker Lee H., 2013, Advances in Neural Information Processing Systems 26, P270
[6]   Two Modeling Strategies for Empirical Bayes Estimation [J].
Efron, Bradley .
STATISTICAL SCIENCE, 2014, 29 (02) :285-301
[7]   Sure independence screening for ultrahigh dimensional feature space [J].
Fan, Jianqing ;
Lv, Jinchi .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 :849-883
[8]   Approximate nonparametric maximum likelihood for mixture models: A convex optimization approach to fitting arbitrary multivariate mixing distributions [J].
Feng, Long ;
Dicker, Lee H. .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2018, 122 :80-91
[9]  
Fiebig Denzil G., 2001, COMPANION THEORETICA, P101
[10]   Regularization Paths for Generalized Linear Models via Coordinate Descent [J].
Friedman, Jerome ;
Hastie, Trevor ;
Tibshirani, Rob .
JOURNAL OF STATISTICAL SOFTWARE, 2010, 33 (01) :1-22