Max-linear regression models with regularization

被引:15
作者
Cui, Qiurong [1 ]
Xu, Yuqing [1 ]
Zhang, Zhengjun [1 ]
Chan, Vincent [1 ]
机构
[1] Univ Wisconsin, Dept Stat, Madison, WI 53706 USA
关键词
Max-linear regression; Regularization; EM algorithm; Econometric model; Business statistics; VARIABLE SELECTION;
D O I
10.1016/j.jeconom.2020.07.017
中图分类号
F [经济];
学科分类号
02 ;
摘要
Motivated by the newly developed max-linear competing copula factor models and max stable nonlinear time series models, we propose a new class of max-linear regression models to take advantages of easy interpretable features embedded in linear regression models. It can be seen that linear relation is a special case of max-linear relation. We develop an EM algorithm based maximum likelihood estimation procedure. The consistency and asymptotics of the estimators for parameters are proved. To advance max-linear models to deal with high dimensional predictors, we adopt the common strategy of regularization in the high dimensional regression literature. We demonstrate the broad applicability of max-linear models using simulation examples and real applications in econometric and business modeling. The results, in terms of predictability, show a significant improvement compared with solely using regular regression models and other existing machine learning methods. The results enhance our understanding of the relationship between the response variable and the predictors, and among the predictors as well. (C) 2020 Elsevier B.V. All rights reserved.
引用
收藏
页码:579 / 600
页数:22
相关论文
共 36 条
[1]  
[Anonymous], 2007, EM ALGORITHM EXTENSI
[2]  
[Anonymous], 2009, Stat Infer Stoch Process, DOI DOI 10.1007/S11203-008-9027-2
[3]  
Bates D.M., 1988, WILEY SERIES PROBABI, DOI [10.1002/9780470316757, DOI 10.1002/9780470316757]
[4]   Simultaneous regression shrinkage, variable selection, and supervised clustering of predictors with OSCAR [J].
Bondell, Howard D. ;
Reich, Brian J. .
BIOMETRICS, 2008, 64 (01) :115-123
[5]  
Breiman L., 2001, IEEE Trans. Broadcast., V45, P5
[6]  
Cotta L., 2016, WORKSH LARG SCAL SPO
[7]   Max-Linear Competing Factor Models [J].
Cui, Qiurong ;
Zhang, Zhengjun .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2018, 36 (01) :62-74
[8]   MAXIMUM LIKELIHOOD FROM INCOMPLETE DATA VIA EM ALGORITHM [J].
DEMPSTER, AP ;
LAIRD, NM ;
RUBIN, DB .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-METHODOLOGICAL, 1977, 39 (01) :1-38
[9]   Finding predictive gene groups from microarray data [J].
Dettling, M ;
Bühlmann, P .
JOURNAL OF MULTIVARIATE ANALYSIS, 2004, 90 (01) :106-131
[10]  
Fan J., 1996, Local Polynomial Smoothing and Its Applications