SPARSE REDUCED RANK REGRESSION WITH NONCONVEX REGULARIZATION

被引:0
作者
Zhao, Ziping [1 ]
Palomar, Daniel P. [1 ]
机构
[1] Hong Kong Univ Sci & Technol, Dept Elect & Comp Engn, Hong Kong, Peoples R China
来源
2018 IEEE STATISTICAL SIGNAL PROCESSING WORKSHOP (SSP) | 2018年
关键词
Multivariate regression; low-rank; variable selection; factor analysis; nonconvex optimization; OPTIMIZATION; LIKELIHOOD; SELECTION; MODEL;
D O I
暂无
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In this paper, the estimation problem for sparse reduced rank regression (SRRR) model is considered. The SRRR model is widely used for dimension reduction and variable selection with applications in signal processing, econometrics, etc. The problem is formulated to minimize the least squares loss with a sparsity-inducing penalty considering an orthogonality constraint. Convex sparsity-inducing functions have been used for SRRR in literature. In this work, a nonconvex function is proposed for better sparsity inducing. An efficient algorithm is developed based on the alternating minimization (or projection) method to solve the nonconvex optimization problem. Numerical simulations show that the proposed algorithm is much more efficient compared to the benchmarks and the nonconvex function can result in a better estimation accuracy.
引用
收藏
页码:811 / 815
页数:5
相关论文
共 25 条
[1]   ESTIMATING LINEAR RESTRICTIONS ON REGRESSION COEFFICIENTS FOR MULTIVARIATE NORMAL DISTRIBUTIONS [J].
ANDERSON, TW .
ANNALS OF MATHEMATICAL STATISTICS, 1951, 22 (03) :327-351
[2]  
[Anonymous], 1984, An introduction to multivariate statistical analysis
[3]  
[Anonymous], 1999, Athena scientific Belmont
[4]  
[Anonymous], 2006, Journal of the Royal Statistical Society, Series B
[5]  
[Anonymous], 2013, Multivariate reduced-rank regression: theory and applications
[6]   Optimization with Sparsity-Inducing Penalties [J].
Bach, Francis ;
Jenatton, Rodolphe ;
Mairal, Julien ;
Obozinski, Guillaume .
FOUNDATIONS AND TRENDS IN MACHINE LEARNING, 2012, 4 (01) :1-106
[7]   The APT model as reduced-rank regression [J].
Bekker, P ;
Dobbelstein, P ;
Wansbeek, T .
JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 1996, 14 (02) :199-202
[8]   Sparse Reduced-Rank Regression for Simultaneous Dimension Reduction and Variable Selection [J].
Chen, Lisha ;
Huang, Jianhua Z. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2012, 107 (500) :1533-1545
[9]   Variable selection via nonconcave penalized likelihood and its oracle properties [J].
Fan, JQ ;
Li, RZ .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (456) :1348-1360
[10]   CONSTRAINED RESTORATION AND THE RECOVERY OF DISCONTINUITIES [J].
GEMAN, D ;
REYNOLDS, G .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (03) :367-383