Supervised singular value decomposition and its asymptotic properties

被引:25
作者
Li, Gen [1 ]
Yang, Dan [2 ]
Nobel, Andrew B. [1 ]
Shen, Haipeng [1 ,3 ]
机构
[1] Univ N Carolina, Dept Stat & Operat Res, Chapel Hill, NC USA
[2] Rutgers State Univ, Dept Stat & Biostat, Piscataway, NJ 08855 USA
[3] Univ Hong Kong, Sch Busiriess, Hong Kong, Hong Kong, Peoples R China
基金
美国国家科学基金会;
关键词
Low rank approximation; Principal component analysis; Reduced rank regression; Supervised dimension reduction; SupSVD; LOW-RANK MATRIX; DIMENSION REDUCTION; COMPONENTS;
D O I
10.1016/j.jmva.2015.02.016
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
A supervised singular value decomposition (SupSVD) model has been developed for supervised dimension reduction where the low rank structure of the data of interest is potentially driven by additional variables measured on the same set of samples. The SupSVD model can make use of the information in the additional variables to accurately extract underlying structures that are more interpretable. The model is general and includes the principal component analysis model and the reduced rank regression model as two extreme cases. The model is formulated in a hierarchical fashion using latent variables, and a modified expectation maximization algorithm for parameter estimation is developed, which is computationally efficient. The asymptotic properties for the estimated parameters are derived. We use comprehensive simulations and a real data example to illustrate the advantages of the SupSVD model. (C) 2015 Elsevier Inc. All rights reserved.
引用
收藏
页码:7 / 17
页数:11
相关论文
共 33 条
[1]   Variable selection in infinite-dimensional problems [J].
Aneiros, German ;
Vieu, Philippe .
STATISTICS & PROBABILITY LETTERS, 2014, 94 :12-20
[2]  
[Anonymous], 2012, MATRIX COMPUTATIONS
[3]  
[Anonymous], 2012, INFERENCE FUNCTIONAL
[4]  
[Anonymous], 2005, FUNCTIONAL DATA ANAL
[5]  
[Anonymous], 2014, Contributions in infinite-dimensional statistics and related topics
[6]   Prediction by supervised principal components [J].
Bair, E ;
Hastie, T ;
Paul, D ;
Tibshirani, R .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2006, 101 (473) :119-137
[7]   REMARKS ON PARALLEL ANALYSIS [J].
BUJA, A ;
EYUBOGLU, N .
MULTIVARIATE BEHAVIORAL RESEARCH, 1992, 27 (04) :509-540
[8]   Scaled envelopes: scale-invariant and efficient estimation in multivariate linear regression [J].
Cook, Dennis ;
Su, Zhihua .
BIOMETRIKA, 2013, 100 (04) :939-954
[9]   Envelopes and partial least squares regression [J].
Cook, R. D. ;
Helland, I. S. ;
Su, Z. .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2013, 75 (05) :851-877
[10]   Fisher lecture: Dimension reduction in regression [J].
Cook, R. Dennis .
STATISTICAL SCIENCE, 2007, 22 (01) :1-26