Bayesian Sparse Partial Least Squares

被引:17
作者
Vidaurre, Diego [1 ]
van Gerven, Marcel A. J. [2 ]
Bielza, Concha [3 ]
Larranaga, Pedro [3 ]
Heskes, Tom [4 ]
机构
[1] Univ Oxford, Oxford Ctr Human Brain Act, Oxford OX3 7JX, England
[2] Radboud Univ Nijmegen, Donders Inst Brain Cognit & Behav, NL-6525 H Nijmegen, Netherlands
[3] Univ Politecn Madrid, Computat Intelligence Grp, E-28660 Madrid, Spain
[4] Radboud Univ Nijmegen, Inst Comp & Informat Sci, NL-6525 H Nijmegen, Netherlands
关键词
DIMENSION REDUCTION; REGRESSION; ALGORITHM;
D O I
10.1162/NECO_a_00524
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Partial least squares (PLS) is a class of methods that makes use of a set of latent or unobserved variables to model the relation between (typically) two sets of input and output variables, respectively. Several flavors, depending on how the latent variables or components are computed, have been developed over the last years. In this letter, we propose a Bayesian formulation of PLS along with some extensions. In a nutshell, we provide sparsity at the input space level and an automatic estimation of the optimal number of latent components. We follow the variational approach to infer the parameter distributions. We have successfully tested the proposed methods on a synthetic data benchmark and on electrocorticogram data associated with several motor outputs in monkeys.
引用
收藏
页码:3318 / 3339
页数:22
相关论文
共 29 条
[1]  
Ando RK, 2005, J MACH LEARN RES, V6, P1817
[2]  
Argyriou A., 2006, Advances in Neural Information Processing Systems, P41, DOI DOI 10.1007/S10994-007-5040-8
[3]   Partial least squares for discrimination [J].
Barker, M ;
Rayens, W .
JOURNAL OF CHEMOMETRICS, 2003, 17 (03) :166-173
[4]  
Beal M. J., 2003, VARIATIONAL ALGORITH
[5]  
Bishop C., 1998, Advances in neural information processing systems, V11
[6]   ADAPTIVE MULTIVARIATE RIDGE-REGRESSION [J].
BROWN, PJ ;
ZIDEK, JV .
ANNALS OF STATISTICS, 1980, 8 (01) :64-74
[7]   Sparse partial least squares regression for simultaneous dimension reduction and variable selection [J].
Chun, Hyonho ;
Keles, Suenduez .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2010, 72 :3-25
[8]   SIMPLS - AN ALTERNATIVE APPROACH TO PARTIAL LEAST-SQUARES REGRESSION [J].
DEJONG, S .
CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 1993, 18 (03) :251-263
[9]   A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS [J].
FRANK, IE ;
FRIEDMAN, JH .
TECHNOMETRICS, 1993, 35 (02) :109-135
[10]  
Friedman J., 2008, The Elements of Statistical Learning