PLS regression: A directional signal-to-noise ratio approach

被引:15
作者
Druilhet, P
Mom, A
机构
[1] ENSAI, CREST, Bruz, France
[2] Univ Rennes 2, Stat Lab, F-35043 Rennes, France
关键词
biased regression; constrained least squares; regression on components; partial least squares; principal components; shrinkage;
D O I
10.1016/j.jmva.2005.06.009
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
We present a new approach to univariate partial least squares regression (PLSR) based on directional signal-to-noise ratios (SNRs). We show how PLSR, unlike principal components regression, takes into account the actual value and not only the variance of the ordinary least squares (OLS) estimator. We find an orthogonal sequence of directions associated with decreasing SNR. Then, we state partial least squares estimators as least squares estimators constrained to be null on the last directions. We also give another procedure that shows how PLSR rebuilds the OLS estimator iteratively by seeking at each step the direction with the largest difference of signals over the noise. The latter approach does not involve any arbitrary scale or orthogonality constraints. (c) 2005 Elsevier Inc. All rights reserved.
引用
收藏
页码:1313 / 1329
页数:17
相关论文
共 18 条
[1]  
[Anonymous], 1989, MULTIVARIATE CALIBRA
[2]  
Bibby J., 1977, Prediction and Improved Estimation in Linear Models
[3]   SUBMODEL SELECTION AND EVALUATION IN REGRESSION - THE X-RANDOM CASE [J].
BREIMAN, L ;
SPECTOR, P .
INTERNATIONAL STATISTICAL REVIEW, 1992, 60 (03) :291-319
[4]  
Brown P. J., 1993, MEASUREMENT REGRESSI
[5]   The peculiar shrinkage properties of partial least squares regression [J].
Butler, NA ;
Denham, MC .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2000, 62 :585-593
[6]   PLS SHRINKS [J].
DEJONG, S .
JOURNAL OF CHEMOMETRICS, 1995, 9 (04) :323-326
[7]   A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS [J].
FRANK, IE ;
FRIEDMAN, JH .
TECHNOMETRICS, 1993, 35 (02) :109-135
[8]  
Goutis C, 1996, ANN STAT, V24, P816
[9]   COMPARISON OF PREDICTION METHODS WHEN ONLY A FEW COMPONENTS ARE RELEVANT [J].
HELLAND, IS ;
ALMOY, T .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1994, 89 (426) :583-591
[10]   ON THE STRUCTURE OF PARTIAL LEAST-SQUARES REGRESSION [J].
HELLAND, IS .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 1988, 17 (02) :581-607