RIDGE-REGRESSION ESTIMATOR COMPARISONS USING PITMANS MEASURE OF CLOSENESS

被引:6
作者
MASON, RL
BLAYLOCK, NW
机构
[1] SW RES INST,STAT ANAL SECT,SAN ANTONIO,TX 78238
[2] SW RES INST,DEPT PROD DEV,SAN ANTONIO,TX 78238
关键词
RIDGE REGRESSION; LEAST SQUARES; COLLINEARITY;
D O I
10.1080/03610929108830728
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
The theory presented in Mason, Keating, Sen and Blaylock (1990) and applied to the comparison of ridge regression estimators using Pitman's measure of closeness is illustrated on two data sets, one that contains a strong collinearity and one that is nearly orthogonal. The regions of preference for the ridge regression estimator over the least squares estimator are established and shown to be dependent on the eigenvalues and eigenvectors of the correlation matrix of the predictor variables, the unknown coefficient vector, the error variance, and the value of the biasing constant in the ridge estimator.
引用
收藏
页码:3629 / 3641
页数:13
相关论文
共 11 条
[1]  
CONERLY MD, 1990, J STATISTICAL COMPUT, V34, P75
[2]   RIDGE REGRESSION AND JAMES-STEIN ESTIMATION - REVIEW AND COMMENTS [J].
DRAPER, NR ;
VANNOSTRAND, RC .
TECHNOMETRICS, 1979, 21 (04) :451-466
[3]   CLASS OF BIASED ESTIMATORS IN LINEAR-REGRESSION [J].
HOCKING, RR ;
SPEED, FM ;
LYNN, MJ .
TECHNOMETRICS, 1976, 18 (04) :425-437
[4]   RIDGE REGRESSION - BIASED ESTIMATION FOR NONORTHOGONAL PROBLEMS [J].
HOERL, AE ;
KENNARD, RW .
TECHNOMETRICS, 1970, 12 (01) :55-&
[5]   PRACTICAL RELEVANCE OF AN ALTERNATIVE CRITERION IN ESTIMATION [J].
KEATING, JP ;
MASON, RL .
AMERICAN STATISTICIAN, 1985, 39 (03) :203-205
[6]   JAMES-STEIN ESTIMATION FROM AN ALTERNATIVE PERSPECTIVE [J].
KEATING, JP ;
MASON, RL .
AMERICAN STATISTICIAN, 1988, 42 (02) :160-164
[7]   COMPARISON OF LINEAR ESTIMATORS USING PITMAN MEASURE OF CLOSENESS [J].
MASON, RL ;
KEATING, JP ;
SEN, PK ;
BLAYLOCK, NW .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1990, 85 (410) :579-581
[8]   The "closest" estimates of statistical parameters [J].
Pitman, EJG .
PROCEEDINGS OF THE CAMBRIDGE PHILOSOPHICAL SOCIETY, 1937, 33 :212-222
[9]  
Saleh, 1981, STATISTICS RELATED T, P123
[10]   THE STEIN PARADOX IN THE SENSE OF THE PITMAN MEASURE OF CLOSENESS [J].
SEN, PK ;
KUBOKAWA, T ;
SALEH, AKME .
ANNALS OF STATISTICS, 1989, 17 (03) :1375-1386