Comparisons of the unbiased ridge estimation to the other estimations

被引:5
作者
Ozkale, M. Revan [1 ]
Kaciranlar, Selahattin [1 ]
机构
[1] Cukurova Univ, Fac Sci & Letters, Dept Stat, TR-01330 Adana, Turkey
关键词
multicollinearity; ordinary least squares estimator; ordinary ridge regression estimator; residual; r - k class estimator; unbiased ridge regression estimator;
D O I
10.1080/03610920601033652
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In the presence of multicollinearity, ordinary least squares (OLS) estimation is inadequate. Alternative estimation techniques were proposed. One of which is unbiased ridge regression (URR) estimator given by Crouse et al. (1995). In this article, we introduced the URR estimator in two different ways by following Farebrother (1984) and Troskie et al. (1994). We discuss its properties in some detail, comparing URR estimator to the OLS, the ordinary ridge regression (ORR), and the r - k class estimators in the sense of matrix mean square error (MMSE) and residuals. We also illustrate our findings with a numerical example based on the data generated by Hoerl and Kennard (1981) which is commonly used in literature to study the effect of multicollinearity.
引用
收藏
页码:707 / 723
页数:17
相关论文
共 17 条
[1]   The examination and analysis of residuals for some biased estimators in linear regression [J].
Akdeniz, F .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2001, 30 (06) :1171-1183
[2]   ON THE ALMOST UNBIASED GENERALIZED LIU ESTIMATOR UNBIASED ESTIMATION OF THE BIAS AND MSE [J].
AKDENIZ, F ;
KACIRANLAR, S .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1995, 24 (07) :1789-1797
[3]   COMBINING RIDGE AND PRINCIPAL COMPONENT REGRESSION - A MONEY DEMAND ILLUSTRATION [J].
BAYE, MR ;
PARKER, DF .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1984, 13 (02) :197-205
[4]  
Belsley D. A., 1980, REGRESSION DIAGNOSTI
[5]   UNBIASED RIDGE ESTIMATION WITH PRIOR INFORMATION AND RIDGE TRACE [J].
CROUSE, RH ;
JIN, C ;
HANUMARA, RC .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1995, 24 (09) :2341-2354
[6]   THE RESTRICTED LEAST-SQUARES ESTIMATOR AND RIDGE-REGRESSION [J].
FAREBROTHER, RW .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1984, 13 (02) :191-196
[7]   RIDGE REGRESSION - SOME SIMULATIONS [J].
HOERL, AE ;
KENNARD, RW ;
BALDWIN, KF .
COMMUNICATIONS IN STATISTICS, 1975, 4 (02) :105-123
[8]   RIDGE REGRESSION - BIASED ESTIMATION FOR NONORTHOGONAL PROBLEMS [J].
HOERL, AE ;
KENNARD, RW .
TECHNOMETRICS, 1970, 12 (01) :55-&
[9]  
Hoerl AE., 1981, AMER J MATH MANAGE S, V1, P5, DOI 10.1080/01966324.1981.10737061
[10]  
LIU KJ, 1993, COMMUN STAT THEORY, V22, P393