Comparison of Liu and two parameter principal component estimator to combat multicollinearity

被引:2
作者
Kaciranlar, Selahattin [1 ]
Ozbay, Nimet [1 ]
Ozkan, Ecem [1 ]
Guler, Huseyin [2 ]
机构
[1] Cukurova Univ, Dept Stat, Fac Sci & Letters, Adana, Turkey
[2] Cukurova Univ, Dept Econometr, Fac Econ & Adm Sci, Adana, Turkey
关键词
Liu regression; multicollinearity; principal component regression; ridge regression; two-parameter estimator; BIASED-ESTIMATION; RIDGE-REGRESSION; SELECTION;
D O I
10.1002/cpe.6737
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Biased estimation methods like ridge regression, Liu-type regression, two-parameter regression and principal component regression have become very popular in the analysis of applied researches for health, economics, chemometrics, and social sciences in recent years. A dataset in such applied fields tends to be characterized by many independent variables on relatively fewer observations. In addition, there is a high degree of near collinearity among the explanatory variables. It is common knowledge that under these conditions, ordinary least squares estimations of regression coefficients may be very unstable, leading to very poor prediction accuracy. The aim of this article is to examine the performance of the combination of principal components regression and some biased regression estimators such as ridge, Liu and two-parameter estimators. For this reason, a real-life application is presented in which different selection methods of the biasing parameters are employed.
引用
收藏
页数:13
相关论文
共 21 条
[1]   ON THE ALMOST UNBIASED GENERALIZED LIU ESTIMATOR UNBIASED ESTIMATION OF THE BIAS AND MSE [J].
AKDENIZ, F ;
KACIRANLAR, S .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1995, 24 (07) :1789-1797
[2]   COMBINING RIDGE AND PRINCIPAL COMPONENT REGRESSION - A MONEY DEMAND ILLUSTRATION [J].
BAYE, MR ;
PARKER, DF .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1984, 13 (02) :197-205
[3]  
Bhat S, 2018, THAIL STATIST, V16, P38
[4]   Combining two-parameter and principal component regression estimators [J].
Chang, Xinfeng ;
Yang, Hu .
STATISTICAL PAPERS, 2012, 53 (03) :549-562
[5]   RIDGE REGRESSION - BIASED ESTIMATION FOR NONORTHOGONAL PROBLEMS [J].
HOERL, AE ;
KENNARD, RW .
TECHNOMETRICS, 1970, 12 (01) :55-&
[6]   Analysis of a complex of statistical variables into principal components [J].
Hotelling, H .
JOURNAL OF EDUCATIONAL PSYCHOLOGY, 1933, 24 :417-441
[7]   Combining the Liu estimator and the principal component regression estimator [J].
Kaçiranlar, S ;
Sakallioglu, S .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2001, 30 (12) :2699-2705
[8]  
Kowalski B., 1982, SYSTEMS INDIRECT OBS, P191
[9]   RETRACTED: Evaluation of the predictive performance of the principal component two-parameter estimator (Retracted Article) [J].
Li, Rong ;
Li, Fei ;
Huang, Jiewu .
CONCURRENCY AND COMPUTATION-PRACTICE & EXPERIENCE, 2019, 31 (12)
[10]  
LIU KJ, 1993, COMMUN STAT THEORY, V22, P393