On Some Ridge Regression Estimators: An Empirical Comparisons

被引:223
作者
Muniz, Gisela [1 ]
Kibria, B. M. Golam [1 ]
机构
[1] Florida Int Univ, Dept Stat, Miami, FL 33199 USA
关键词
Bias; Estimation; MSE; Multicollinearity; Ridge regression; Simulation;
D O I
10.1080/03610910802592838
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In ridge regression analysis, the estimation of the ridge parameter k is an important problem. Many methods are available for estimating such a parameter. This article reviewed and proposed some estimators based on Kibria (2003) and Khalaf and Shukur (2005). A simulation study has been made and mean squared error (MSE) criteria are used to compare the performances of the estimators. We observed that under certain conditions some of the proposed estimators performed well compared to the ordinary least squared (OLS) estimator and some existing popular estimators. Finally, a numerical example has been considered to illustrate the performance of the estimators.
引用
收藏
页码:621 / 630
页数:10
相关论文
共 19 条
[1]   Developing ridge parameters for SUR model [J].
Alkhamisi, M. A. ;
Shukur, G. .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2008, 37 (04) :544-564
[2]   Some modifications for choosing ridge parameters [J].
Alkhamisi, Mahdi ;
Khalaf, Ghadban ;
Shukur, Ghazi .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2006, 35 (11) :2005-2020
[3]  
[Anonymous], 1952, Statistical Theory with Engineering Applications
[4]  
[Anonymous], TECHNOMETRICS
[5]  
DANIEL C, 1980, ASSISTANCE JW GORMAN
[6]   SIMULATION STUDY OF ALTERNATIVES TO ORDINARY LEAST-SQUARES [J].
DEMPSTER, AP ;
SCHATZOFF, M ;
WERMUTH, N .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1977, 72 (357) :77-93
[7]   A SIMULATION STUDY OF SOME RIDGE ESTIMATORS [J].
GIBBONS, DG .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1981, 76 (373) :131-139
[8]   Choosing ridge parameter for regression problems [J].
Khalaf, G ;
Shukur, G .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2005, 34 (05) :1177-1182
[9]   Performance of some new ridge regression estimators [J].
Kibria, BMG .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2003, 32 (02) :419-435
[10]   SIMULATION STUDY OF RIDGE AND OTHER REGRESSION ESTIMATORS [J].
LAWLESS, JF ;
WANG, P .
COMMUNICATIONS IN STATISTICS PART A-THEORY AND METHODS, 1976, A 5 (04) :307-323