Choice of the ridge factor from the correlation matrix determinant

被引:13
作者
Garcia, Claudia [1 ]
Salmeron Gomez, Roman [2 ]
Garcia, Catalina B. [2 ]
机构
[1] Univ Granada, Doctoral Program Econ & Business Sci, Granada, Spain
[2] Univ Granada, Dept Quantitat Methods Econ & Business, Fac Econ & Business, Granada, Spain
关键词
Multicollinearity; ridge regression; variance inflation factor; mean square error; VARIANCE INFLATION FACTOR; REGRESSION ESTIMATORS; SIMULATION; PARAMETER;
D O I
10.1080/00949655.2018.1543423
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Ridge regression is the alternative method to ordinary least squares, which is mostly applied when a multiple linear regression model presents a worrying degree of collinearity. A relevant topic in ridge regression is the selection of the ridge parameter, and different proposals have been presented in the scientific literature. Since the ridge estimator is biased, its estimation is normally based on the calculation of the mean square error (MSE) without considering (to the best of our knowledge) whether the proposed value for the ridge parameter really mitigates the collinearity. With this goal and different simulations, this paper proposes to estimate the ridge parameter from the determinant of the matrix of correlation of the data, which verifies that the variance inflation factor (VIF) is lower than the traditionally established threshold. The possible relation between the VIF and the determinant of the matrix of correlation is also analysed. Finally, the contribution is illustrated with three real examples.
引用
收藏
页码:211 / 231
页数:21
相关论文
共 27 条
[2]  
Dorugade A.V., 2010, Applied Math. Sci, V4, P447
[3]  
Duzan H., 2015, INDIAN J SCI TECHNOL, V8
[4]   GENERALIZED COLLINEARITY DIAGNOSTICS [J].
FOX, J ;
MONETTE, G .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1992, 87 (417) :178-183
[5]  
Garcia C., 2017, Indian J Sci Technol, V10, P1, DOI [10.17485/ijst/2017/v10i13/98678, DOI 10.17485/ijst/2017/v10i13/98678]
[6]   Collinearity: revisiting the variance inflation factor in ridge regression [J].
Garcia, C. B. ;
Garcia, J. ;
Lopez Martin, M. M. ;
Salmeron, R. .
JOURNAL OF APPLIED STATISTICS, 2015, 42 (03) :648-661
[7]   Standardization of Variables and Collinearity Diagnostic in Ridge Regression [J].
Garcia, Jose ;
Salmeron, Roman ;
Garcia, Catalina ;
Lopez Martin, Maria del Mar .
INTERNATIONAL STATISTICAL REVIEW, 2016, 84 (02) :245-266
[8]   A SIMULATION STUDY OF SOME RIDGE ESTIMATORS [J].
GIBBONS, DG .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1981, 76 (373) :131-139
[9]   Tests of regression coefficients under ridge regression models [J].
Halawa, AM ;
El Bassiouni, MY .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2000, 65 (04) :341-356
[10]   CLASS OF BIASED ESTIMATORS IN LINEAR-REGRESSION [J].
HOCKING, RR ;
SPEED, FM ;
LYNN, MJ .
TECHNOMETRICS, 1976, 18 (04) :425-437