On the estimation of ridge penalty in linear regression: Simulation and application

被引:4
作者
Khan, Muhammad Shakir [1 ,2 ]
Ali, Amjad [1 ]
Suhail, Muhammad [3 ]
Alotaibi, Eid Sadun [4 ]
Alsubaie, Nahaa Eid [4 ]
机构
[1] Islamia Coll Peshawar, Peshawar, Pakistan
[2] Livestock & Dairy Dev Dept Research Wing Peshawar, Khyber Pakhtunkhwa, Pakistan
[3] Univ Agr, Dept Stat, Peshawar Amir Muhammad Khan Campus, Mardan, Pakistan
[4] Taif Univ, AlKhurmah Univ Coll, Dept Math, POB 11099, Taif 21944, Saudi Arabia
关键词
Linear regression model; Multicollinearity; Ridge regression; Two parameter ridge estimators; Mean square error; Monte Carlo simulation; Prediction; PERFORMANCE;
D O I
10.1016/j.kjs.2024.100273
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
According to existing literature, the ordinary least squares (OLS) estimators are not the best in presence of multicollinearity. The inability of OLS estimators against multicollinearity has paved the way for the development of various ridge type estimators for circumventing the problem of multicollinearity. In this paper improved two-parameter ridge (ITPR) estimators are proposed. A simulation study is used to evaluate the performance of proposed estimators based on minimum mean squared error (MSE) criterion. The simulative results reveal that, based on minimum MSE, ITPR2 was the most efficient estimator compared to the considered estimators in the study. Finally, a real-life dataset is analyzed to demonstrate the applications of the proposed estimators and also checked their efficacy for mitigation of multicollinearity.
引用
收藏
页数:10
相关论文
共 22 条
[1]  
Belsley D.A., 1980, DIAGNOSTICS IDENTIFY
[2]  
Chatterjee S., 1977, Regression analysis by example.
[3]   Collinearity: revisiting the variance inflation factor in ridge regression [J].
Garcia, C. B. ;
Garcia, J. ;
Lopez Martin, M. M. ;
Salmeron, R. .
JOURNAL OF APPLIED STATISTICS, 2015, 42 (03) :648-661
[4]   A review of ridge parameter selection: minimization of the mean squared error vs. mitigation of multicollinearity [J].
Garcia Garcia, Catalina ;
Salmeron Gomez, Roman ;
Garcia Perez, Jose .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2024, 53 (08) :3686-3698
[5]   Standardization of Variables and Collinearity Diagnostic in Ridge Regression [J].
Garcia, Jose ;
Salmeron, Roman ;
Garcia, Catalina ;
Lopez Martin, Maria del Mar .
INTERNATIONAL STATISTICAL REVIEW, 2016, 84 (02) :245-266
[6]   Tests of regression coefficients under ridge regression models [J].
Halawa, AM ;
El Bassiouni, MY .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2000, 65 (04) :341-356
[7]   CLASS OF BIASED ESTIMATORS IN LINEAR-REGRESSION [J].
HOCKING, RR ;
SPEED, FM ;
LYNN, MJ .
TECHNOMETRICS, 1976, 18 (04) :425-437
[8]   RIDGE REGRESSION - SOME SIMULATIONS [J].
HOERL, AE ;
KENNARD, RW ;
BALDWIN, KF .
COMMUNICATIONS IN STATISTICS, 1975, 4 (02) :105-123
[9]   RIDGE REGRESSION - APPLICATIONS TO NONORTHOGONAL PROBLEMS [J].
HOERL, AE ;
KENNARD, RW .
TECHNOMETRICS, 1970, 12 (01) :69-&
[10]   Ridge regression: Biased estimation for nonorthogonal problems [J].
Hoerl, AE ;
Kennard, RW .
TECHNOMETRICS, 2000, 42 (01) :80-86