Multicolinearity and ridge regression: results on type I errors, power and heteroscedasticity

被引:12
作者
Wilcox, Rand R. [1 ]
机构
[1] Univ Southern Calif, Dept Psychol, Los Angeles, CA 90007 USA
关键词
Regression; multicolinearity; heteroscedasticity; ROBUST RIDGE; TESTS;
D O I
10.1080/02664763.2018.1526891
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Let be the slope parameters in a linear regression model and consider the goal of testing (). A well-known concern is that multicolinearity can inflate the standard error of the least squares estimate of , which in turn can result in relatively low power. The paper examines heteroscedastic methods for dealing with this issue via a ridge regression estimator. A method is found that might substantially increase the probability of identifying a single slope that differs from zero. But due to the bias of the ridge estimator, it cannot reject for more than one value of j. Simulations indicate that the increase in power is a function of the correlations among the dependent variables as well as the nature of the distributions generating the data.
引用
收藏
页码:946 / 957
页数:12
相关论文
共 24 条
[21]   Biased estimation and hypothesis testing in linear regression [J].
Stahlecker, P ;
Schmidt, K .
ACTA APPLICANDAE MATHEMATICAE, 1996, 43 (01) :145-151
[22]  
Wilcox R., 2017, INTRO ROBUST ESTIMAT
[23]   Within groups analysis of covariance: multiple comparisons at specified design points using a robust measure location when there is curvature [J].
Wilcox, Rand R. .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2015, 85 (16) :3236-3246
[24]   Regularization and variable selection via the elastic net [J].
Zou, H ;
Hastie, T .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2005, 67 :301-320