Leverage and influential observations on the Liu type estimator in the linear regression model with the severe collinearity

被引:11
作者
Eledum, Hussein [1 ]
机构
[1] Univ Tabuk, Dept Stat, Tabuk, Saudi Arabia
关键词
Ridge regression; Multicollinearity; Cook's distance; DFFITS; Leverage; RIDGE-REGRESSION; OUTLIERS;
D O I
10.1016/j.heliyon.2021.e07792
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
In the process of building a linear regression model, the essential part is to identify influential observations. Various influence measures involving Cook's distance and DFFITS are designed to detect the linear regression's influential observations using the Least Squares (LS). The existence of influential observations in the data is complicated by the presence of severe collinearity and affects the efficiency of the detection measures. This paper proposes new diagnostic methods based on the Liu type estimator (LTE) defined by Liu [1]. The Cook's distance and DFFITS for the LTE are introduced. Moreover, approximate formulas for Cook'sdistance and DFFITS are also proposed for LTE. Two real data sets with a high level of multicollinearity among the explanatory variables as well as the simulation study are used to illustrate and evaluate performance of the methodologies presented in this paper.
引用
收藏
页数:15
相关论文
共 26 条
[1]   Regression diagnostics methods for Liu estimator under the general linear regression model [J].
Acar, Tugba Sokut ;
Ozkale, M. Revan .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2020, 49 (03) :771-792
[2]   Influence measures in ridge regression when the error terms follow an Ar(1) process [J].
Acar, Tugba Sokut ;
Ozkale, M. Revan .
COMPUTATIONAL STATISTICS, 2016, 31 (03) :879-898
[3]  
[Anonymous], 2011, J DATA SCI
[4]  
Belsley D.A., 1980, REGRESSION DIAGNOSTI, P313
[5]   REGRESSION DIAGNOSTICS - AN EXPOSITORY TREATMENT OF OUTLIERS AND INFLUENTIAL CASES [J].
BOLLEN, KA ;
JACKMAN, RW .
SOCIOLOGICAL METHODS & RESEARCH, 1985, 13 (04) :510-542
[6]   CENTERING AND SCALING IN RIDGE REGRESSION [J].
BROWN, PJ .
TECHNOMETRICS, 1977, 19 (01) :35-36
[7]   DETECTION OF INFLUENTIAL OBSERVATION IN LINEAR-REGRESSION [J].
COOK, RD .
TECHNOMETRICS, 1977, 19 (01) :15-18
[8]   INFLUENTIAL OBSERVATIONS AND OUTLIERS IN REGRESSION [J].
DRAPER, NR ;
JOHN, JA .
TECHNOMETRICS, 1981, 23 (01) :21-26
[9]   Detecting influential observations in Liu and modified Liu estimators [J].
Ertas, Hasan ;
Erisoglu, Murat ;
Kaciranlar, Selahattin .
JOURNAL OF APPLIED STATISTICS, 2013, 40 (08) :1735-1745
[10]   DIAGNOSING COLLINEARITY-INFLUENTIAL OBSERVATIONS [J].
HADI, AS .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1988, 7 (02) :143-159