Robust Liu Estimator Used to Combat Some Challenges in Partially Linear Regression Model by Improving LTS Algorithm Using Semidefinite Programming

被引:3
作者
Altukhaes, Waleed B. [1 ,2 ]
Roozbeh, Mahdi [3 ]
Mohamed, Nur A. [1 ]
机构
[1] Univ Malaya, Fac Sci, Inst Math Sci, Kuala Lumpur 50603, Malaysia
[2] Shaqra Univ, Coll Sci & Humanities, Dept Math, Sahqra 11961, Saudi Arabia
[3] Semnan Univ, Fac Math Stat & Comp Sci, Dept Stat, Semnan 3513119111, Iran
关键词
generalized Liu estimator; least trimmed squares estimator; linear restriction; multicollinearity; outlier; partially linear regression models; RIDGE-REGRESSION; SQUARES;
D O I
10.3390/math12172787
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
Outliers are a common problem in applied statistics, together with multicollinearity. In this paper, robust Liu estimators are introduced into a partially linear model to combat the presence of multicollinearity and outlier challenges when the error terms are not independent and some linear constraints are assumed to hold in the parameter space. The Liu estimator is used to address the multicollinearity, while robust methods are used to handle the outlier problem. In the literature on the Liu methodology, obtaining the best value for the biased parameter plays an important role in model prediction and is still an unsolved problem. In this regard, some robust estimators of the biased parameter are proposed based on the least trimmed squares (LTS) technique and its extensions using a semidefinite programming approach. Based on a set of observations with a sample size of n, and the integer trimming parameter h <= n, the LTS estimator computes the hyperplane that minimizes the sum of the lowest h squared residuals. Even though the LTS estimator is statistically more effective than the widely used least median squares (LMS) estimate, it is less complicated computationally than LMS. It is shown that the proposed robust extended Liu estimators perform better than classical estimators. As part of our proposal, using Monte Carlo simulation schemes and a real data example, the performance of robust Liu estimators is compared with that of classical ones in restricted partially linear models.
引用
收藏
页数:23
相关论文
共 47 条
[1]   Generalized difference-based weighted mixed almost unbiased liu estimator in semiparametric regression models [J].
Akdeniz, Fikri ;
Roozbeh, Mahdi ;
Akdeniz, Esra ;
Khan, Naushad Mamode .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2022, 51 (13) :4395-4416
[2]   Restricted Ridge Estimators of the Parameters in Semiparametric Regression Model [J].
Akdeniz, Fikri ;
Tabakan, Guelin .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2009, 38 (11) :1852-1869
[3]   A new improved Liu estimator for the QSAR model with inverse Gaussian response [J].
Akram, Muhammad Nauman ;
Amin, Muhammad ;
Kibria, B. M. Golam ;
Arashi, Mohammad ;
Lukman, Adewale F. ;
Afzal, Nimra .
COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2024, 53 (04) :1873-1888
[4]   SPARSE LEAST TRIMMED SQUARES REGRESSION FOR ANALYZING HIGH-DIMENSIONAL LARGE DATA SETS [J].
Alfons, Andreas ;
Croux, Christophe ;
Gelper, Sarah .
ANNALS OF APPLIED STATISTICS, 2013, 7 (01) :226-248
[5]   On ridge parameter estimators under stochastic subspace hypothesis [J].
Arashi, M. ;
Kibria, B. M. Golam ;
Valizadeh, T. .
JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2017, 87 (05) :966-983
[6]   Performance of Kibria's methods in partial linear ridge regression model [J].
Arashi, M. ;
Valizadeh, T. .
STATISTICAL PAPERS, 2015, 56 (01) :231-246
[7]   A note on Stein-type shrinkage estimator in partial linear models [J].
Arashi, M. ;
Roozbeh, M. ;
Niroumand, H. A. .
STATISTICS, 2012, 46 (05) :673-685
[8]   Liu regression after random forest for prediction and modeling in high dimension [J].
Arashi, Mohammad ;
Lukman, Adewale F. ;
Algamal, Zakariya Y. .
JOURNAL OF CHEMOMETRICS, 2022, 36 (04)
[9]   Difference based ridge and Liu type estimators in semiparametric regression models [J].
Duran, Esra Akdeniz ;
Haerdle, Wolfgang Karl ;
Osipenko, Maria .
JOURNAL OF MULTIVARIATE ANALYSIS, 2012, 105 (01) :164-175