The principal correlation components estimator and its optimality

被引:2
作者
Guo, Wenxing [1 ]
Liu, Xiaohui [2 ]
Zhang, Shangli [3 ]
机构
[1] Cent Univ Finance & Econ, Sch Math & Stat, Beijing 100081, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Stat, Nanchang 330013, Jiangxi, Peoples R China
[3] Beijing Jiaotong Univ, Sch Sci, Beijing 100044, Peoples R China
关键词
Principal correlation components estimator; Least squares estimator; Principal components regression estimator; Admissible estimator; Balanced loss function; Pitman closeness criterion; BIASED-ESTIMATION; RIDGE-REGRESSION; LEAST-SQUARES; BALANCED LOSS; COLLINEARITY; PREDICTION; PARAMETERS; MODELS; CEMENT;
D O I
10.1007/s00362-015-0678-y
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In regression analysis, the principal components regression estimator (PCRE) is often used to alleviate the effect of multicollinearity by deleting the principal components variables with smaller eigenvalues, but it has some drawbacks for subset selection. So another effective estimator based on the principal components, termed the principal correlation components estimator (PCCE), has been proposed, which selects the variables by considering the correlation coefficients between the principal components variables and the response variable. In this paper we investigate the property of the PCCE and its optimality. We prove that the PCCE is an admissible estimator and obtain the condition that the PCCE performs better than the PCRE under the balanced loss function (BLF). As an improvement of the least squares estimator (LSE), the conditions that the PCCE performs better than LSE under the BLF and the Pitman closeness criterion are derived in the paper. The empirical performance of the PCCE is demonstrated by several real and simulation data examples.
引用
收藏
页码:755 / 779
页数:25
相关论文
共 32 条
[1]   Generalized Liu type estimators under Zellner's balanced loss function [J].
Akdeniz, F ;
Wan, ATK ;
Akdeniz, E .
COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2005, 34 (08) :1725-1736
[2]  
[Anonymous], 1952, Statistical Theory with Engineering Applications
[3]  
Duffy EA, 1967, PHS PUBLICATION
[4]   OPTIMAL PROPERTY OF PRINCIPAL COMPONENTS IN CONTEXT OF RESTRICTED LEAST-SQUARES [J].
FOMBY, TB ;
HILL, RC ;
JOHNSON, SR .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 1978, 73 (361) :191-193
[5]   A STATISTICAL VIEW OF SOME CHEMOMETRICS REGRESSION TOOLS [J].
FRANK, IE ;
FRIEDMAN, JH .
TECHNOMETRICS, 1993, 35 (02) :109-135
[6]   DIAGNOSING COLLINEARITY-INFLUENTIAL OBSERVATIONS [J].
HADI, AS .
COMPUTATIONAL STATISTICS & DATA ANALYSIS, 1988, 7 (02) :143-159
[7]   Some cautionary notes on the use of principal components regression [J].
Hadi, AS ;
Ling, RF .
AMERICAN STATISTICIAN, 1998, 52 (01) :15-19
[8]  
HILL RC, 1987, J ECONOMETRICS, V35, P83
[9]   RIDGE REGRESSION - BIASED ESTIMATION FOR NONORTHOGONAL PROBLEMS [J].
HOERL, AE ;
KENNARD, RW .
TECHNOMETRICS, 1970, 12 (01) :55-&
[10]   Principal components regression with data-chosen components and related methods [J].
Hwang, JTG ;
Nettleton, D .
TECHNOMETRICS, 2003, 45 (01) :70-79