CORRELATION WEIGHTS IN MULTIPLE REGRESSION

被引:0
作者
Waller, Niels G. [1 ]
Jones, Jeff A. [1 ]
机构
[1] Univ Minnesota, Dept Psychol, Minneapolis, MN 55455 USA
关键词
multiple regression; correlation weights; alternate weights; parameter sensitivity; LINEAR-MODELS; ESTIMATING COEFFICIENTS; EQUAL WEIGHTS; NO NEVERMIND; SENSITIVITY; ALTERNATIVES; PREDICTION; COMPOSITE;
D O I
暂无
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
A general theory on the use of correlation weights in linear prediction has yet to be proposed. In this paper we take initial steps in developing such a theory by describing the conditions under which correlation weights perform well in population regression models. Using OLS weights as a comparison, we define cases in which the two weight systems yield maximally correlated composites and when they yield minimally similar weights. We then derive the least squares weights (for any set of predictors) that yield the largest drop in R-2 (the coefficient of determination) when switching to correlation weights. Our findings suggest that two characteristics of a model/data combination are especially important in determining the effectiveness of correlation weights: (1) the condition number of the predictor correlation matrix, R-xx, and (2) the orientation of the correlation weights to the latent vectors of R-xx.
引用
收藏
页码:58 / 69
页数:12
相关论文
共 50 条
[11]   Multiple Regression in Pair Correlation Solution [J].
Lipovetsky, Stan .
JOURNAL OF MODERN APPLIED STATISTICAL METHODS, 2009, 8 (01) :122-131
[12]   MULTIPLE CORRELATION AND REGRESSION IN PREDICTING MILK PRICE [J].
Popescu, Agatha .
SCIENTIFIC PAPERS-SERIES MANAGEMENT ECONOMIC ENGINEERING IN AGRICULTURE AND RURAL DEVELOPMENT, 2015, 15 (04) :231-238
[13]   Overcoming Multicollinearity In Multiple Regression Using Correlation Coefficient [J].
Zainodin, H. J. ;
Yap, S. J. .
INTERNATIONAL CONFERENCE ON MATHEMATICAL SCIENCES AND STATISTICS 2013 (ICMSS2013), 2013, 1557 :416-419
[14]   Multiple regression and correlation techniques: Recent controversies and best practices [J].
Hoyt, William T. ;
Imel, Zac E. ;
Chan, Fong .
REHABILITATION PSYCHOLOGY, 2008, 53 (03) :321-339
[15]   Spurious spatial regression with equal weights [J].
Baltagi, Badi H. ;
Liu, Long .
STATISTICS & PROBABILITY LETTERS, 2010, 80 (21-22) :1640-1642
[16]   Robust weighted regression via PAELLA sample weights [J].
Castejon-Limas, Manuel ;
Alaiz-Moreton, Hector ;
Fernandez-Robles, Laura ;
Alfonso-Cendon, Javier ;
Fernandez-Llamas, Camino ;
Sanchez-Gonzalez, Lidia ;
Perez, Hilde .
NEUROCOMPUTING, 2020, 391 :325-333
[17]   Applied Single Correlation Analysis and Multiple Regression Analysis for Rapid Prediction of Reservoir Sensitivity [J].
Lei, Qu .
PROCEEDINGS OF THE 2016 2ND WORKSHOP ON ADVANCED RESEARCH AND TECHNOLOGY IN INDUSTRY APPLICATIONS, 2016, 81 :556-562
[18]   Factors associated with sensitive regression weights: A fungible parameter approach [J].
Agler, Robert A. ;
De Boeck, Paul .
BEHAVIOR RESEARCH METHODS, 2020, 52 (01) :207-223
[19]   Improved Small Domain Estimation via Compromise Regression Weights [J].
Henderson, Nicholas C. ;
Varadhan, Ravi ;
Louis, Thomas A. .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2023, 118 (544) :2793-2809
[20]   Factors associated with sensitive regression weights: A fungible parameter approach [J].
Robert A. Agler ;
Paul De Boeck .
Behavior Research Methods, 2020, 52 :207-223