Model selection using information criteria under a new estimation method: least squares ratio

被引:4
|
作者
Deniz, Eylem [1 ]
Akbilgic, Oguz [2 ]
Howe, J. Andrew
机构
[1] Mimar Sinan Fine Arts Univ, Fac Sci & Letters, Dept Stat, Istanbul, Turkey
[2] Istanbul Univ, Fac Business Adm, Dept Quantitat Tech, Istanbul, Turkey
关键词
model selection; least squares ratio; subset selection; information criteria; LINEAR-REGRESSION; COMPLEXITY;
D O I
10.1080/02664763.2010.545111
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this study, we evaluate several forms of both Akaike-type and Information Complexity (ICOMP)-type information criteria, in the context of selecting an optimal subset least squares ratio (LSR) regression model. Our simulation studies are designed to mimic many characteristics present in real data - heavy tails, multicollinearity, redundant variables, and completely unnecessary variables. Our findings are that LSR in conjunction with one of the ICOMP criteria is very good at selecting the true model. Finally, we apply these methods to the familiar body fat data set.
引用
收藏
页码:2043 / 2050
页数:8
相关论文
共 50 条
  • [1] Model selection of M-estimation models using least squares approximation
    Mao, Guangyu
    STATISTICS & PROBABILITY LETTERS, 2015, 99 : 238 - 243
  • [2] Information criteria for model selection
    Zhang, Jiawei
    Yang, Yuhong
    Ding, Jie
    WILEY INTERDISCIPLINARY REVIEWS-COMPUTATIONAL STATISTICS, 2023, 15 (05)
  • [3] Model selection by sequentially normalized least squares
    Rissanen, Jorma
    Roos, Teemu
    Myllymaki, Petri
    JOURNAL OF MULTIVARIATE ANALYSIS, 2010, 101 (04) : 839 - 849
  • [4] On information criteria and the generalized likelihood ratio test of model order selection
    Stoica, P
    Selén, Y
    Li, J
    IEEE SIGNAL PROCESSING LETTERS, 2004, 11 (10) : 794 - 797
  • [5] Information and posterior probability criteria for model selection in local likelihood estimation
    Irizarry, RA
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2001, 96 (453) : 303 - 315
  • [6] AIC under the framework of least squares estimation
    Banks, H. T.
    Joyner, Michele L.
    APPLIED MATHEMATICS LETTERS, 2017, 74 : 33 - 45
  • [7] Model selection for partial least squares regression
    Li, BB
    Morris, J
    Martin, EB
    CHEMOMETRICS AND INTELLIGENT LABORATORY SYSTEMS, 2002, 64 (01) : 79 - 89
  • [8] Quantum information criteria for model selection in quantum state estimation
    Yano, Hiroshi
    Yamamoto, Naoki
    JOURNAL OF PHYSICS A-MATHEMATICAL AND THEORETICAL, 2023, 56 (40)
  • [9] Another look at subset selection using linear least squares
    Miller, AJ
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2000, 29 (9-10) : 2005 - 2017
  • [10] Robust Total Least Squares Estimation Method for Uncertain Linear Regression Model
    Shi, Hongmei
    Zhang, Xingbo
    Gao, Yuzhen
    Wang, Shuai
    Ning, Yufu
    MATHEMATICS, 2023, 11 (20)