Model selection using information criteria under a new estimation method: least squares ratio

被引:4
|
作者
Deniz, Eylem [1 ]
Akbilgic, Oguz [2 ]
Howe, J. Andrew
机构
[1] Mimar Sinan Fine Arts Univ, Fac Sci & Letters, Dept Stat, Istanbul, Turkey
[2] Istanbul Univ, Fac Business Adm, Dept Quantitat Tech, Istanbul, Turkey
关键词
model selection; least squares ratio; subset selection; information criteria; LINEAR-REGRESSION; COMPLEXITY;
D O I
10.1080/02664763.2010.545111
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this study, we evaluate several forms of both Akaike-type and Information Complexity (ICOMP)-type information criteria, in the context of selecting an optimal subset least squares ratio (LSR) regression model. Our simulation studies are designed to mimic many characteristics present in real data - heavy tails, multicollinearity, redundant variables, and completely unnecessary variables. Our findings are that LSR in conjunction with one of the ICOMP criteria is very good at selecting the true model. Finally, we apply these methods to the familiar body fat data set.
引用
收藏
页码:2043 / 2050
页数:8
相关论文
共 50 条
  • [21] Nonlinear predictive model selection and model averaging using information criteria
    Gu, Yuanlin
    Wei, Hua-Liang
    Balikhin, Michael M.
    SYSTEMS SCIENCE & CONTROL ENGINEERING, 2018, 6 (01) : 319 - 328
  • [22] Structural Break Inference Using Information Criteria in Models Estimated by Two-Stage Least Squares
    Hall, Alastair R.
    Osborn, Denise R.
    Sakkas, Nikolaos
    JOURNAL OF TIME SERIES ANALYSIS, 2015, 36 (05) : 741 - 762
  • [23] Robust mixture regression modeling using the least trimmed squares (LTS)-estimation method
    Dogru, Fatma Zehra
    Arslan, Olcay
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2018, 47 (07) : 2184 - 2196
  • [24] Model selection for partial least squares based dimension reduction
    Li, Guo-Zheng
    Zhao, Rui-Wei
    Qu, Hai-Ni
    You, Mingyu
    PATTERN RECOGNITION LETTERS, 2012, 33 (05) : 524 - 529
  • [25] Statistical and Heuristic Model Selection in Regularized Least-Squares
    Braga, Igor
    Monard, Maria Carolina
    2013 BRAZILIAN CONFERENCE ON INTELLIGENT SYSTEMS (BRACIS), 2013, : 231 - 236
  • [26] Model selection in multivariate adaptive regressions splines (MARS) using alternative information criteria
    Adiguzel, Meryem Bekar
    Cengiz, Mehmet Ali
    HELIYON, 2023, 9 (09)
  • [27] Model selection via information criteria
    Talata Z.
    Periodica Mathematica Hungarica, 2005, 51 (1) : 99 - 117
  • [28] A fuzzy logistic regression model based on the least squares estimation
    Gao, Yifan
    Lu, Qiujun
    COMPUTATIONAL & APPLIED MATHEMATICS, 2018, 37 (03) : 3562 - 3579
  • [29] Model validation and selection for personalized medicine using dynamic-weighted ordinary least squares
    Wallace, Michael P.
    Moodie, Erica E. M.
    Stephens, David A.
    STATISTICAL METHODS IN MEDICAL RESEARCH, 2017, 26 (04) : 1641 - 1653
  • [30] Information criteria for variable selection under sparsity
    Jansen, Maarten
    BIOMETRIKA, 2014, 101 (01) : 37 - 55