Model selection using information criteria under a new estimation method: least squares ratio

被引:4
|
作者
Deniz, Eylem [1 ]
Akbilgic, Oguz [2 ]
Howe, J. Andrew
机构
[1] Mimar Sinan Fine Arts Univ, Fac Sci & Letters, Dept Stat, Istanbul, Turkey
[2] Istanbul Univ, Fac Business Adm, Dept Quantitat Tech, Istanbul, Turkey
关键词
model selection; least squares ratio; subset selection; information criteria; LINEAR-REGRESSION; COMPLEXITY;
D O I
10.1080/02664763.2010.545111
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In this study, we evaluate several forms of both Akaike-type and Information Complexity (ICOMP)-type information criteria, in the context of selecting an optimal subset least squares ratio (LSR) regression model. Our simulation studies are designed to mimic many characteristics present in real data - heavy tails, multicollinearity, redundant variables, and completely unnecessary variables. Our findings are that LSR in conjunction with one of the ICOMP criteria is very good at selecting the true model. Finally, we apply these methods to the familiar body fat data set.
引用
收藏
页码:2043 / 2050
页数:8
相关论文
共 50 条
  • [41] On measures of information and divergence and model selection criteria
    Karagrigoriou, Alex
    Papaioannou, Takis
    STATISTICAL MODELS AND METHODS FOR BIOMEDICAL AND TECHNICAL SYSTEMS, 2008, : 503 - +
  • [42] Using Experimental Data and Information Criteria to Guide Model Selection for Reaction–Diffusion Problems in Mathematical Biology
    David J. Warne
    Ruth E. Baker
    Matthew J. Simpson
    Bulletin of Mathematical Biology, 2019, 81 : 1760 - 1804
  • [43] Model selection for dynamical systems via sparse regression and information criteria
    Mangan, N. M.
    Kutz, J. N.
    Brunton, S. L.
    Proctor, J. L.
    PROCEEDINGS OF THE ROYAL SOCIETY A-MATHEMATICAL PHYSICAL AND ENGINEERING SCIENCES, 2017, 473 (2204):
  • [44] CONSISTENCY OF A CLASS OF INFORMATION CRITERIA FOR MODEL SELECTION IN NONLINEAR-REGRESSION
    HAUGHTON, D
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 1991, 20 (5-6) : 1619 - 1629
  • [45] Prediction-Oriented Model Selection in Partial Least Squares Path Modeling
    Sharma, Pratyush Nidhi
    Shmueli, Galit
    Sarstedt, Marko
    Danks, Nicholas
    Ray, Soumya
    DECISION SCIENCES, 2021, 52 (03) : 567 - 607
  • [46] Variable selection in regression models using nonstandard optimisation of information criteria
    Kapetanios, George
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2007, 52 (01) : 4 - 15
  • [47] Model slection using information criteria and genetic algorithms
    Balcombe K.G.
    Computational Economics, 2005, 25 (3) : 207 - 228
  • [48] Consistency of information criteria for model selection with missing data
    El Matouat, Abdelaziz
    Moussa, Freedath Djibril
    Hamzaoui, Hassania
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2016, 45 (23) : 6900 - 6914
  • [49] Information and other criteria in structural equation model selection
    Haughton, DMA
    Oud, JHL
    Jansen, RARG
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 1997, 26 (04) : 1477 - 1516
  • [50] Model Selection Criteria Using Divergences
    Toma, Aida
    ENTROPY, 2014, 16 (05): : 2686 - 2698