A ROBUST CONSISTENT INFORMATION CRITERION FOR MODEL SELECTION BASED ON EMPIRICAL LIKELIHOOD

被引:5
|
作者
Chen, Chixiang [1 ]
Wang, Ming [2 ]
Wu, Rongling [2 ]
Li, Runze [3 ]
机构
[1] Univ Maryland, Div Biostat & Bioinformat, Sch Med, Baltimore, MD 21201 USA
[2] Penn State Coll Med, Dept Publ Hlth Sci, Div Biostat & Bioinformat, Hershey, PA 17033 USA
[3] Penn State Univ, Dept Stat & Methodol Ctr, University Pk, PA 16802 USA
关键词
Consistency; empirical likelihood; model selection; GENERALIZED ESTIMATING EQUATIONS; WORKING-CORRELATION-STRUCTURE; LONGITUDINAL DATA;
D O I
10.5705/ss.202020.0254
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Conventional likelihood-based information criteria for model selection rely on the assumed distribution of the data. However, for complex data, specifying this underlying distribution turns out to be challenging, and existing criteria may be limited and not sufficiently general to handle various model-selection problems. Here, we propose a robust and consistent model-selection criterion based on the empirical likelihood function, which is data driven. In particular, this framework adopts plug-in estimators that can be achieved by solving external estimating equations not limited to the empirical likelihood. This avoids potential computationalconvergence issues and allows for versatile applications, such as generalized linear models, generalized estimating equations, and penalized regressions. The proposed criterion is derived initially from the asymptotic expansion of the marginal likelihood under a variable-selection framework, but more importantly, the consistent model-selection property is established in a general context. Extensive simulation studies confirm that the proposed model-selection criterion outperforms traditional criteria. Finally, an application to the Atherosclerosis Risk in Communities Study illustrates the practical value of the proposed framework.
引用
收藏
页码:1205 / 1223
页数:19
相关论文
共 50 条
  • [1] ELCIC: An R package for model selection using the empirical-likelihood based information criterion
    Chen, Chixiang
    Shen, Biyi
    Wang, Ming
    COMMUNICATIONS FOR STATISTICAL APPLICATIONS AND METHODS, 2023, 30 (04) : 355 - 368
  • [2] An information criterion for likelihood selection
    Yuan, A
    Clarke, B
    IEEE TRANSACTIONS ON INFORMATION THEORY, 1999, 45 (02) : 562 - 571
  • [3] Generalized Empirical Likelihood-Based Focused Information Criterion and Model Averaging
    Sueishi, Naoya
    ECONOMETRICS, 2013, 1 (02): : 141 - 156
  • [4] A strongly consistent information criterion for linear model selection based on M-estimation
    Y. Wu
    M. M. Zen
    Probability Theory and Related Fields, 1999, 113 : 599 - 625
  • [5] A strongly consistent information criterion for linear model selection based on M-estimation
    Wu, Y
    Zen, MM
    PROBABILITY THEORY AND RELATED FIELDS, 1999, 113 (04) : 599 - 625
  • [6] Model information metric based on selection criterion
    Duan, XJ
    Du, XY
    Wang, ZM
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 467 - 471
  • [7] INFORMATION CRITERION IN MODEL SELECTION
    KLEIN, RW
    ECONOMICS LETTERS, 1979, 3 (03) : 243 - 248
  • [8] A new model selection criterion based on information geometry
    Liu, YH
    Luo, SW
    Li, AJ
    Yu, HB
    2004 7TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS, VOLS 1-3, 2004, : 1562 - 1565
  • [9] Copula information criterion for model selection with two-stage maximum likelihood estimation
    Ko, Vinnie
    Hjort, Nils Lid
    ECONOMETRICS AND STATISTICS, 2019, 12 : 167 - 180
  • [10] Hidden Gibbs random fields model selection using Block Likelihood Information Criterion
    Stoehr, Julien
    Marin, Jean-Michel
    Pudlo, Pierre
    STAT, 2016, 5 (01): : 158 - 172