Simple Formula for Calculating Bias-corrected AIC in Generalized Linear Models

被引:4
|
作者
Imori, Shinpei [1 ]
Yanagihara, Hirokazu [1 ]
Wakaki, Hirofumi [1 ]
机构
[1] Hiroshima Univ, Grad Sch Sci, Dept Math, Higashihiroshima, Hiroshima 7398626, Japan
基金
日本学术振兴会;
关键词
stochastic expansion; maximum likelihood estimation; information criterion; variable selection; REGRESSION; VARIABLES; SELECTION;
D O I
10.1111/sjos.12049
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
In real-data analysis, deciding the best subset of variables in regression models is an important problem. Akaike's information criterion (AIC) is often used in order to select variables in many fields. When the sample size is not so large, the AIC has a non-negligible bias that will detrimentally affect variable selection. The present paper considers a bias correction of AIC for selecting variables in the generalized linear model (GLM). The GLM can express a number of statistical models by changing the distribution and the link function, such as the normal linear regression model, the logistic regression model, and the probit model, which are currently commonly used in a number of applied fields. In the present study, we obtain a simple expression for a bias-corrected AIC (corrected AIC, or CAIC) in GLMs. Furthermore, we provide an 'R' code based on our formula. A numerical study reveals that the CAIC has better performance than the AIC for variable selection.
引用
收藏
页码:535 / 555
页数:21
相关论文
共 50 条
  • [1] Bias-Corrected AIC for Selecting Variables in Poisson Regression Models
    Kamo, Ken-Ichi
    Yanagihara, Hirokazu
    Satoh, Kenichi
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2013, 42 (11) : 1911 - 1921
  • [2] Bias-Corrected Inference of High-Dimensional Generalized Linear Models
    Tang, Shengfei
    Shi, Yanmei
    Zhang, Qi
    MATHEMATICS, 2023, 11 (04)
  • [3] Bias-corrected AIC for selecting variables in multinomial logistic regression models
    Yanagihara, Hirokazu
    Kamo, Ken-ichi
    Imori, Shinpei
    Satoh, Kenichi
    LINEAR ALGEBRA AND ITS APPLICATIONS, 2012, 436 (11) : 4329 - 4341
  • [4] Covariance matrix of the bias-corrected maximum likelihood estimator in generalized linear models
    Gauss M. Cordeiro
    Denise A. Botter
    Alexsandro B. Cavalcanti
    Lúcia P. Barroso
    Statistical Papers, 2014, 55 : 643 - 652
  • [5] Covariance matrix of the bias-corrected maximum likelihood estimator in generalized linear models
    Cordeiro, Gauss M.
    Botter, Denise A.
    Cavalcanti, Alexsandro B.
    Barroso, Lucia P.
    STATISTICAL PAPERS, 2014, 55 (03) : 643 - 652
  • [6] Second-order bias-corrected AIC in multivariate normal linear models under non-normality
    Yanagihara, Hirokazu
    Kamo, Ken-Ichi
    Tonda, Tetsuji
    CANADIAN JOURNAL OF STATISTICS-REVUE CANADIENNE DE STATISTIQUE, 2011, 39 (01): : 126 - 146
  • [7] Robust estimation and bias-corrected empirical likelihood in generalized linear models with right censored data
    Xue, Liugen
    Xie, Junshan
    Yang, Xiaohui
    JOURNAL OF APPLIED STATISTICS, 2024, 51 (11) : 2197 - 2213
  • [8] Bias-corrected score decomposition for generalized quantiles
    Ehm, W.
    Ovcharov, E. Y.
    BIOMETRIKA, 2017, 104 (02) : 473 - 480
  • [9] A high-dimensional bias-corrected AIC for selecting response variables in multivariate calibration
    Oda, Ryoya
    Mima, Yoshie
    Yanagihara, Hirokazu
    Fujikoshi, Yasunori
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2021, 50 (14) : 3453 - 3476
  • [10] Stable and bias-corrected estimation for nonparametric regression models
    Lin, Lu
    Li, Feng
    JOURNAL OF NONPARAMETRIC STATISTICS, 2008, 20 (04) : 283 - 303