AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories

被引:24
|
作者
Li, Jialiang [1 ]
Lv, Jing [2 ]
Wan, Alan T. K. [3 ]
Liao, Jun [4 ]
机构
[1] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
[2] Southwest Univ, Sch Math & Stat, Chongqing 400715, Peoples R China
[3] City Univ Hong Kong, Dept Management Sci, Kowloon Tong, Hong Kong, Peoples R China
[4] Renmin Univ China, Sch Stat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Boosting; Model averaging; Model misspecification; Prediction accuracy; Smoothing; Vary coefficient structure identification; GENERALIZED LINEAR-MODELS; NONCONCAVE PENALIZED LIKELIHOOD; VARYING COEFFICIENT MODELS; VARIABLE SELECTION; STATISTICAL VIEW; DIMENSION REDUCTION; EVIDENCE CONTRARY; LOGISTIC-REGRESSION; JMLR; 9; CLASSIFICATION;
D O I
10.1080/01621459.2020.1790375
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Model average techniques are very useful for model-based prediction. However, most earlier works in this field focused on parametric models and continuous responses. In this article, we study varying coefficient multinomial logistic models and propose a semiparametric model averaging prediction (SMAP) approach for multi-category outcomes. The proposed procedure does not need any artificial specification of the index variable in the adopted varying coefficient sub-model structure to forecast the response. In particular, this new SMAP method is more flexible and robust against model misspecification. To improve the practical predictive performance, we combine SMAP with the AdaBoost algorithm to obtain more accurate estimations of class probabilities and model averaging weights. We compare our proposed methods with all existing model averaging approaches and a wide range of popular classification methods via extensive simulations. An automobile classification study is included to illustrate the merits of our methodology.for this article are available online.
引用
收藏
页码:495 / 509
页数:15
相关论文
共 50 条
  • [31] Hybrid link prediction via model averaging
    Zhang, Qi
    Tong, Tingting
    Wu, Shunyao
    PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS, 2020, 556
  • [32] Ranking Model Averaging: Ranking Based on Model Averaging
    Feng, Ziheng
    He, Baihua
    Xie, Tianfa
    Zhang, Xinyu
    Zong, Xianpeng
    INFORMS JOURNAL ON COMPUTING, 2024,
  • [33] Model selection and model averaging after multiple imputation
    Schomaker, Michael
    Heumann, Christian
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2014, 71 : 758 - 770
  • [34] Investigation on the improvement of prediction by bootstrap model averaging
    Holländer, N
    Augustin, NH
    Sauerbrei, W
    METHODS OF INFORMATION IN MEDICINE, 2006, 45 (01) : 44 - 50
  • [35] Model averaging for prediction with discrete Bayesian networks
    Dash, D
    Cooper, GF
    JOURNAL OF MACHINE LEARNING RESEARCH, 2004, 5 : 1177 - 1203
  • [36] Model averaging prediction for possibly nonstationary autoregressions
    Lin, Tzu-Chi
    Liu, Chu-An
    JOURNAL OF ECONOMETRICS, 2025, 249
  • [37] Improving Septic Shock Prediction with AdaBoost and Cox Regression Model
    Darwiche, Aiman
    EL-Geneidy, Ayman
    Mukherjee, Sumitra
    2021 IEEE INTERNATIONAL CONFERENCE ON CONSUMER ELECTRONICS AND COMPUTER ENGINEERING (ICCECE), 2021, : 522 - 527
  • [38] Model averaging for multivariate multiple regression models
    Zhu, Rong
    Zou, Guohua
    Zhang, Xinyu
    STATISTICS, 2018, 52 (01) : 205 - 227
  • [39] Robust model averaging prediction of longitudinal response with ultrahigh-dimensional covariates
    Jiang, Binyan
    Lv, Jing
    Li, Jialiang
    Cheng, Ming-Yen
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2024, : 337 - 361
  • [40] A Multiple Definitions Model of Classification Into Fuzzy Categories
    Gruenenfelder, Thomas M.
    FRONTIERS IN PSYCHOLOGY, 2019, 10