AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories

被引:24
|
作者
Li, Jialiang [1 ]
Lv, Jing [2 ]
Wan, Alan T. K. [3 ]
Liao, Jun [4 ]
机构
[1] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
[2] Southwest Univ, Sch Math & Stat, Chongqing 400715, Peoples R China
[3] City Univ Hong Kong, Dept Management Sci, Kowloon Tong, Hong Kong, Peoples R China
[4] Renmin Univ China, Sch Stat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Boosting; Model averaging; Model misspecification; Prediction accuracy; Smoothing; Vary coefficient structure identification; GENERALIZED LINEAR-MODELS; NONCONCAVE PENALIZED LIKELIHOOD; VARYING COEFFICIENT MODELS; VARIABLE SELECTION; STATISTICAL VIEW; DIMENSION REDUCTION; EVIDENCE CONTRARY; LOGISTIC-REGRESSION; JMLR; 9; CLASSIFICATION;
D O I
10.1080/01621459.2020.1790375
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Model average techniques are very useful for model-based prediction. However, most earlier works in this field focused on parametric models and continuous responses. In this article, we study varying coefficient multinomial logistic models and propose a semiparametric model averaging prediction (SMAP) approach for multi-category outcomes. The proposed procedure does not need any artificial specification of the index variable in the adopted varying coefficient sub-model structure to forecast the response. In particular, this new SMAP method is more flexible and robust against model misspecification. To improve the practical predictive performance, we combine SMAP with the AdaBoost algorithm to obtain more accurate estimations of class probabilities and model averaging weights. We compare our proposed methods with all existing model averaging approaches and a wide range of popular classification methods via extensive simulations. An automobile classification study is included to illustrate the merits of our methodology.for this article are available online.
引用
收藏
页码:495 / 509
页数:15
相关论文
共 50 条
  • [1] Semiparametric Model Averaging for Ultrahigh-Dimensional Conditional Quantile Prediction
    Guo, Chao Hui
    Lv, Jing
    Yang, Hu
    Tu, Jing Wen
    Tian, Chen Xiao
    ACTA MATHEMATICA SINICA-ENGLISH SERIES, 2023, 39 (06) : 1171 - 1202
  • [2] Semiparametric model averaging prediction for dichotomous response
    Fang, Fang
    Li, Jialiang
    Xia, Xiaochao
    JOURNAL OF ECONOMETRICS, 2022, 229 (02) : 219 - 245
  • [3] Model-averaging-based semiparametric modeling for conditional quantile prediction
    Guo, Chaohui
    Zhang, Wenyang
    SCIENCE CHINA-MATHEMATICS, 2024, 67 (12) : 2843 - 2872
  • [4] Semiparametric model averaging prediction for lifetime data via hazards regression
    Li, Jialiang
    Yu, Tonghui
    Lv, Jing
    Lee, Mei-Ling Ting
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES C-APPLIED STATISTICS, 2021, 70 (05) : 1187 - 1209
  • [5] Varying-coefficient semiparametric model averaging prediction
    Li, Jialiang
    Xia, Xiaochao
    Wong, Weng Kee
    Nott, David
    BIOMETRICS, 2018, 74 (04) : 1417 - 1426
  • [6] Composite quantile regression for ultra-high dimensional semiparametric model averaging
    Guo, Chaohui
    Lv, Jing
    Wu, Jibo
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2021, 160 (160)
  • [7] Semiparametric Model Averaging for Ultrahigh-Dimensional Conditional Quantile Prediction
    Chao Hui Guo
    Jing Lv
    Hu Yang
    Jing Wen Tu
    Chen Xiao Tian
    Acta Mathematica Sinica, English Series, 2023, 39 : 1171 - 1202
  • [8] Model averaging marginal regression for high dimensional conditional quantile prediction
    Tu, Jingwen
    Yang, Hu
    Guo, Chaohui
    Lv, Jing
    STATISTICAL PAPERS, 2021, 62 (06) : 2661 - 2689
  • [9] Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series
    Chen, Jia
    Li, Degui
    Linton, Oliver
    Lu, Zudi
    JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2018, 113 (522) : 919 - 932
  • [10] Semiparametric GARCH via Bayesian Model Averaging
    Chen, Wilson Ye
    Gerlach, Richard H.
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2021, 39 (02) : 437 - 452