AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories

被引:24
|
作者
Li, Jialiang [1 ]
Lv, Jing [2 ]
Wan, Alan T. K. [3 ]
Liao, Jun [4 ]
机构
[1] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
[2] Southwest Univ, Sch Math & Stat, Chongqing 400715, Peoples R China
[3] City Univ Hong Kong, Dept Management Sci, Kowloon Tong, Hong Kong, Peoples R China
[4] Renmin Univ China, Sch Stat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Boosting; Model averaging; Model misspecification; Prediction accuracy; Smoothing; Vary coefficient structure identification; GENERALIZED LINEAR-MODELS; NONCONCAVE PENALIZED LIKELIHOOD; VARYING COEFFICIENT MODELS; VARIABLE SELECTION; STATISTICAL VIEW; DIMENSION REDUCTION; EVIDENCE CONTRARY; LOGISTIC-REGRESSION; JMLR; 9; CLASSIFICATION;
D O I
10.1080/01621459.2020.1790375
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Model average techniques are very useful for model-based prediction. However, most earlier works in this field focused on parametric models and continuous responses. In this article, we study varying coefficient multinomial logistic models and propose a semiparametric model averaging prediction (SMAP) approach for multi-category outcomes. The proposed procedure does not need any artificial specification of the index variable in the adopted varying coefficient sub-model structure to forecast the response. In particular, this new SMAP method is more flexible and robust against model misspecification. To improve the practical predictive performance, we combine SMAP with the AdaBoost algorithm to obtain more accurate estimations of class probabilities and model averaging weights. We compare our proposed methods with all existing model averaging approaches and a wide range of popular classification methods via extensive simulations. An automobile classification study is included to illustrate the merits of our methodology.for this article are available online.
引用
收藏
页码:495 / 509
页数:15
相关论文
共 50 条
  • [41] Jackknife Model Averaging for Composite Quantile Regression
    You, Kang
    Wang, Miaomiao
    Zou, Guohua
    JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2024, 37 (04) : 1604 - 1637
  • [42] Mallows model averaging with effective model size in fragmentary data prediction
    Yuan, Chaoxia
    Fang, Fang
    Ni, Lyu
    COMPUTATIONAL STATISTICS & DATA ANALYSIS, 2022, 173
  • [43] Protein crystallization prediction with AdaBoost
    Hsieh, Cheng-Wei
    Hsu, Hui-Huang
    Pai, Tun-Wen
    INTERNATIONAL JOURNAL OF DATA MINING AND BIOINFORMATICS, 2013, 7 (02) : 214 - 227
  • [44] Semiparametric quantile averaging in the presence of high-dimensional predictors
    De Gooijer, Jan G.
    Zerom, Dawit
    INTERNATIONAL JOURNAL OF FORECASTING, 2019, 35 (03) : 891 - 909
  • [45] MALMEM: model averaging in linear measurement error models
    Zhang, Xinyu
    Ma, Yanyuan
    Carroll, Raymond J.
    JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2019, 81 (04) : 763 - 779
  • [46] On improvability of model selection by model averaging
    Peng, Jingfu
    Yang, Yuhong
    JOURNAL OF ECONOMETRICS, 2022, 229 (02) : 246 - 262
  • [47] Improved Software Reliability Prediction by Using Model Stacking and Averaging
    Karaomer, Rabia Burcu
    Yet, Barbaros
    Chouseinoglou, Oumout
    2019 45TH EUROMICRO CONFERENCE ON SOFTWARE ENGINEERING AND ADVANCED APPLICATIONS (SEAA 2019), 2019, : 186 - 192
  • [48] Renewable prediction of model averaging in the Cox proportional hazards model with streaming data
    Li, Mengyu
    Wang, Xiaoguang
    JOURNAL OF STATISTICAL COMPUTATION AND SIMULATION, 2025,
  • [49] On Tuning Parameter Selection in Model Selection and Model Averaging: A Monte Carlo Study
    Xiao, Hui
    Sun, Yiguo
    JOURNAL OF RISK AND FINANCIAL MANAGEMENT, 2019, 12 (03)
  • [50] Model averaging prediction for nonparametric varying-coefficient models with B-spline smoothing
    Xia, Xiaochao
    STATISTICAL PAPERS, 2021, 62 (06) : 2885 - 2905