AdaBoost Semiparametric Model Averaging Prediction for Multiple Categories

被引:24
|
作者
Li, Jialiang [1 ]
Lv, Jing [2 ]
Wan, Alan T. K. [3 ]
Liao, Jun [4 ]
机构
[1] Natl Univ Singapore, Dept Stat & Appl Probabil, Singapore, Singapore
[2] Southwest Univ, Sch Math & Stat, Chongqing 400715, Peoples R China
[3] City Univ Hong Kong, Dept Management Sci, Kowloon Tong, Hong Kong, Peoples R China
[4] Renmin Univ China, Sch Stat, Beijing, Peoples R China
基金
中国国家自然科学基金;
关键词
Boosting; Model averaging; Model misspecification; Prediction accuracy; Smoothing; Vary coefficient structure identification; GENERALIZED LINEAR-MODELS; NONCONCAVE PENALIZED LIKELIHOOD; VARYING COEFFICIENT MODELS; VARIABLE SELECTION; STATISTICAL VIEW; DIMENSION REDUCTION; EVIDENCE CONTRARY; LOGISTIC-REGRESSION; JMLR; 9; CLASSIFICATION;
D O I
10.1080/01621459.2020.1790375
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Model average techniques are very useful for model-based prediction. However, most earlier works in this field focused on parametric models and continuous responses. In this article, we study varying coefficient multinomial logistic models and propose a semiparametric model averaging prediction (SMAP) approach for multi-category outcomes. The proposed procedure does not need any artificial specification of the index variable in the adopted varying coefficient sub-model structure to forecast the response. In particular, this new SMAP method is more flexible and robust against model misspecification. To improve the practical predictive performance, we combine SMAP with the AdaBoost algorithm to obtain more accurate estimations of class probabilities and model averaging weights. We compare our proposed methods with all existing model averaging approaches and a wide range of popular classification methods via extensive simulations. An automobile classification study is included to illustrate the merits of our methodology.for this article are available online.
引用
收藏
页码:495 / 509
页数:15
相关论文
共 50 条
  • [21] Model averaging estimator for semiparametric mixed effects models with measurement errors
    Chang, Baoqun
    Wu, Liucang
    Li, Na
    COMMUNICATIONS IN STATISTICS-SIMULATION AND COMPUTATION, 2025,
  • [22] Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data
    Hu, Guozhi
    Cheng, Weihu
    Zeng, Jie
    MATHEMATICS, 2023, 11 (03)
  • [23] Optimal model averaging for semiparametric partially linear models with measurement errors
    Hu, Guozhi
    Cheng, Weihu
    Zeng, Jie
    Guan, Ruijie
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2024, 230
  • [24] Model Averaging for Prediction With Fragmentary Data
    Fang, Fang
    Lan, Wei
    Tong, Jingjing
    Shao, Jun
    JOURNAL OF BUSINESS & ECONOMIC STATISTICS, 2019, 37 (03) : 517 - 527
  • [25] Model averaging for generalized linear models in fragmentary data prediction
    Yuan, Chaoxia
    Wu, Yang
    Fang, Fang
    STATISTICAL THEORY AND RELATED FIELDS, 2022, 6 (04) : 344 - 352
  • [26] Model selection in semiparametric expectile regression
    Spiegel, Elmar
    Sobotka, Fabian
    Kneib, Thomas
    ELECTRONIC JOURNAL OF STATISTICS, 2017, 11 (02): : 3008 - 3038
  • [27] Model averaging marginal regression for high dimensional conditional quantile prediction
    Jingwen Tu
    Hu Yang
    Chaohui Guo
    Jing Lv
    Statistical Papers, 2021, 62 : 2661 - 2689
  • [28] Model averaging prediction for survival data with time-dependent effects
    Wang, Xiaoguang
    Hu, Rong
    Li, Mengyu
    JOURNAL OF STATISTICAL PLANNING AND INFERENCE, 2025, 238
  • [29] A flexible semiparametric forecasting model for time series
    Li, Degui
    Linton, Oliver
    Lu, Zudi
    JOURNAL OF ECONOMETRICS, 2015, 187 (01) : 345 - 357
  • [30] Jackknife model averaging for additive expectile prediction
    Sun, Xianwen
    Zhang, Lixin
    COMMUNICATIONS IN STATISTICS-THEORY AND METHODS, 2024, 53 (19) : 6799 - 6831