Model averaging estimation for generalized partially linear varying-coefficient models

被引:1
作者
Zheng, Shengbin [1 ]
Xue, Yuan [2 ]
Zhao, Junlong [1 ]
Li, Gaorong [1 ]
机构
[1] Beijing Normal Univ, Sch Stat, Beijing 100875, Peoples R China
[2] Univ Int Business & Econ, Sch Stat, Beijing 100029, Peoples R China
基金
中国国家自然科学基金;
关键词
generalized semiparametric model; Kullback-Leibler divergence; model averaging estimation; varying-coefficient model; NONCONCAVE PENALIZED LIKELIHOOD; SELECTION; REGRESSION;
D O I
10.1002/sta4.520
中图分类号
O21 [概率论与数理统计]; C8 [统计学];
学科分类号
020208 ; 070103 ; 0714 ;
摘要
Model averaging has long been used as a powerful approach to reduce the risk of model misspecification. However, there is little work on model averaging methods under generalized semiparametric models. In this article, we study model averaging in generalized partially linear varying-coefficient models and propose a semiparametric model averaging estimation (SMAE) method for the canonical parameters. Specifically, we take the partially linear varying-coefficient model as candidate models in which there is only one varying-coefficient component. The different covariates could enjoy the benefit of matching the optimal degrees of freedom and each candidate model can take into account the confounding effects among predictors as well. Moreover, the weight choice criterion based on the Kullback-Leibler divergence is adopted to determine the weights. We prove that the corresponding model averaging estimator is asymptotically optimal under certain regularity conditions. Finally, some simulation studies and a real data analysis are conducted to compare with existing methods, and the results show that the proposed method has better out-of-sample performance.
引用
收藏
页数:13
相关论文
共 28 条
[1]   NEW LOOK AT STATISTICAL-MODEL IDENTIFICATION [J].
AKAIKE, H .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1974, AC19 (06) :716-723
[2]   A WEIGHT-RELAXED MODEL AVERAGING APPROACH FOR HIGH-DIMENSIONAL GENERALIZED LINEAR MODELS [J].
Ando, Tomohiro ;
Li, Ker-Chau .
ANNALS OF STATISTICS, 2017, 45 (06) :2654-2679
[3]   A Model-Averaging Approach for High-Dimensional Regression [J].
Ando, Tomohiro ;
Li, Ker-Chau .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2014, 109 (505) :254-265
[4]   BETTER SUBSET REGRESSION USING THE NONNEGATIVE GARROTE [J].
BREIMAN, L .
TECHNOMETRICS, 1995, 37 (04) :373-384
[5]   Model selection: An integral part of inference [J].
Buckland, ST ;
Burnham, KP ;
Augustin, NH .
BIOMETRICS, 1997, 53 (02) :603-618
[6]   Semiparametric Ultra-High Dimensional Model Averaging of Nonlinear Dynamic Time Series [J].
Chen, Jia ;
Li, Degui ;
Linton, Oliver ;
Lu, Zudi .
JOURNAL OF THE AMERICAN STATISTICAL ASSOCIATION, 2018, 113 (522) :919-932
[7]   Sure independence screening for ultrahigh dimensional feature space [J].
Fan, Jianqing ;
Lv, Jinchi .
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES B-STATISTICAL METHODOLOGY, 2008, 70 :849-883
[8]   SURE INDEPENDENCE SCREENING IN GENERALIZED LINEAR MODELS WITH NP-DIMENSIONALITY [J].
Fan, Jianqing ;
Song, Rui .
ANNALS OF STATISTICS, 2010, 38 (06) :3567-3604
[9]  
Fan JQ, 2008, STAT INTERFACE, V1, P179
[10]   Nonconcave penalized likelihood with a diverging number of parameters [J].
Fan, JQ ;
Peng, H .
ANNALS OF STATISTICS, 2004, 32 (03) :928-961