Optimal Distributed Model Averaging for Multivariate Additive Model

被引:0
作者
Song, Minghui [1 ]
Qu, Tianyao [1 ]
Zhao, Zhihao [2 ]
Zou, Guohua [1 ]
机构
[1] Capital Normal Univ, Sch Math Sci, Beijing 100048, Peoples R China
[2] Capital Univ Econ & Business, Sch Stat, Beijing 100070, Peoples R China
基金
中国国家自然科学基金;
关键词
Additive model; asymptotic optimality; consistency; distributed algorithm; weight choice; REGRESSION;
D O I
10.1007/s11424-025-5054-y
中图分类号
O1 [数学];
学科分类号
0701 ; 070101 ;
摘要
In the era of massive data, the study of distributed data is a significant topic. Model averaging can be effectively applied to distributed data by combining information from all machines. For linear models, the model averaging approach has been developed in the context of distributed data. However, further investigation is needed for more complex models. In this paper, the authors propose a distributed optimal model averaging approach based on multivariate additive models, which approximates unknown functions using B-splines allowing each machine to have a different smoothing degree. To utilize the information from the covariance matrix of dependent errors in multivariate multiple regressions, the authors use the Mahalanobis distance to construct a Mallows-type weight choice criterion. The criterion can be computed by transmitting information between the local machines and the center machine in two steps. The authors demonstrate the asymptotic optimality of the proposed model averaging estimator when the covariates are subject to uncertainty, and obtain the convergence rate of the weight vector to the theoretically optimal weights. The results remain novel even for additive models with a single response variable. The numerical examples show that the proposed method yields good performance.
引用
收藏
页数:25
相关论文
共 31 条
[31]   Model averaging for multivariate multiple regression models [J].
Zhu, Rong ;
Zou, Guohua ;
Zhang, Xinyu .
STATISTICS, 2018, 52 (01) :205-227